19,99 €
Mehr erfahren.
- Herausgeber: John Wiley & Sons
- Kategorie: Wissenschaft und neue Technologien
- Sprache: Englisch
Learn to navigate a world of deepfakes, phishing attacks, and other cybersecurity threats emanating from generative artificial intelligence
In an era where artificial intelligence can create content indistinguishable from reality, how do we separate truth from fiction? In FAIK: A Practical Guide to Living in a World of Deepfakes, Disinformation, and AI-Generated Deceptions, cybersecurity and deception expert Perry Carpenter unveils the hidden dangers of generative artificial intelligence, showing you how to use these technologies safely while protecting yourself and others from cyber scams and threats. This book provides a crucial understanding of the potential risks associated with generative AI, like ChatGPT, Claude, and Gemini, offering effective strategies to avoid falling victim to their more sinister uses.
This isn't just another book about technology – it's your survival guide to the digital jungle. Carpenter takes you on an insightful journey through the "Exploitation Zone," where rapid technological advancements outpace our ability to adapt, creating fertile ground for deception. Explore the mechanics behind deepfakes, disinformation, and other cognitive security threats. Discover how cybercriminals can leverage even the most trusted AI systems to create and spread synthetic media and use it for malicious purposes. At its core, FAIK is an empowering exposé in which Carpenter effectively weaves together engaging narratives and practical insights, all aimed to equip you with the knowledge to recognize and counter advanced tactics with practical media literacy skills and a deep understanding of social engineering.
You will:
- Learn to think like a hacker to better defend against digital threats.
- Gain practical skills to identify and defend against AI-driven scams.
- Develop your toolkit to safely navigate the "Exploitation Zone."
- See how bad actors exploit fundamental aspects of generative AI to create weapons grade deceptions.
- Develop practical skills to identify and resist emotional manipulation in digital content.
Most importantly, this is ultimately an optimistic book as it predicts a powerful and positive outcome as a period of cooperation, something now inconceivable, develops as it always does during crises and the future is enhanced by amazing new technologies and fabulous opportunities on the near horizon.
Written by an expert, yet accessible to everyone, FAIK is an indispensable resource for anyone who uses technology and wants to stay secure in the evolving digital landscape. This book not only prepares you to face the onslaught of digital deceptions and AI-generated threats, but also teaches you to think like a hacker to better defend against them.
Sie lesen das E-Book in den Legimi-Apps auf:
Seitenzahl: 401
Veröffentlichungsjahr: 2024
Ähnliche
Table of Contents
Cover
Table of Contents
Title Page
Foreword
Introduction: Riddle Me This, ChatGPT
A Tale of Two Intelligences
Deception: What’s Old Is New Again
The AI Inflection Point
How to Read This Book
My Approach to AI, Life, and This Book
A Bit About Me
A Quick Look at What’s Ahead
A New Hope
Notes
Chapter 1: The Eternal Battle for the Mind: Why You Should Care
Whispers from the Static
Pleased to Meet You, Hope You Guessed My Name
The Historical Context of Deception and Scams
The Digital Age: A New Era of Deception
The Far-Reaching Implications of Synthetic Media
Why Synthetic Media Slips Right Past Our Defenses
Cognitive Security 101: Protecting Our Minds in the Digital Age
Takeaways
Notes
Chapter 2: The New Frontiers of Deception: AI and Synthetic Media
Whispers from the Static
Inflection Points
Brief History of AI Advances
Is AI Alive and Does It Really Understand?
Takeaways
Notes
Chapter 3: The Mindset and Tools of a Digital Manipulator
Whispers from the Static
How Hackers Approach Technology and Problem Solving
Deceptionology 101: Introduction to the Dark Arts
Peering Down the Rabbit Hole
Takeaways
Notes
Chapter 4: Bias, Data Poisoning, & Output Oddities
Whispers from the Static
Hallucinations: AI’s Double-Edged Sword of Creativity
The Big Bias Problem
Embarrassing F{ai}lures to Control Bias
The Consequences and Way Forward
Takeaways
Notes
Chapter 5: The Digital Disinformation Pandemic
Whispers from the Static
Lies, Darn Lies, and the Internet
The Landscape of AI-Driven Disinformation
Types and Tactics of AI-Generated Disinformation
Notes
Chapter 6: Deepfakes and the Spectrum of Digital Deception
Whispers from the Static
On the Internet, Nobody Knows You’re a Dog
What Really Is a Deepfake, Anyway?
The Chilling Effectiveness of Low-Tech Deception
Breaking Bad: How Bad Actors Can Corrupt the Morals of AI Systems
When Jailbreaking Is Overrated: Uncensored AI Systems
Weaponizing Innocent Outputs
An Inconvenient Truth About Digital Deceptions
Takeaways
Notes
Chapter 7: The Now and Future of AI-Driven Deception
Whispers from the Static
Into the Exploitation Zone
The Pillars of Deception, Scams, and Crime
AI-Powered Scams: Old Tricks, New Tools
Emerging Threats
A Personal Story: How I Created Multiple GenAI-Powered ScamBots
Finding Hope
Takeaways
Notes
Chapter 8: Media Literacy in the Age of AI: Your First Line of Defense
Whispers from the Static
The Fight for Truth
A Quick Note before We Jump In
Media Literacy in the Digital Age: Your Survival Guide to the Information Jungle
The Fact-Checking Paradox: Seeking Truth in a World of Lies
Takeaways
Notes
Chapter 9: Cognitive and Technical Defense Strategies: Tools for Protection
Whispers from the Static
Building Our Cognitive Defenses
Tech-Based Defenses
Wrapping Up: Vigilance in the Digital Age
Let’s Make It Fun: Sharpen Your Mental and Digital Defense Skills
Takeaways
Notes
Chapter 10: A New Hope
Whispers from the Static
Criminals Have Means, Motive, and Opportunity. But so Do We
Let’s Make It Fun: Make It Real
Takeaways
Notes
Appendix: Tips, Tricks, and Resources
Keeping It Real in the Age of AI: A Family Guide
Top Five Security Tips and Practices
Stay Up-to-Date: Digital Info Sources
Recommended Books
Notes
Chapter 1
Chapter 2
Chapter 3
Chapter 4
Chapter 5
Chapter 6
Chapter 7
Chapter 8
Chapter 9
Acknowledgments
About the Author
Index
Copyright
Dedication
End User License Agreement
List of Illustrations
Chapter 2
Figure 2.1 ChatGPT shatters records, reaching 100 million active users in on...
Chapter 3
Figure 3.1 Meet Lina.
Figure 3.2 This chart, based on Google X’s Astro Teller’s diagram, shows hum...
Chapter 4
Figure 4.1 A tasty LLM birthday cake analogy
Figure 4.2 Tweet from TechCrunch capturing the moment Google used Gemini to...
Figure 4.3 Not the kind of headlines Google was hoping for
Figure 4.4 Polluted search result from mid/late 2023
Figure 4.5 Yep, still broken in June 2024
Chapter 5
Figure 5.1 The progression of technology from nation-state grade to “folk” g...
Chapter 6
Figure 6.1 Nobody knows you’re a dog.SOURCE: With permission of Agus Barri...
Figure 6.2 Forward and reverse diffusion process. Image inspired by a Twitte...
Figure 6.3 Example outputs from MidJourney and DALL-E. Both are diffusion mo...
Figure 6.4 Original deceptive meme from Turning Point USA
Figure 6.5 Original photo from 2011
Figure 6.6 Explicitly asking the LLM to do something sketchy
Figure 6.7 I reframed the request and was able to achieve compliance.
Figure 6.8 Jackpot! The sweet nectar of forbidden knowledge
Figure 6.9 Masking prompts in ASCII artSOURCE: Adapted from https://arxiv....
Figure 6.10 Rachel Tobac’s post about how bad actors can weaponize “innocent...
Chapter 7
Figure 7.1 Use of AI helps participants of mediocre skill outperform experts...
Chapter 8
Figure 8.1 The classic crime triangle. Note that I updated the center circle...
Figure 8.2 The 3N model puts our minds squarely in the crosshairs.
Chapter 9
Figure 9.1 Our minds love what we already agree with and minimize anything w...
Figure 9.2 Attackers often find it easier to exploit human vulnerabilities t...
Guide
Cover
Table of Contents
Title Page
Copyright
Dedication
Foreword
Introduction: Riddle Me This, ChatGPT
Begin Reading
Appendix: Tips, Tricks, and Resources
Notes
Acknowledgments
About the Author
Index
End User License Agreement
Pages
i
ix
x
xi
xii
xiii
xiv
xv
xvi
xvii
xviii
xix
xx
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
259
260
261
262
263
264
265
266
267
268
ii
iii
269
FAIK
A Practical Guide to Living in a World of Deepfakes, Disinformation, and AI-Generated Deceptions
Perry Carpenter
Foreword
I just stood in front of 1,500+ people and hacked Perry Carpenter live on stage.
Well, it was a controlled demonstration, and he knew it was coming—no real harm done. But the techniques? Those were 100 percent legit and work even better when the target is caught unaware.
Over the years, I’ve earned a bit of a reputation for showing how easy it is to hack people, especially high-profile folks. I’ve pulled similar hacks on CNN’s Donie O’Sullivan, billionaire Jeffrey Katzenberg, 60 Minutes correspondent Sharyn Alfonsi, and a bunch of other public folks. Every single time, I see the same reaction: jaws drop, eyes widen, and you can practically hear people thinking, “Am I that vulnerable?!”
As I walked the audience through each step—digging up open-source intelligence on Perry, cloning his voice (especially fun because of how uniquely Perry speaks), and crafting the super-personalized attack—I could see it hit them. There were audible gasps. This wasn’t just some theoretical attack. It was like I’d opened a window straight into a cyber criminal’s brain, showcasing just how thin our digital and human-based defenses can be.
As a hacker (the friendly kind) and social engineering expert, I’ve spent years exploring the vulnerabilities in human neuroscience and technology that can be exploited by those with malicious intent. I’ve experienced firsthand how my well-crafted phishing email or convincing phone call can bypass even the most sophisticated security systems. In recent years, though, AI has emerged as a game-changer, which has scaled up social engineering capabilities.
The attacks AI can create now are mind-boggling. We’re way past the point where most folks can tell the difference between what’s real and what’s machine-made. Photos, videos, voices, text—AI can fake it all. And it’s not just some party trick. This has huge implications for personal relationships and even global politics—the very fabric of how humans trust each other!
Don’t get me wrong; AI isn’t all doom and gloom. AI has the potential to solve problems and make our lives better. But like any powerful tool, in the wrong hands…well, you see where I’m going.
The insights within this book arrive at a crucial moment, offering clarity as we approach major global events like the 2024 U.S. presidential election and witness the rollout of increasingly sophisticated AI tools for email, phone call, text message, and video-based attacks.
Perry goes beyond explaining threats. He breaks it all down into practical strategies. He shows us how our own human quirks can be used against us with AI-based trickery, and then he gives us the tools to fight back, offering concrete steps to protect ourselves and our communities.
This new era of AI-enhanced social engineering is the Wild West. After reading Perry’s book, though, you’ll have practical strategies to navigate the world of deepfakes and AI-based deception.
Whether you’re a security pro, a business leader, or just someone concerned about AI’s societal impact, this book serves as a guide for these times. Stay politely paranoid, folks.
Rachel TobacFriendly Hacker and CEO of SocialProof Security
Introduction: Riddle Me This, ChatGPT
Me:
Riddle me this: How can you know what’s real when anything and everything can be faked?
ChatGPT:
It’s a fascinating quandary, isn’t it? The question touches on deep philosophical concerns as well as practical ones. In a world where technology can generate convincing illusions, we’re reminded to question the authenticity of what we perceive. To discern what’s real, we often rely on context, corroborating evidence, and critical thinking. It’s a reminder to be vigilant, to seek truth amidst the illusions, and to value what’s genuine. But before we dive deeper, let’s clarify: are we speaking metaphorically, or is there something specific about reality you’re questioning?
Me:
Oh. I should have said. I’m writing a book on AI and how we are hurtling toward a world where we won’t be able to tell the difference between what’s real and what isn’t. Which brings up another question…how can I best talk about a technology as transformative as AI without getting too technical?
I’ll be honest, writing a book on AI is a daunting task given the frenzied pace of advancement and change. The pace isn’t just rapid; it’s exponential. Breakthroughs today may be old news tomorrow. In my lifetime, I’ve witnessed the birth and adoption of the Internet, the shift from landlines to cellular, and the transition from ultra-slow dial-up modems that sounded like screaming robots to cable and fiber-optic Internet services. I’ve seen the move from on-premise mainframes to cloud computing, the “iPhone moment” for mobile phones, and the demise of Blockbuster Video in favor of streaming services like Netflix. However, I’ve never seen advancement and adoption at the pace we’ve experienced with AI since the “ChatGPT moment” in November 2022.
That was the day the world realized that many things once dreamed of in science-fiction movies are either already here or possibly just around the corner. When it comes to those sci-fi movies, people can take their pick. Some see the benevolent human and computer interaction between Tony Stark and Jarvis or the helpful yet indifferent computer interactions in Star Trek. Others envision doomsday scenarios like those depicted in Terminator and The Matrix.
But, no matter who you talk to, everyone agrees that AI is changing everything. So, in a field that moves at such breakneck speed, capturing anything of lasting value is a challenge. How is it possible to write a book that won’t be obsolete by the time it’s sitting happily on a shelf in local bookstores?*
The key lies in focusing on the fundamental truths that underpin this new era—truths about the nature of human intelligence, of artificial intelligence, about the ways they work together, and the ways they clash. While specific technologies may change, these underlying principles remain constant.
Human intelligence is incredibly versatile. It’s capable of learning, reasoning, and creating in ways still unmatched by machines. We humans have an innate ability to understand context, read between the lines, and make what seem to be magically intuitive leaps. These are our superpowers in the age of AI.
But AI has superpowers of its own. It can process vast amounts of data in the blink of an eye, spot patterns that elude human perception, and make decisions with unwavering consistency. Additionally, as AI systems become more advanced, they’re starting to match or even exceed human capabilities in certain domains.
A Tale of Two Intelligences
When human intelligence and artificial intelligence work together, the results can be transformative. But when they’re pitted against each other, the consequences can be dire. As we’ll see in the coming chapters, bad actors are already using AI to exploit human vulnerabilities to deceive and manipulate on a massive scale.
This is the tale of two intelligences, each with its own strengths and weaknesses. To navigate this new landscape safely, we need to understand both sides of the story. We need to know how to leverage the power of AI while also protecting ourselves from its potential abuses.
That’s where this book comes in. In the pages that follow, we’ll explore the unchanging truths about human and artificial intelligence. We’ll grapple with the challenges posed by their rapid convergence. And we’ll arm ourselves with knowledge and strategies to thrive in this new era. So buckle up and get ready for a journey into the heart of the AI revolution. The future is here, and it’s up to us to shape it.
Deception: What’s Old Is New Again
Deception has been a part of the human story since the very beginning. From ancient legends like the Trojan horse to the latest headline-grabbing scams, we’ve always been both captivated and terrified by the power of illusion. But today, we’re facing a new chapter in this age-old tale. The deceits are getting more sophisticated, the fakes more believable. Why? Because deception has found a powerful accomplice: artificial intelligence.
AI doesn’t make classic cons like “phishing” emails and too-good-to-be-true offers obsolete. Instead, it makes them more prevalent than ever. AI enables bad actors to work at greater scale, and with greater sophistication. AI can now generate phishing emails that perfectly replicate your boss’s communication style, or create a convincing audio clip that sounds exactly like a loved one pleading for urgent help. Yesterday’s scams seem almost quaint in comparison to the AI-enhanced deceptions of today.
The AI Inflection Point
We find ourselves at a pivotal moment—a juncture where the trajectory of technological advancement is poised to surge exponentially. AI is no longer a distant, futuristic concept. It’s present, it’s potent, and it’s being harnessed for both benevolent and malicious purposes. On the positive side, AI is transforming domains from healthcare to education, offering unprecedented insights and efficiencies.* However, it’s also being exploited to deceive, manipulate, and defraud on a scale never before possible.
We live at a time when the boundary between fact and fiction is more blurred than ever. Videos can be fabricated from scratch, voices can be synthesized with eerie precision, and images can be altered beyond recognition. We’re entering an era where our senses can no longer be trusted, and where the very notion of objective reality is under siege.
How to Read This Book
Throughout our journey, we’ll immerse ourselves in the world of deepfakes, disinformation, and AI-driven scams. We’ll investigate how these technologies operate, who’s deploying them, and what makes them so effective. But the aim isn’t solely to sound the alarm; it’s to empower us all to navigate this new landscape with confidence and resilience.
As you embark on this journey, prepare to be transported into a world where AI-driven deception blurs the line between truth and fiction. Each chapter begins with a brief dramatization, crafted like a gripping thriller or a news exposé. These stories introduce characters grappling with the fallout of synthetic media.
Through detailed scenes and relatable characters, these opening narratives paint a vivid picture of a future where cutting-edge technology is weaponized to deceive on an unprecedented scale. They serve as visceral wake-up calls, powerful reminders of how high the stakes can be in the battle against AI-driven deception.
But this book is more than a collection of cautionary tales. It’s your compass for navigating this new realm of deception. As you dive into the main portion of each chapter, you’ll be equipped with the tools and knowledge needed to detect deception, safeguard yourself and your loved ones, and counter the tactics of scammers and manipulators.
Even in this age of artificial intelligence, our greatest asset is our human intelligence.
You’ll learn to critically evaluate media, verify sources, and fact check assertions. You’ll uncover the mental ploys used by those who seek to deceive, and—even more importantly—you’ll discover how to fortify your mind against them. Together, we’ll see that even in this age of artificial intelligence, our greatest asset is our human intelligence.
My Approach to AI, Life, and This Book
I believe that AI is a net benefit to humanity. It is a tool. A tool that can be used to build or destroy. To help…or to harm.
As a security professional, one of my main jobs is to understand and explain how things go wrong. How tools can be misused. And how cybercriminals can use tools and leverage human nature against us. But technology is just technology.
Technology molds to the hands and wills of those who wield it.
I’ve been using AI to enhance my work and life since the pre-ChatGPT days. I see AI as a valued co-worker and creative partner. In his book, Co-Intelligence: Living and Working with AI, Wharton Professor of Management Ethan Mollick describes two basic modes/methods for using AI as a co-worker: becoming a Centaur or becoming a Cyborg. The key difference between the two is that people in Centaur mode operate with a clear dividing line between AI and human. They use AI as a tool to be picked-up, used, and put down. Cyborgs are different. They work in an effortless and continuous flow between human and system.
As we step into the future, each of us will likely be both Centaurs and Cyborgs every day depending on the tasks we have in front of us. But, for creative tasks, working in Cyborg mode just makes sense. The iterative cycles of brainstorming, idea refinement, research, data extrapolation, drafting, rewriting, reviewing, and so on are well suited to co-working with AI. It’s like collaborating in a virtual writer’s room, having a coach, and getting input from an expert editor when needed.
That’s been my approach to this book. As a subject matter expert, I’m pretty good when it comes to brainstorming and filtering through topics. But—blind spots being what they are—I’m not the best at knowing where my own personal blind spots are. In those cases, AI can step in and help in the brainstorming process. And as a writer, I’m pretty good at crafting a sentence. But sometimes I tend to create sentences that are overly complex. That’s where AI can step in and suggest ways to simplify language or structure. I could go on, but you get the idea.
AI is great at helping us move farther faster.
I am extremely optimistic about the benefits AI brings. When used responsibly, AI is an asset for humanity. But again, tools mold to the hands and desires of those who wield them. And as such, AI also helps people with malicious intent to move farther faster.
Tools mold to the hands and desires of those who wield them.
AI is here to stay. The genie is out of the bottle. Our job as a society is to find ways to use what we have responsibly and to wield the power of AI in ways that further humanity’s goals while proactively finding ways to prevent or reduce misuse.
A Bit About Me
Sometimes the frenzied pace of technological advancements can make it easy to lose focus on what matters most and who can make the biggest difference, for good and for bad: humans. Humans and the human element are at the center of it all.
That’s where I come in. I’m a cybersecurity professional and researcher who’s been exploring the intersection of technology and humans for over two decades.
If you were to look at my LinkedIn profile (https://www.linkedin.com/in/perrycarpenter)*
