AI threats follow the rules, too - Digital Threat Digest
PGI’s Digital Investigations Team brings you the Digital Threat Digest, SOCMINT and OSINT insights into disinformation, influence operations, and online harms.
PGI’s Digital Investigations Team brings you the Digital Threat Digest, SOCMINT and OSINT insights into disinformation, influence operations, and online harms.
The hyperfocus on AI continues to generate an incredible number of predictions around its future uses, for good and for ill. Even just focusing on digital risks, AI could either drown the internet in fake posts, or become sentient and destroy humanity. It has a wide range of potential futures, and it’s understandable that people are worried about how this new technology may impact them.
The good news is AI digital threats are still beholden to the same rules and constraints that any other digital threats are. When a ‘bad actor’ is choosing whether to engage maliciously on the internet, they must weigh costs and potential benefits. For an individual, creating a long text post with a new conspiracy might not be worth the time if they know it won’t be shared widely. For a larger actor, spending money on equipment and manpower to make spam videos for ad revenue might not be worth it if nobody watches them.
And that’s the key to understanding where AI digital threats might present themselves. AI can write a long post faster than a human, but it can’t guarantee that post will go viral. AI can save money on video production, but it can’t guarantee anyone will see it. And while AI will certainly increase the rate at which this material will be posted, that doesn’t necessarily help. Over time, platforms and regulators will have increasingly powerful defensive tools to detect and shut down AI generated content. Additionally, the public will become increasingly aware and resilient to this content, just as it did with bots in the 2010s.
Where AI is likely to make the most immediate difference, therefore, is where that cost-benefit calculation already favours benefit. So we’re more likely to see AI enhance pre-existing operations, or change how they’re presented, rather than develop completely new ones right away.
What does that mean to the average internet user? Barring a sentient AI uprising, in aggregate, you’re likely to experience more of the same. The phishing emails may be written slightly better, the spam videos may come at a faster clip, but the fundamental equations don’t change. Of course, this will not be a universal truth, and we will see new operations develop, especially in the fringes of the internet. But many of the lessons we have learned that apply to generic digital threats are also applicable to AI ones, and that is a good thing.
More about Protection Group International's Digital Investigations
Our Digital Investigations Analysts combine modern exploitative technology with deep human analytical expertise that covers the social media platforms themselves and the behaviours and the intents of those who use them. Our experienced analyst team have a deep understanding of how various threat groups use social media and follow a three-pronged approach focused on content, behaviour and infrastructure to assess and substantiate threat landscapes.
Disclaimer: Protection Group International does not endorse any of the linked content.
Working within the Trust and Safety industry, 2024 has been PGI’s busiest year to date, both in our work with clients and our participation in key conversations, particularly around the future of regulation, the human-AI interface, and child safety.
At their core, artificial systems are a series of relationships between intelligence, truth, and decision making.
Feeding the name of a new criminal to the online OSINT community is like waving a red rag to a bull. There’s an immediate scramble to be the first to find every piece of information out there on the target, and present it back in a nice network graph (bonus points if you’re using your own network graph product and the whole thing is a thinly veiled advert for why your Ghunt code wrap with its purple-backlit-round-edged-dynamic-element CSS is better than everyone else’s).