Crypto deepfakes prove that X is failing as an industry platform

It seems we’ve just traded scam accounts that pretend to be Musk for scam accounts that act like crypto industry leaders

share

X, formerly Twitter, has a deepfake problem, one that I believe could — and, frankly, should — end its role as the premier social platform for the crypto industry.

Scrolling through the endless chaos of X, it doesn’t take long to come across a video, usually starring a stilted Michael Saylor or Brad Garlinghouse, promising me access to a crypto airdrop. Solana co-founder Anatoly Yakovenko’s likeness has also been used

These videos are, of course, scams, putting a new and decidedly worrisome technology spin on an old problem — similar to the ever-prevailing threat of crypto phishing attacks

The videos employ AI-generated voice recordings and what appear to be added lip animations to present “opportunities” to would-be crypto holders. 

These “major announcements” share a common call to action: Scan a QR code or follow a link to receive “money.” Obviously, I didn’t click or scan by way through, but the implications are clear for anyone who has encountered the dangers of the modern internet. Interaction means security exposure, and exposure means the potential for stolen digital assets, personal information or more. 

One account, live as of the time of writing, had scored 276,000 views for a Saylor deepfake and 139,000 views for a Garlinghouse deepfake. 

Read more from our opinion section: Farcaster just might be the new Crypto Twitter

The fact that these posts are often tagged as advertisements — thereby offering them the veneer of legitimacy — is deeply problematic. Far worse is the reality that X is making money off the problem rather than making any kind of visible effort to confront them.

It wasn’t that long ago that X owner Elon Musk pledged to solve the spam bot problem. The reality seems to be that we’ve traded scam accounts that pretend to be Musk for scam accounts that act like crypto industry leaders — in both cases, enticing would-be victims with giveaways.

This is all playing out against the backdrop of a wave of other types of spam advertisements, as The Information detailed earlier this month. The result — fueled by an exodus of major advertisers that has slowly played out since Musk took over the now-former Twitter — is a minefield of questionable products, porn bots and these deep fake videos.

It’s a disaster. The situation further muddies the water of a platform that has, for many years, served as a central hub for inter-industry relations. And, if recent technology developments hold true, the problem will likely become worse over time. 

News from Sam Altman’s OpenAI that the company has developed a text-to-video product may put additional tools in the hands of would-be scammers. To be sure, OpenAI appears to be taking an at least publicly cautious approach to allowing access to this tool, in what is doubtless an acknowledgement of the inherent risks. But AI-generated video tools will inevitably become widespread — opening the door to more sophisticated deep fakes like the crypto ones popping up today.

Where to from here? Should alternative social media platforms be embraced? Do crypto-enabled platforms and protocols like Lens or Farcaster hold the key to a social media without these scam videos?

I don’t know. I believe the industry should become louder about this issue — if, for nothing else, to perhaps prompt a response from X and Musk. Remember, the Musk bot issue did go away, but by all appearances the fundamental problem — fake accounts masquerading as sources of authority — has metastasized. 

This situation places an industry long dogged by its worst impulses in close proximity with a dangerous collision of technology and exploitation. The crypto industry would be wise to confront it head-on. 



Start your day with top crypto insights from David Canellis and Katherine Ross. Subscribe to the Empire newsletter.

Tags

Upcoming Events

Salt Lake City, UT

WED - FRI, OCTOBER 9 - 11, 2024

Pack your bags, anon — we’re heading west! Join us in the beautiful Salt Lake City for the third installment of Permissionless. Come for the alpha, stay for the fresh air. Permissionless III promises unforgettable panels, killer networking opportunities, and mountains […]

recent research

Avail.jpg

Research

Data publishing costs have historically been a bottleneck for rollups, and as more rollups launch, interoperability will continue to be a major challenge. Avail presents a potential solution to rollup fragmentation through its three products: Avail DA, Nexus, and Fusion, which together aim to unify the web3 experience.

article-image

The SEC alleges that Justin Sun spent nearly 400 days in the US from 2017 to 2019

article-image

Short-term “sell the news” reactions could follow new BTC price peaks months from now, industry watchers say — but only if history repeats itself

article-image

While crypto fundraising remains well off its bull market highs, Q1 data shows capital is returning to the space

article-image

Billed as a better BRC-20 fungible token standard, Bitcoin Runes launches tomorrow

article-image

Bitcoin miners need to explore unconventional energy avenues or be buried by the financial realities created by this halving

article-image

BlackRock’s iShares Bitcoin Trust continues to see daily positive net flows, though its inflow total for a single day hit a new low Wednesday