Soon you will only trust people you know.
I have been learning a fun programming language called Gleam. And I wanted to read a book on it.
The one book on it I could find was by someone called Julian Lornfield. Who has written over a dozen books in 2025 each on a different topic in computers. Theres no photo of them on the internet other then this amazon author photo. No linkedin. No youtube talks at conferences etc.
So baring some major mistake by me this is a bot churning out AI written books. It could be a real person but one without the usual trail we leave. A fake author would be odd but not something that unusual in 2025.
But to take a step up from these checks. What happens when fake reviews, linkedin accounts and these things I checked are much easier? If there was a linkedin, lots of reviews, better spacing of the release dates and even videos of talks would I have been fooled? Probably.
Making a fake account involves making photos, passing captchas, sending text back and forth between some other bots and some real people. All this is easily doable now.
AI LLM arguments focus on the abilities at the extreme. Writing a new math proof or acing some test. But what happens when they get really good at stuff designed for normal people to easily do. Gmail wants you to get an email account. Amazon wants you to leave reviews. Emergency services want you to ring when your house is on fire.
When LLMs get good enough at these tasks that Social media, reviews, email inboxes get flooded you will not trust anyone in the digital space you do not personally know. They pretty much are already on Twitter and facebook but other digital locations are next. The cost of an llm for the same level of intelligence decreases 10 fold per year. So if it is too expensive to build up 100 bot reviewers today it will be 1/1000th the cost in 3 years.
For online review sites this is probably fairly obvious. But I do not think the effects on offline services are considered yet.
999 services or dentists are not designed for 100 bots that sound like people ringing them.
Politicians and newspapers are not expecting 100 physical letters what have all been written by different bots.
But to take a step up from these checks. What happens when fake reviews, linkedin accounts and these things I checked are much easier? If there was a linkedin, lots of reviews, better spacing of the release dates and even videos of talks would I have been fooled? Probably.
Making a fake account involves making photos, passing captchas, sending text back and forth between some other bots and some real people. All this is easily doable now.
AI LLM arguments focus on the abilities at the extreme. Writing a new math proof or acing some test. But what happens when they get really good at stuff designed for normal people to easily do. Gmail wants you to get an email account. Amazon wants you to leave reviews. Emergency services want you to ring when your house is on fire.
When LLMs get good enough at these tasks that Social media, reviews, email inboxes get flooded you will not trust anyone in the digital space you do not personally know. They pretty much are already on Twitter and facebook but other digital locations are next. The cost of an llm for the same level of intelligence decreases 10 fold per year. So if it is too expensive to build up 100 bot reviewers today it will be 1/1000th the cost in 3 years.
For online review sites this is probably fairly obvious. But I do not think the effects on offline services are considered yet.
999 services or dentists are not designed for 100 bots that sound like people ringing them.
Politicians and newspapers are not expecting 100 physical letters what have all been written by different bots.
If we get 100 fake ads from what looks like our bank we are likely to get one just when we are having a problem and at our most confused moment believe them.
LLMs are smart enough now to create and operate online accounts including making phone calls. The price of this will drop orders of magnitudes in a few years. The online and especially the offline world is not set up for when this happens.
LLMs are smart enough now to create and operate online accounts including making phone calls. The price of this will drop orders of magnitudes in a few years. The online and especially the offline world is not set up for when this happens.
No comments:
Post a Comment