this post was submitted on 16 Dec 2025
153 points (98.7% liked)

Technology

78183 readers
2186 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

ChatGPT’s crawler GPTBot, which spiders the internet to capture information and turn it into knowledge, is the most-blocked bot on the internet, according to Cloudflare’s 2025 year in review. Meanwhile its biggest rival, Google, is the No. 1 most-allowed crawler. And perhaps even more interestingly, while ChatGPT is the most-blocked bot, it’s actually Anthropic’s Claude AI engine that is the least reciprocally beneficial service for website owners.

Every year internet infrastructure company Cloudflare publishes an analysis of what’s happening on the internet.

Archive: http://archive.today/xvW1Q

Cite: https://radar.cloudflare.com/year-in-review/2025

you are viewing a single comment's thread
view the rest of the comments
[–] kboy101222@sh.itjust.works 5 points 2 weeks ago* (last edited 2 weeks ago)

I wouldn't be surprised if we've already passed that for new content. I can't search for anything nowadays without it being clearly AI written garbage, especially for guides for video games.

At least when someone on GameFAQs made some shit up it was a human being looking to troll you, not some statistical bullshit machine trying to generate page views for ad revenue