Hi, I’m building a personal website and I don’t want it to be used to train AI. In my robots.txt file I blocked:

  • ChatGPT-User
  • GPTBot
  • Google-Extended
  • FacebookBot

What bots should I also add? Are there any other ways to block AI bots?

IMPORTANT: I don’t want to block search engine crawlers, only bots that are used to train AI.

  • bbbhltz@beehaw.orgdeleted by creator
    2·
    3 years ago

    I don’t remember what all of those are for so you might want to look them up.

    • chevy9294@monero.townOP
      2·
      3 years ago

      I did, most of them are used for AI or business search engines. I copied everything except Yandex.