personal-website/docs/www/robots.txt

User-agent: GPTBot
Disallow: /
User-agent: ChatGPT-User
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: PerplexityBot
Disallow: /

User-agent: anthropic-ai
Disallow: /
User-agent: Claude-Web
Disallow: /
User-agent: ClaudeBot
Disallow: /

User-agent: Amazonbot 
Disallow: /
Add robots.txt Big thanks to https://www.cyberciti.biz/web-developer/block-openai-bard-bing-ai-crawler-bots-using-robots-txt-file/ for providing a list of these leeches. 2024-06-23 08:00:43 +02:00			`User-agent: GPTBot`
			`Disallow: /`
			`User-agent: ChatGPT-User`
			`Disallow: /`

			`User-agent: Google-Extended`
			`Disallow: /`

			`User-agent: CCBot`
			`Disallow: /`

			`User-agent: PerplexityBot`
			`Disallow: /`

			`User-agent: anthropic-ai`
			`Disallow: /`
remove some weird unicode 2024-06-23 08:01:18 +02:00			`User-agent: Claude-Web`
Add robots.txt Big thanks to https://www.cyberciti.biz/web-developer/block-openai-bard-bing-ai-crawler-bots-using-robots-txt-file/ for providing a list of these leeches. 2024-06-23 08:00:43 +02:00			`Disallow: /`
			`User-agent: ClaudeBot`
Block the fucking amazon fucker eating my cpu fuck you you fucking ai morons kill yourselves I fucking hate you so much. All of you fucking ai retards need to fucking remove yourselves from the planet if you fucking hate humanity so much you goddamn fucking idiots. 2024-07-25 23:42:21 +02:00			`Disallow: /`

			`User-agent: Amazonbot`
Add robots.txt Big thanks to https://www.cyberciti.biz/web-developer/block-openai-bard-bing-ai-crawler-bots-using-robots-txt-file/ for providing a list of these leeches. 2024-06-23 08:00:43 +02:00			`Disallow: /`