 |
Post AkSh65P5MdElyPHvWK by [email protected] |
 |
More posts by [email protected] |
|
Post #AkSh5xmBiqxoJk2GQ4 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
So how much bandwidth am I paying for for billionaire AI companies to be hammer… |
|
|
|
Post #AkSh5yFbxSV1mznlHU by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@josh If you haven’t already, you might incorporate this repo into your build… |
|
|
|
Post #AkSh65Dk2oABPDyrq4 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@waldoj @josh It absolutely is malicious. Across hundreds of government sites I… |
|
|
|
Post #AkSh65JPhihTgodOgC by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@ThatPrilla @josh The worst offenders ignore robots.txt, and I have to block th… |
|
|
|
Post #AkSh65P5MdElyPHvWK by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@waldoj @ThatPrilla You check the user agent during the request? |
|
|
|
Post #AkSh65UP2rUUEtmAoC by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@josh @ThatPrilla I block them in .htaccess, by user agent if that's suffic… |
|
|
|
Post #AkSh65a4hm1mWUQheK by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@waldoj Blocking bots and AI crawlers seem like a full time job. I set up this … |
