 |
Post Ax0dnbcGFGKPU3CW4u by [email protected] |
 |
More posts by [email protected] |
|
Post #Ax0FzpsEfCb0HIyIs4 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
So according to this article: https://www.dropsitenews.com/p/meta-facebook-tech… |
|
|
|
Post #Ax0Fzq0OAt7Mgamoa0 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
Does anyone know a good way to block them?I do not want anything to do with the… |
|
|
|
Post #Ax0Fzq77lqVP1TwC4u by [email protected] |
|
0 likes, 0 repeats |
|
|
|
Just edited our #nginx configs and addedif ($http_user_agent ~* "Meta-Exte… |
|
|
|
Post #Ax0FzqEvIqkBPfaQEa by [email protected] |
|
0 likes, 0 repeats |
|
|
|
In addition, i've also enabled CloudFlare's AI scrape block for masto.a… |
|
|
|
Post #Ax0FzqLIv7qdjSZWBE by [email protected] |
|
0 likes, 2 repeats |
|
|
|
@[email protected] For .coffee, since that's not going through Cloudflare&#… |
|
|
|
Post #Ax0GJs7432Qr0xSgPw by [email protected] |
|
0 likes, 2 repeats |
|
|
|
@stux I've been looking at The Ultimate Nginx Bad Bot Blockerhttps://github… |
|
|
|
Post #Ax0GZ6caO8YSM5TBbs by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux I'm sorry this is happening to you. Did you block Threads yet? |
|
|
|
Post #Ax0QXIIyyahVYR4jJY by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@stux The robots.txt file is just an 'ask' but means nothing.See Cloudf… |
|
|
|
Post #Ax0R2bIkOmoxRmtRvU by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux #Sysadmin #Life |
|
|
|
Post #Ax0R3gPos1Hvb7iXke by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux this is why I think instances should be authenticated only. There is an o… |
|
|
|
Post #Ax0R4KEWpQ1X5gk5ho by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@jorijn oh! is that enough? 😀 |
|
|
|
Post #Ax0R8c1ccXkhQgkXWC by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux i summon @Crystals |
|
|
|
Post #Ax0RAIQ0UN3LCQxTxw by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux block their entire ASN? it will make at least them spend money by using a… |
|
|
|
Post #Ax0RAIXS2h0XZWRQZM by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@athos @stux They have a whole page about their crawlers and a handy command to… |
|
|
|
Post #Ax0RBYL4mZSGrjFe6q by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux "niche forums, personal blogs, and even revenge porn sites"...s… |
|
|
|
Post #Ax0RBYSAMD7tDiZJA0 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@alice @stux they're the best target for LLM AI. Didn't Zuckerberg say … |
|
|
|
Post #Ax0RBrSVh9guAHsLpo by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux Thanks so much for your constant efforts on our behalf, youre a hero and … |
|
|
|
Post #Ax0RCfQRv5kf8NIPZ2 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@[email protected] Here's the robots.txt Cloudflare generated for my site t… |
|
|
|
Post #Ax0REBooy76FtBQCbQ by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux I think this is the problem that Cloudflare has been trying to solve: the… |
|
|
|
Post #Ax0RFFIrUykezAybx2 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux I did the same. |
|
|
|
Post #Ax0RFbSt6NqLidpvdI by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux Maybe use Anubis on everything possible.Also make the robots.text and use… |
|
|
|
Post #Ax0RFcr1w6kW1o8iu0 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@TagHunt @stux They are openly disregarding robots.txt. It's going to have … |
|
|
|
Post #Ax0RIEAQBAvKKZRyym by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux i wonder if adding another line to that stanza, specifically so that the … |
|
|
|
Post #Ax0RKpM0tErMF970ts by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux does that mean Fedi people can take part in the class action law suit tha… |
|
|
|
Post #Ax0RMIqIjo9pzQyzFA by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux lol. They prohibit, shadowban, or actual-ban any acknowledgement of the … |
|
|
|
Post #Ax0RMf87sDUJ75UX56 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux Needs hashtags. (lol) |
|
|
|
Post #Ax0RN8w73RhhYW6MWO by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@grob @stux :catjam: |
|
|
|
Post #Ax0RNVkYEb7cJJrxC4 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux maybe some kind of rate limiter?would work if their request all originate… |
|
|
|
Post #Ax0RNVrHpYVeeD1Kgy by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@loganer @stux they dont... |
|
|
|
Post #Ax0RNVyjNsSr1IVHIO by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@Extelec @stux that is mighty strange for them not to be...I would expect that … |
|
|
|
Post #Ax0ROaR2IgK18CFoZs by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux Block those MoFu's ! |
|
|
|
Post #Ax0RPqFMzvKuSbObDs by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux I'm very curious to know what effect this has on the traffic. From th… |
|
|
|
Post #Ax0RRgWg6uuytIN21o by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux returning http code 444 from nginx just closes the connection, clearing u… |
|
|
|
Post #Ax0RSA7C6EMIewg6TI by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux Is there an Instance Runner newsletter for all nodes to.learn from your e… |
|
|
|
Post #Ax0RWmFwEZI06sy7o8 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux maybe have a look at my setup: https://repos.mxhdr.net/maxheadroom/Traefi… |
|
|
|
Post #Ax0RZ8rZ9Y8enrhEjA by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@kevinrns When Ghost's new federation works fully ill setup a small blog on… |
|
|
|
Post #Ax0RZ8zMgYNRC3LSsq by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux 👏 👏 |
|
|
|
Post #Ax0Rbh3P0FUHQKRv72 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux :)https://http.cat/403 |
|
|
|
Post #Ax0RfKErlrLfp2Xkie by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux not just Meta, none of them respect any content any more. No point in rob… |
|
|
|
Post #Ax0RfbjyhRKu6SEL4a by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux what about iocaine, quixotic, etc? |
|
|
|
Post #Ax0RhO2Cd5H4ApbRke by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux Try the following in htaccess in order to be extremely specific on known … |
|
|
|
Post #Ax0RhwMF15VOcpEvho by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@alex yes, im gonna test dis:if ($http_user_agent ~* "Meta-ExternalAgent&q… |
|
|
|
Post #Ax0ZnZXxXVY5FUuwN6 by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@alice @stux A new emergent demographic, like it was in Japan. MAGA is comorbi… |
|
|
|
Post #Ax0ddSUjItYyIXq7Vo by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@loganer @Extelec @stux they proxy their content scraping through lots of locat… |
|
|
|
Post #Ax0de97Up9WoUwIflg by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux long-term persistent activity? Any ability to allow for #req/h or smth? |
|
|
|
Post #Ax0dnbcGFGKPU3CW4u by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux I doubt this will be acceptable to many, but I use a captcha to keep the … |
|
|
|
Post #Ax0dpPZzy34CjT0I6K by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux wonder if Anubis or Fail2ban can do more for you… |
|
|
|
Post #Ax0dxxNaBW3HsRGrKa by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux I use Cloudflare at work and have enabled every AI-scraping bot feature a… |
|
|
|
Post #Ax0e2r7St1n5uU4HPk by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@stux Wouldn't it be more effective to fight fire with fire? Create a mass … |
|
|
|
Post #Ax0eCZbOrzQyTehgeW by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@http_error_418 @loganer @stux it doesn't, there is no real defence, rate l… |
|
|
|
Post #Ax0eDu50DjpuHDBUB6 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@[email protected] Just block them, do not use the AI scraper maze feature of C… |
|
|
|
Post #Ax0sqZzgEQxCdL1zLE by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@stux A leak from what orifice ? |
