 |
Post AsgV0jPiZBH5AVTU48 by [email protected] |
 |
More posts by [email protected] |
|
Post #AsgAdPXIJ7Odm6cYV6 by [email protected] |
|
0 likes, 5 repeats |
|
|
|
The Wikimedia Foundation, which owns Wikipedia, says its bandwidth costs have g… |
|
|
|
Post #AsgUowJOmms9hDtcEC by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson source link https://diff.wikimedia.org/2025/04/01/how-crawlers-impac… |
|
|
|
Post #AsgUowRuH9g67bsPUO by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@ash doin' god's work |
|
|
|
Post #AsgUqWvk7nm3YWacbI by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson This may be a dumb question, but it's there a way - CAPTCHA or s… |
|
|
|
Post #AsgUqX3Xeo0pwiEqky by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@VirginiaHolloway @camwilson Not a dumb question. It's technically possible… |
|
|
|
Post #AsgUryAMLfLeJd73Eu by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson this is particularly stupid given they could just download the whole… |
|
|
|
Post #AsgUryIrq29ak15qV6 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@ben_hr @camwilson ah, but then they would need to host it themselves? Think ab… |
|
|
|
Post #AsgUv9ljfLIdAb7BLc by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson Why does everyone assume this is NOT malice? I'm sure Google wo… |
|
|
|
Post #AsgUxgbuX5j9baj3Ka by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson #fuckai #fuckaiart #fuckaibots #fuckaiEtAl |
|
|
|
Post #AsgV0jPiZBH5AVTU48 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson Thanks for speaking out about such issues involving AI. |
|
|
|
Post #AsgV1Q0MDLXRGIwL0S by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson wtf do you mean Wikipedia is paying for bandwidth?! They should be p… |
|
|
|
Post #AsgV5nnJhsj0CcvlRY by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson then it's probably time for them to look into using a commercial… |
|
|
|
Post #AsgV7KeP292eOUUUEq by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson Move fast and break other peoples things |
|
|
|
Post #AsgV8LIc6k2uh9mTWS by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson On a very small site (compared to the big players) requests went fro… |
|
|
|
Post #AsgV9EAM797WrTL9mq by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@ben_hr @camwilson it's always better to externalize costs :/ |
|
|
|
Post #AsgV9PfbLJeMXZ2lW4 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson This appears to be slowing down (sometimes saturating) some of my si… |
|
|
|
Post #AsgVA7uKrta1k0H9ai by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson I remember when Musk was warning the world about AI, but fuck that N… |
|
|
|
Post #AsgVAG8oFxuZHD6pGK by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson #AI #Crawlers are not only increasing bandwidth costs for #Wikipedia… |
|
|
|
Post #AsgVANeyImnUazD6rg by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson Can you please share the link this comes from? |
|
|
|
Post #AsgVBEfrCDzt15246S by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson What an inefficient disaster this is. |
|
|
|
Post #AsgVD0rLWuY0kZFnHc by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@ben_hr @camwilson Apparently it's cheaper to just keep scrapping it than s… |
|
|
|
Post #AsgVFSmIhSpLuw3uWO by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson Should Wikipedia check if you are a bot? Would that help? |
|
|
|
Post #AsgVFSuSD9LiKDsQEK by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson That would be annoying af, though. |
|
|
|
Post #AsgVHBX5mxEv0klmAi by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@jernej__s @ben_hr @camwilson Yes, it is cheaper because it is stealing bandwid… |
|
|
|
Post #AsgVKLL9mU9UIUh0mO by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@VirginiaHolloway @camwilson I started blocking known IP address ranges for bot… |
|
|
|
Post #AsgVNGaJuypQPwBB2m by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@ben_hr @camwilson Maybe they vibe coded their crawlers? |
|
|
|
Post #AsgVOB8deZYPoafNJI by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson That's like the economics of ticket scalping.Except the second-h… |
|
|
|
Post #AsgVQFzuYeDrSsZj7I by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson this makes me think that maybe wikipedia should think about glazing … |
|
|
|
Post #AsgVQeDuUFgGbFJFGi by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson In the US they once passed a law that telemarketers couldn't cal… |
|
|
|
Post #AsgVR0paQqtGiT6e36 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson Alt text:Since January 2024, we have seen the bandwidth used for dow… |
|
|
|
Post #AsgVRa7XE72mAGlyNs by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson @Gargron wikipedia has an option to download its entire contents as … |
|
|
|
Post #AsgVU3dOSwRCHNr4me by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@mirjanxThe guy who also has an AI chatbot, and wants to buy OpenAI?Yes, fuck t… |
|
|
|
Post #AsgVVfcohdOWOYM1lg by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@ben_hr Not surprising, when one knows thwy download the same thing over and ov… |
|
|
|
Post #AsgVWdYHtbQGFshG2S by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson What to me is maddening about it is that there really is no need to … |
|
|
|
Post #AsgnjZBjEKaTf0SZTk by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson I always wonder if Wikipedia still offers a full download? |
|
|
|
Post #AsgnjZJWlKpG3C6ndQ by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@utzer @camwilson Of course you can. https://dumps.wikimedia.org/ |
|
|
|
Post #AsgnpDmhim8112S2hk by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@arrrg I respect the nomenclature. |
|
|
|
Post #AsgnpOAp5xMZEjoRge by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@coyets @jernej__s @ben_hr @camwilson Digital colonizers are outsourcing their … |
|
|
|
Post #AsgnugWSIlYhaoSLwW by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson ok, that the difference between AI and not AI crawlers? |
|
|
|
Post #Asgo3nheyPEaTB2mLg by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@a_lex_ander @VirginiaHolloway @camwilson Do you have blocklists you could shar… |
|
|
|
Post #Asgo9bOzcaCy3X4xEW by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@camwilson this crap makes self hosting almost impossible |
|
|
|
Post #AsgoPLwOsCqwjmDPo8 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@notforyourstereo @mirjanx People like Musk change their "views" on a… |
|
|
|
Post #AsgouLZUIUXmZIHFw0 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@nben @VirginiaHolloway @camwilson I'm using the IP ranges from https://git… |
