Introduction
Introduction Statistics Contact Development Disclaimer Help
Post AxCeUABkQa5mldbzH6 by [email protected]
More posts by [email protected]
Post #AxCS6qu8lBxoqgUgXg by [email protected]
0 likes, 4 repeats
We apologize for a period of extreme slowness today. The army of AI crawlers ju…
Post #AxCS6rvaxGio1UBMRs by [email protected]
0 likes, 1 repeats
It seems like the AI crawlers learned how to solve the Anubis challenges. Anubi…
Post #AxCSAvV3cHECG9hj4S by [email protected]
0 likes, 0 repeats
However, we can confirm that at least Huawei networks now send the challenge re…
Post #AxCSR8XGux9XK3TBYG by [email protected]
0 likes, 1 repeats
We have a list of explicitly blocked IP ranges. However, a configuration oversi…
Post #AxCSR8cwZrgpbe7iOO by [email protected]
0 likes, 1 repeats
@Codeberg Thanks for fighting the good fight!
Post #AxCalmXqfmT4pm5wbg by [email protected]
0 likes, 0 repeats
For the load average auction, we offer these numbers from one of our physical s…
Post #AxCalmeaGjr7AfFK6a by [email protected]
0 likes, 1 repeats
@Codeberg I really wish you contacted me at all about this before going public.
Post #AxCeNpZaAAdz5kjyMa by [email protected]
0 likes, 0 repeats
@cadey I'm sorry if this gave you any unwanted or negative attention. I con…
Post #AxCeNpgJl821QdtLrU by [email protected]
0 likes, 0 repeats
@Codeberg It'd be a good time to encourage folks to sign up to https://gith…
Post #AxCeOvUzcFNRlD7GeO by [email protected]
0 likes, 0 repeats
@Suiseiseki Anubis is the option that saved us a lot of work over the past mont…
Post #AxCeOvcRAZKe8IbDFo by [email protected]
0 likes, 0 repeats
@[email protected] @[email protected] A lot of use…
Post #AxCeOw3jX5ANUxN0ng by [email protected]
0 likes, 0 repeats
@Suiseiseki BTW, we're also actively following the work around iocaine, e.g…
Post #AxCePQmnI72InOgQCW by [email protected]
0 likes, 0 repeats
@Codeberg ouch. This remains a cat-and-mouse game.At least having them solve th…
Post #AxCeSfMVYQRMs4vldQ by [email protected]
0 likes, 0 repeats
@Suiseiseki @phnt @Codeberg "infidel"? What are you, a pantomime reli…
Post #AxCeSfTx6kOZFAPiEq by [email protected]
0 likes, 0 repeats
@mdione @Suiseiseki @Codeberg No, he's just autistic about a group of licen…
Post #AxCeUABkQa5mldbzH6 by [email protected]
0 likes, 0 repeats
@Codeberg Now what needs to happen is that part of the challenge computes a kno…
Post #AxCeUAHm4Auf4KQnfU by [email protected]
0 likes, 0 repeats
@woozle This topic was discussed in the past. The problem is that cutting usefu…
Post #AxCeUANnhljXN1Fc3s by [email protected]
0 likes, 0 repeats
@Codeberg Yeah, agreed it's nontrivial.
Post #AxCeUBH6O9yA8X7mG8 by [email protected]
0 likes, 0 repeats
@Codeberg (on further thought) ...or is it?Create a set of N problems.Solve a s…
Post #AxCeY3vTeYryVFrPVo by [email protected]
0 likes, 0 repeats
@Codeberg wow - that looks scary. Thanks for all your work ❤️
Post #AxCeckIY3ZdZ4msvjc by [email protected]
0 likes, 0 repeats
@Codeberg Can we continue this conversation over email after my panic subsides?…
Post #AxCedJlqAerf5lrJke by [email protected]
0 likes, 0 repeats
@Codeberg wow :psyduck:
Post #AxCedvAb7ZeX5Gj6ye by [email protected]
0 likes, 0 repeats
@Codeberg so, to clarify, do you have evidence that the bots were solving Anubi…
Post #AxCegzxPmJb2nh1mRk by [email protected]
0 likes, 0 repeats
@Codeberg In the days of single CPU servers (early 90s?) and an interesting fil…
Post #AxCehk4QKaXFokf1l2 by [email protected]
0 likes, 0 repeats
@Codeberg
Post #AxCeih3P21m8kfdXrE by [email protected]
0 likes, 0 repeats
@Codeberg Is your list shared? It would be good to have a list of carefully cur…
Post #AxCejWAwxj7FIqYnCa by [email protected]
0 likes, 0 repeats
@Codeberg yeowsa. this feels like an arms race that is going to get harder :(
Post #AxCem0kkFPFiiSUYNM by [email protected]
0 likes, 0 repeats
@Codeberg @SuperDicq @Suiseiseki I don’t think that because some people brows…
Post #AxCem0rpp2vL4RoDQW by [email protected]
0 likes, 0 repeats
@[email protected] @[email protected] @Suiseiseki@freesoftwa…
Post #AxCemqB53FccCuCo0O by [email protected]
0 likes, 0 repeats
@Suiseiseki @Codeberg In what way is Anubis proprietary?
Post #AxCer6L8u0XDUYwZLE by [email protected]
0 likes, 0 repeats
@CodebergI like the idea of them figuring out solving the Anubis challenge only…
Post #AxCerl8pCi2k2EUoKm by [email protected]
0 likes, 0 repeats
@Suiseiseki @Codeberg >If you want to stop scraper bots, start serving GNUzi…
Post #AxCet2TSFMUA55ktxQ by [email protected]
0 likes, 0 repeats
@Suiseiseki @Codeberg browsers do not offer an interface that allow for thatTha…
Post #AxCetZTFZ8viQ0uhii by [email protected]
0 likes, 0 repeats
@phnt @Suiseiseki @Codeberg nonsensical. This is no different than automaticall…
Post #AxCetZaL8mbKm0EMls by [email protected]
0 likes, 0 repeats
@RedTechEngineer @Suiseiseki @Codeberg You can argue however you want. It is th…
Post #AxCetZjCbpgrDUNRaK by [email protected]
0 likes, 0 repeats
@phnt @Suiseiseki @Codeberg them choosing to eat garbage is their choice. no on…
Post #AxCeu8jmRfwtnPutqS by [email protected]
0 likes, 0 repeats
@Codeberg Good luck with fighting the bots. I recently moved my OSDev project a…
Post #AxCf2oKBi19D5q53eC by [email protected]
0 likes, 0 repeats
@Codeberg Great thread and explanation. Thank you.
Post #AxCf9cMwYe642acDWy by [email protected]
0 likes, 0 repeats
@Codeberg I'm really sorry there isn't a good legal avenue to stave off…
Post #AxCfBzxXovidmfs1UO by [email protected]
0 likes, 0 repeats
@Suiseiseki @Codeberg is this one of those dual operton systems?
Post #AxCfE4tmQYMDgM6L20 by [email protected]
0 likes, 0 repeats
@thesamesam Unfortunately, I'm not sure if encouraging anyone to reinforce …
Post #AxCfEino4BLXRPc8H2 by [email protected]
0 likes, 0 repeats
@Codeberg #HugOps
Post #AxCfF2G9j0JRmq1XbE by [email protected]
0 likes, 0 repeats
@zacchiro Yes, the crawlers completed the challenges. We tried to verify if the…
Post #AxCfGeqRkclBkLlw36 by [email protected]
0 likes, 0 repeats
@Codeberg nice
Post #AxCfJBVdHEOhdGF1u4 by [email protected]
0 likes, 0 repeats
@Codeberg #opshugs
Post #AxChkdJEE1qhZyeiEC by [email protected]
0 likes, 0 repeats
I have a follow up question, though, @Codeberg, re: @zacchiro's question. …
Post #AxChkdR1l25TyAIwNs by [email protected]
0 likes, 0 repeats
@bkuhn Anubis challenges are not solved by humans. It's not like a captcha.…
Post #AxChsXJsNVW5Jsj9Ga by [email protected]
0 likes, 0 repeats
@Codeberg This is a great number, but I have seen higher in my career. Unfortun…
Post #AxCi2mFDk66AVKQtfc by [email protected]
0 likes, 0 repeats
@Codeberg I'm sure https://www.patreon.com/cadey could work?
Post #AxCi6ge4VBlkITvA0G by [email protected]
0 likes, 0 repeats
@Suiseiseki @Codeberg That’s a bullshit. The zip bombs are old and if the AI-…
Post #AxCiluVbrXjNAPcUfw by [email protected]
0 likes, 1 repeats
@Codeberg damn. The only time I've seen numbers like this were when a ceph …
Post #AxCim7dt254ltqamsi by [email protected]
0 likes, 0 repeats
@Codeberg oh...... noob question: how can it send the challenge response? I mea…
Post #AxCim7kcd2SoEjkANc by [email protected]
0 likes, 0 repeats
@gturri Anubis sends a challenge. The browser needs to compute the answer with …
Post #AxCimTIMWmvl3SguO0 by [email protected]
0 likes, 0 repeats
@woozle Remember that users want to get through the challenge page quickly. So …
Post #AxCimfaAqOJBAB7Ioa by [email protected]
0 likes, 0 repeats
@Codeberg OH RIGHT... I was kinda forgetting about the actual-user time-penalty.
Post #AxCjVDYZtEADH3c1my by [email protected]
0 likes, 0 repeats
@Codeberg These companies are evidently willing to pay an absolutely staggering…
Post #AxCjVDexVVGfaqb7jc by [email protected]
0 likes, 0 repeats
@Codeberg @cadeyAlso, does the Anubis client use multiple cores to do its work?…
Post #AxCjVDkz965XtXPw80 by [email protected]
0 likes, 1 repeats
@argv_minus_one @Codeberg it already does: https://github.com/TecharoHQ/anubis/…
Post #AxCjgf51tmOhp1FSIy by [email protected]
0 likes, 1 repeats
@Codeberg It's going to be rat race after all, I expected this to happen ev…
Post #AxCy9pVwEyI8zHbU5A by [email protected]
0 likes, 0 repeats
@ikke @Codeberg is there a way to get them solving something useful, so at leas…
Post #AxCy9pe5keoVOZPzn6 by [email protected]
0 likes, 0 repeats
@peterainbow @ikke @Codeberg a friend of mine ran a startup where random websit…
Post #AxCy9ronfoZG8MRZlA by [email protected]
0 likes, 0 repeats
@peterainbow @ikke @Codeberg it worked as a cheap marketplace for compute. You …
Post #AxCyKICYR7PWr6WfTM by [email protected]
0 likes, 0 repeats
@CodebergHw much RAM do you have in your Machines?
Post #AxCyKIKhwnvtGOLBBI by [email protected]
0 likes, 0 repeats
@lindesbs 160 GB apparently. Looked it up from https://codeberg.org/Codeberg-In…
Post #AxCyLp4hhQZv6GaEvQ by [email protected]
0 likes, 0 repeats
@DamonHD @Codeberg got around 800 on a single CPU server (well actually VM) thi…
Post #AxCyLpB5JhgNQ3ZKs4 by [email protected]
0 likes, 0 repeats
@mirabilos @Codeberg Yes, that is bad. I now run servers with no disc swap and…
Post #AxCyPf0L5CVD1eN7AG by [email protected]
0 likes, 0 repeats
@cadey @Codeberg in case it is because of this, don't be too hard on yourse…
Post #AxCyRms4o0KE0FWNc0 by [email protected]
0 likes, 0 repeats
@DamonHD @Codeberg no swap at all is actually a bad thing on Linux. Put some in…
Post #AxCyUOGmjIkkZVJsye by [email protected]
0 likes, 0 repeats
@fabiosantoscode @peterainbow @Codeberg That sounds very sketchy to be honest.
Post #AxCyZlzHyVDNZxhd4q by [email protected]
0 likes, 0 repeats
@Codeberg I believe @Suiseiseki is not referring to codebergs usage of anubis s…
Post #AxCydOxdWsaHJzezEu by [email protected]
0 likes, 0 repeats
@Suiseiseki @daemon_nova @SuperDicq @Codeberg If someone has the dedication to …
Post #AxCyxIlwFSRpv3g4KO by [email protected]
0 likes, 0 repeats
@Codeberg what is the threshold for alerting so? Grafana/Zabbix/Prometheus?
Post #AxCyzaP9f6b5BW6sWu by [email protected]
0 likes, 0 repeats
@ikke @peterainbow @Codeberg It's a startup 🤷‍♂️They pivoted to so…
Post #AxCzF3sOMynyvuAGkC by [email protected]
0 likes, 0 repeats
@SuperDicq @Suiseiseki @Codeberg "saying anubis is the only solution"…
Post #AxCzPV0wKJ4vzm8jOS by [email protected]
0 likes, 0 repeats
@Codeberg Just for reference, I'd understand it if you decided to go "…
Post #AxD4S0Sqrkgvt1D6K8 by [email protected]
0 likes, 0 repeats
@ikke @Codeberg it costs the planet extra resources too unfortunately :/
Post #AxD4Vd5ZiWlOXz3BmS by [email protected]
0 likes, 0 repeats
@Codeberg huh, that's a pretty kernel-heavy workload, so much red
Post #AxD4VdXw15RrxwJpz6 by [email protected]
0 likes, 0 repeats
@Codeberg what are they hitting that's so kernel-intensive, is this filesys…
Post #AxDEXxkQsTNojyudGa by [email protected]
0 likes, 0 repeats
@fabiosantoscode @peterainbow @ikke @Codeberg I remembered that there are crowd…
Post #AxDEXyIooctASd05rc by [email protected]
0 likes, 0 repeats
@fabiosantoscode @peterainbow @ikke @Codeberg I think the main issues for imple…
Post #AxDEY5kj7GN7ZD6yps by [email protected]
0 likes, 0 repeats
@phf @Codeberg Hmm, what if the top level "README" project info pages…
Post #AxDEbWgVRMYZxnm7KS by [email protected]
0 likes, 0 repeats
@Codeberg omfg that load!
Post #AxDEfbJCBrErSloZcW by [email protected]
0 likes, 0 repeats
@jann @Codeberg It’s io. If the system was cpu bound at 5000+ load you certai…
Post #AxDOGTsXg09Sio0aDg by [email protected]
0 likes, 0 repeats
@Codeberg @thesamesamhttps://liberapay.com/Xe/ you can support Xe through liber…
Post #AxDikFUTjYVxruDzcW by [email protected]
0 likes, 0 repeats
@mirabilos @Codeberg my scheme has been working well for me (with a little zram…
Post #AxDikFarLpcQBhD5ZA by [email protected]
0 likes, 0 repeats
@Codeberg @DamonHD it works, sure
Post #AxDinKfOwfjyn5nufA by [email protected]
0 likes, 0 repeats
@Codeberg thank you for the details. Very interesting. They are worth a blog po…
Post #AxDjCqxs02ViCUc05Q by [email protected]
0 likes, 0 repeats
@cadey @argv_minus_one @Codeberg mb suggest to migrate to CodeBerg instead of h…
Post #AxDuFRLUo0tJ6q6BcG by [email protected]
0 likes, 0 repeats
@mirabilos @Codeberg I run all my primary services on an RPi3 off grid. It has…
Post #AxDuFS9pmr9ncxeO4u by [email protected]
0 likes, 0 repeats
@mirabilos @Codeberg It also gives better Web response than I can get out of Cl…
Post #AxDuFSvguvRE1O2bfk by [email protected]
0 likes, 0 repeats
@mirabilos @Codeberg Those may well be different to your goals for a server.
Post #AxDw9ARCxJOkqDuJNI by [email protected]
0 likes, 0 repeats
@danjones000 @Codeberg The crawler is a separate system where the gains of usin…
Post #AxE2BVJusywnuXzhj6 by [email protected]
0 likes, 0 repeats
@phf @Codeberg I'd move my code off Codeberg if it became another walled ga…
Post #AxE6FZpUSi5Us4xaeO by [email protected]
0 likes, 0 repeats
@phfHmmm... Really though? Switching from "git clone this repo and build&q…
Post #AxE6MESOK60Yc2KTU8 by [email protected]
0 likes, 0 repeats
@zkat I think that Liberapay is currently one of the best options, thank you fo…
Post #AxEF7LfS8BMaDgPsKO by [email protected]
0 likes, 1 repeats
@Codeberg Have you looked into serving these LLM crawlers alternative versions …
Post #AxEF7cZhGprOekr1DU by [email protected]
0 likes, 0 repeats
@mathew @phf @Codeberg I hope it doesn't come to that, although it may need…
Post #AxEJH1o1EOsJKdIIhk by [email protected]
0 likes, 0 repeats
@varx @Codeberg I think maybe the hard part isn't deciding what content to …
Post #AxEJH1v6o2Xvgcbxku by [email protected]
0 likes, 1 repeats
@cuchaz @Codeberg True, blocking an IP range might have acceptable false positi…
Post #AxHwz9WSNgxHh1zTOq by [email protected]
0 likes, 0 repeats
@Codeberg Are you going to publish your work anywhere? I guess it could cause t…
Post #AxHxAzWVNr7k9jesNc by [email protected]
0 likes, 0 repeats
@argv_minus_one @Codeberg the good news is that either way, the attackers' …
Post #AxHxAzcX1RwcSQTgm0 by [email protected]
0 likes, 0 repeats
@ireneista Eventually the gold rush will end, yes, but in the mean time, they s…
Post #AxHxBRHw9c6kGf3dYm by [email protected]
0 likes, 0 repeats
@argv_minus_one @Codeberg can we just say, by the way, the fact you're repo…
Post #AxHxBSsUFCwFCJALAW by [email protected]
0 likes, 0 repeats
@Codeberg Perhaps it's time stop letting robots solve puzzles and instead f…
Post #AxHxBvctMGhAML5nO4 by [email protected]
0 likes, 0 repeats
😲🤬 re: what's happened to @Codeberg today.The AI ballyhoo *is* a real…
Post #AxHxBvm6o04GovP9km by [email protected]
0 likes, 0 repeats
@bkuhn @Codeberg if anyone need it, there is this gist showing how to pseudo-au…
Post #AxHxBvtCNdjtAuionw by [email protected]
0 likes, 0 repeats
IMO, @serk, the better move is not to delete the repository, but to do somethin…
Post #AxHxBw0zudyfZ6N2xc by [email protected]
0 likes, 0 repeats
@bkuhn @serk When @librecast moved our repos I wrote a script to wipe the GitHu…
Post #AxHxBw9VP0mbzULqDo by [email protected]
0 likes, 0 repeats
@bkuhn @serk https://spectra.video/w/mhoTtoSoXtkjanF1qZHwRZ😉
Post #AxHxCnJxirdgtGeRNY by [email protected]
0 likes, 0 repeats
@CodebergKeep up the good work!
Post #AxHxD46lJCBIxFbdfE by [email protected]
0 likes, 0 repeats
@argv_minus_one @Codeberg so the thing about how complex systems fail is, every…
Post #AxHxEoIt2Y3GW86qYa by [email protected]
0 likes, 0 repeats
@[email protected] Anubis is extremely easy to bypass, you just have …
Post #AxHxEoROWurCwW5dom by [email protected]
0 likes, 0 repeats
@ulveon This depends on the configuration, and it was not the problem we have b…
Post #AxHxFbpsseYs8evOIC by [email protected]
0 likes, 0 repeats
@Codeberg "AI crawlers learned how to solve the Anubis challenges"Why…
Post #AxHxFbxKQyW4VkPKtc by [email protected]
0 likes, 0 repeats
Hi @bookwar @Codeberg,because we let the commission and https://consilium.europ…
Post #AxHxFy8PyQSVIVlVEe by [email protected]
0 likes, 0 repeats
@Codeberg are the ip blocklists public?
Post #AxHxGWqCw7gkwAVxD6 by [email protected]
0 likes, 0 repeats
@Codeberg gzip bomb when?
Post #AxHxInTk36Uv7K5VGi by [email protected]
0 likes, 0 repeats
@Codeberg Are you guys using traffic shaping and queue management at all? For e…
Post #AxHxJ7BKnFeoE1d5M0 by [email protected]
0 likes, 0 repeats
@[email protected] @[email protected] What if we set u…
Post #AxHxJ7J8KFtacDHJVg by [email protected]
0 likes, 0 repeats
@daltux I bet they rotate IPs @Codeberg
Post #AxHxJ7PrvDHcx6Qh0a by [email protected]
0 likes, 0 repeats
Yes, they have plenty of resources. This is why I guess feeding them the compre…
Post #AxHxKtB7pQqlNENTIe by [email protected]
0 likes, 0 repeats
@binaergewitter Toter der Woche: Anubis-Challenges als wirksames Mittel
Post #AxHxLBPc2J8LvNIINc by [email protected]
0 likes, 0 repeats
@Suiseiseki @Codeberg That mostly stops the badly-written scrapers though.Stric…
Post #AxHxLnKd3Hj5WvFqt6 by [email protected]
0 likes, 0 repeats
@Codeberg It makes me wonder: there is a public curated IP blocklist somewhere …
Post #AxHxMBKRpbqFxJM2wC by [email protected]
0 likes, 0 repeats
@Codeberg this is an absurd level of waste they're introducing
Post #AxHxMPulbNDDC0SFUW by [email protected]
0 likes, 0 repeats
@argv_minus_one @Codeberg corporate strategy has a tendency to leverage this ap…
Post #AxHxN837Vg2Q4ehXcW by [email protected]
0 likes, 0 repeats
@Codeberg It’s ok, take it slowly and take care of yourselves and your comput…
Post #AxHxOUcT52DyMbsxNY by [email protected]
0 likes, 0 repeats
@Codeberg Was the solution to increase the proof-of-work difficulty?
Post #AxHxOUiqhJKQgOs3KC by [email protected]
0 likes, 0 repeats
@baltakatei No. We fixed our config. Now we're blocking the offending IP ra…
Post #AxHxOcs0P9PFx7DThw by [email protected]
0 likes, 0 repeats
@nemo Currently not. We wanted to investigate the legal situation with regards …
Post #AxHxQVVijo6FhsgpiS by [email protected]
0 likes, 0 repeats
@Suiseiseki @Codeberg @phnt curl also supports --max-filesize and --max-time.Co…
Post #AxHxR44IFlxOsx7vKC by [email protected]
0 likes, 0 repeats
@danjones000 @Codeberg the whole point is to force the scrapers to run a whole …
Post #AxHxRocx9F0vHlhFjc by [email protected]
0 likes, 0 repeats
@argv_minus_one @Codeberg anyway, yes, proxies are of course going to be part o…
Post #AxHxRtLlaZElvuh68m by [email protected]
0 likes, 0 repeats
@Codeberg May be would it be possible to use the tool described in :https://sat…
Post #AxHxSe7BiaVCyJEcRU by [email protected]
0 likes, 0 repeats
@Codeberg Thank You For Your Service. ( I moved to Codeberg, like, yesterday, …
Post #AxHzDdj556hjKXvn72 by [email protected]
1 likes, 0 repeats
@muppeth @Codeberg What kind of work are you referring to? The configuration th…
You are viewing proxied material from pleroma.anduin.net. The copyright of proxied material belongs to its original authors. Any comments or complaints in relation to proxied material should be directed to the original authors of the content concerned. Please see the disclaimer for more details.