 |
Post AwrvNWxvb12mW0xrjU by [email protected] |
 |
More posts by [email protected] |
|
Post #AwqdMn6K7vQNw5QfxI by [email protected] |
|
0 likes, 1 repeats |
|
|
|
the recent burst of companies flagrantly disregarding robots.txt are eating the… |
|
|
|
Post #AwqfeaVRtNyrzjnN7A by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@0xabad1dea or they're trying to bank as much cash as possible now so that … |
|
|
|
Post #AwqfeabTWynkIQcBVY by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@mcc @0xabad1dea while I wouldn't put it past them, the problem with this t… |
|
|
|
Post #Awqfeah9BtL2a1GiLg by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@mcc @0xabad1dea like it only makes sense if you accept the premise that the da… |
|
|
|
Post #AwqfeanWoARUtoFoIK by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@glyph @mcc @0xabad1dea the data itself is clearly a mixed bag, often times a s… |
|
|
|
Post #Awqg6O59g7JpZQkiTw by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@glyph @mcc @0xabad1dea but “making money” these days is not about direct i… |
|
|
|
Post #AwqhPbTiCDfeZdxvI8 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@0xabad1dea I really don't like the fact that I have heard at least a dozen… |
|
|
|
Post #AwqhPbZjpoUWsKmjgW by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@glyph @0xabad1dea I still remember the first time someone explained how that t… |
|
|
|
Post #AwqhfiWPmAQB3JughU by [email protected] |
|
0 likes, 2 repeats |
|
|
|
one time I was on vacation and a Microsoft employee contacted me personally wit… |
|
|
|
Post #AwqtMkdQtTj7YQv1Xc by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@0xabad1dea I love this story, however Microsoft is the one company that probab… |
|
|
|
Post #AwqtMkjoVkpZsDu7UG by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@purpleidea that's not true at all. every single major internet company has… |
|
|
|
Post #AwrPzMCOsRmFauj8ZE by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@0xabad1dea Time for everyone to start increasing the costs by deploying someth… |
|
|
|
Post #AwrPzMKCPS11z6NMiu by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@thedarktangent @0xabad1dea Anubis is a travesty for the common good, it's … |
|
|
|
Post #AwrPzMQa1j7UItMSfY by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@Foxboron @0xabad1dea Its taken decades to get here, and all along the way comp… |
|
|
|
Post #AwrPzMWxe0DwcgLYcC by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@thedarktangent @0xabad1dea Tar pit defences don't ruin the fundamental web… |
|
|
|
Post #AwrPzMfT8N1t34KLsO by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@Foxboron @thedarktangent @0xabad1dea Precisely, and that's why Anubis is a… |
|
|
|
Post #AwrPzMlqke8LMrJRp2 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@soop @thedarktangent @0xabad1dea Well, that's the issue. You can't fig… |
|
|
|
Post #AwrPzMswKHnxiqd6sC by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@Foxboron @soop @thedarktangent @0xabad1dea My reaction to the "Anubis is … |
|
|
|
Post #AwrPzN01tvTa4pwlvM by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@n0toose @Foxboron @thedarktangent @0xabad1dea ffs at least don't use anubi… |
|
|
|
Post #AwrPzN7TSFQmRvQiWm by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@soop @n0toose @thedarktangent @0xabad1dea > you can replicate 95% of anubis… |
|
|
|
Post #AwrPzNED3Coomoa61g by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@Foxboron @n0toose @thedarktangent @0xabad1dea My point is the javascript PoW i… |
|
|
|
Post #AwrPzNLIcqUR8ntl4q by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@soop @Foxboron ... or the hardest one. "then send us your sysadmins"… |
|
|
|
Post #AwrPzNSOCUA3UnDQ80 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@n0toose @Foxboron There are anti-scraper tools other than Anubis that are simi… |
|
|
|
Post #AwrPzNY3rOhLmNrwy8 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@soop @n0toose @Foxboron you mean these? https://iocaine.madhou... https://git.… |
|
|
|
Post #AwrPzNf9R2My8NBc1I by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@apophis @n0toose @soop I can't see how iocaine is scaleable for AI-scrappe… |
|
|
|
Post #AwrPzNmF0g2aUMVH4S by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@Foxboron @apophis @n0toose @soopI'm going to respond to multiple parts of … |
|
|
|
Post #AwrPzNpQooaoeFzp2m by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@soop @Foxboron either way, either you can scream from the sidelines or contrib… |
|
|
|
Post #AwrPzNvSSPPgwwodRA by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@algernon @Foxboron @apophis @n0toose @iocaine amazing thank you i'm bookma… |
|
|
|
Post #AwrPzOtMrfKrwkqTom by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@algernon since you're here and you seem to know what you're talking ab… |
|
|
|
Post #AwrPzmaOlqQFQs9faC by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@soop @n0toose @Foxboron @thedarktangent sorry but I have read the page you lin… |
|
|
|
Post #AwrPzmh8MnoHllJ356 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@0xabad1dea @n0toose @Foxboron @thedarktangent it clearly states a plan to keep… |
|
|
|
Post #AwrPzmmo1iLa3LxZvE by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@soop @0xabad1dea @n0toose @thedarktangent That's not true. |
|
|
|
Post #AwrPzmspfJASM2mOJc by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@Foxboron @0xabad1dea @n0toose @thedarktangent elaborate |
|
|
|
Post #AwrPzmyrItzKejbCi0 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@soop @0xabad1dea @n0toose @thedarktangent No?I'm not here to educate you a… |
|
|
|
Post #AwrQ00eoSEGv4cKOPI by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@Foxboron @0xabad1dea @n0toose @thedarktangent Then why are you here arguing wi… |
|
|
|
Post #AwrQ00kq5p5nNJ9Cng by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@soop @Foxboron @n0toose @thedarktangent why are YOU arguing with strangers on … |
|
|
|
Post #AwrQ023fFJkFPyxkmW by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@apophis @Foxboron @n0toose Precisely |
|
|
|
Post #AwrQ0aTjGunSAfQ384 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@Foxboron @0xabad1dea @thedarktangent @soop Or you could throttle the site with… |
|
|
|
Post #AwrQ0abApEkeXktzjU by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@lispi314 @Foxboron @thedarktangent @soop ah, make it unusable for everyone, no… |
|
|
|
Post #AwrQ0ahYRVr6rXt5g8 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@endrift @soop @thedarktangent @Foxboron Throttled is slow but still usable. It… |
|
|
|
Post #AwrQ1JebJLEOHPqrp2 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@algernon @Foxboron look, the reach is indeed "the problem" - if it&#… |
|
|
|
Post #AwrQ1JlKuIcQcJ0FJw by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@algernon @Foxboron this is not something i'm saying because i want to quit… |
|
|
|
Post #AwrQ1v0WQnkc87OOcy by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@soop @Foxboron - i know the project is in part sketch- there are many projects… |
|
|
|
Post #AwrQ1vQOsaS1QNV3xo by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@soop @Foxboron plus, if you actually do it right and only deploy it to specifi… |
|
|
|
Post #AwrQ3Nw4MXGA8f0coy by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@Foxboron @soop @thedarktangent @0xabad1dea Yeah. It's not an either/or, bo… |
|
|
|
Post #AwrQ3p3nVuU6GRpg7E by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@n0toose @Foxboron nod nod, understood, and thank you!Marketing for Anubis-alte… |
|
|
|
Post #AwrQ3qWC5onEmo7s12 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@endrift @lispi314 @thedarktangent @soop You are helping them solve a problem t… |
|
|
|
Post #AwrQ45Zw6BhPUkzZQm by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@0xabad1dea exactly this, very well put.They're going to discover that if y… |
|
|
|
Post #AwrQ45gfh95Rpe8wvg by [email protected] |
|
0 likes, 0 repeats |
|
|
|
Or worse. The multinational tech megacorps. Good luck running your crawling bot… |
|
|
|
Post #AwrQ45n3JQBu9R82sK by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@JessTheUnstill @Taco_lad @0xabad1dea Oh, please, piss off my employer (current… |
|
|
|
Post #AwrQ45siyKjCR1mZiS by [email protected] |
|
0 likes, 0 repeats |
|
|
|
The Abuse departments of those places don't fuck around.@ryanc @Taco_lad @0… |
|
|
|
Post #AwrQ69kfYQL916zwvo by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@soop @0xabad1dea @n0toose @thedarktangent You are the one jumping into the thr… |
|
|
|
Post #AwrQ69qLDKsRIheTlw by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@Foxboron @0xabad1dea @n0toose @thedarktangent I jumped into the thread thinkin… |
|
|
|
Post #AwrQ69wipbytcUdZia by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@soop @0xabad1dea @n0toose @thedarktangent Then read the original toot again wi… |
|
|
|
Post #AwrQ6vBZCEmY88wasi by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@algernon @n0toose Xe is also very responsive to community feedback though. Whi… |
|
|
|
Post #AwrQ6vHappbQQplPH6 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@Foxboron @n0toose From my personal experience, everyone working in this space … |
|
|
|
Post #AwrQ7zeE5ivIG8rPiS by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@Foxboron @apophis @n0toose @algernon The other option offers javascript POWNot… |
|
|
|
Post #AwrQ7zkFjJkAYpgE6q by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@soop @apophis @n0toose @algernon Sure, just edit the 350 line YAML config by h… |
|
|
|
Post #AwrQ7zqdLaqcscfK3U by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@Foxboron @apophis @n0toose @algernon who says you have to go over the config f… |
|
|
|
Post #AwrQ7zy4tunpFi9Geu by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@soop @apophisWhy would you want to spend time keeping a YAML config up to date… |
|
|
|
Post #AwrQ8eKSq6TcQivi6a by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@lispi314 @endriftThis is not a solution. |
|
|
|
Post #AwrQ8oKpdaiFSlB94C by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@JessTheUnstill @Taco_lad @0xabad1dea well, at least some of theses bot network… |
|
|
|
Post #AwrQ96YxrmiFznvgau by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@soop That's a good question! I think it would be technically possible, but… |
|
|
|
Post #AwrQ96edWhFYHOaDR2 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@algernon i see, thanks for the responseI think it would be technically possibl… |
|
|
|
Post #AwrQA9mhNHJwHDr4We by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@soop @n0toose @thedarktangent @0xabad1dea This doesn't answer the question… |
|
|
|
Post #AwrQAT57d0La7rcYNc by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@lispi314 @thedarktangent @0xabad1dea @soop Okay, how? |
|
|
|
Post #AwrQAiMgnyJPWgxILQ by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@soop @Foxboron I do not disagree, but I think we are talking in circles and th… |
|
|
|
Post #AwrQBhZvDO8rNOcDwG by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@Foxboron brushing the social media argument aside, does this network happen to… |
|
|
|
Post #AwrQBplCnJvAkhxLdY by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@0xabad1dea Nods in "pre-millenium network operations center staff". |
|
|
|
Post #AwrQDE8DfVQiczNwRs by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@Foxboron @apophis You set it and forget it. Editing a config file once does no… |
|
|
|
Post #AwrQEe8cSk2PZiFVI0 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@soop @apophis Then I think you misunderstand or underestimate the problem we a… |
|
|
|
Post #AwrvNJbTHCM94bMFQO by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@0xabad1dea 2000ish, I got an angry call from some very pissed off dude who was… |
|
|
|
Post #AwrvNWxvb12mW0xrjU by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@rk @0xabad1dea oh, so _that's_ why AT&T shut down the email-to-text ga… |
|
|
|
Post #Ax2LlzkU8jT0tM39CC by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@0xabad1dea I was just being mean about M$. |
|
|
|
Post #Ax2LlzrZiN8dFLMoFM by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@purpleidea yes and it's annoying. |
|
|
|
Post #Ax2LlzxFNHfvWw1L5U by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@0xabad1dea I still love your story thanks. |
|
|
|
Post #AxhBP0kDtc8wJ9eUwC by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@lispi314 @Foxboron @thedarktangent @endrift @soop One of my sites sees very li… |
|
|
|
Post #AxhBP0t5MfESkdnZke by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@NegativeK @soop @endrift @thedarktangent @FoxboronDumb Throttling: Heavily deg… |
|
|
|
Post #AxhBP10stfTF8pRnuK by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@lispi314 Individualized throttling would work if some scrapers weren't usi… |
|
|
|
Post #AxhBPrnadpKOqwdR2m by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@NegativeK Yes, there are some hard limits to what even the combination of gene… |
