 |
Post Aun67u1UTVD8x9DQLw by [email protected] |
 |
More posts by [email protected] |
|
Post #Auhayw27YyYEDBxFw0 by [email protected] |
|
0 likes, 3 repeats |
|
|
|
building a little log analyser thing and testing it out on my site and blogholy… |
|
|
|
Post #Auhayw8VBFegWywLse by [email protected] |
|
0 likes, 0 repeats |
|
|
|
I don't get a ton of traffic there anyway, it's not like thousands of p… |
|
|
|
Post #AuhaywEAqAByoZasim by [email protected] |
|
0 likes, 0 repeats |
|
|
|
one thing I did notice is that there are quite a few user agents that point to … |
|
|
|
Post #AuhaywKYSRIR8MZyfQ by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@gsuberland your stats track what I’m seeing |
|
|
|
Post #AuhneQTySPWDyHX9bU by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@gsuberland 100% agree, I see the same. I tuned my servers to watch for traffic… |
|
|
|
Post #AuhsExWlTQiyhTVydc by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@gsuberland So what happened to the real people? It seems our existence is unde… |
|
|
|
Post #AuickF7CjEie7GPkSe by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@fbarton @gsuberland Ditto. They don;t even seem to check the stuff they are pu… |
|
|
|
Post #AuickFDEMpXWPxEYr2 by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@dtl @gsuberland ya’know… if you’re lying for egress, that’s very fair.… |
|
|
|
Post #Auii1z4zaSjpMjeu8W by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@gsuberland I wish there were an easy way to booby trap your own content agains… |
|
|
|
Post #Auk76Qz4TNGH534GTA by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@gsuberland the funny thing is if they just scraped each page *once* and then c… |
|
|
|
Post #Auk76at3eaORnIKbU8 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@cinebox @gsuberland yeah but cloud ingress is free, caching a whole friggin… |
|
|
|
Post #Aun65Hes8wrRO5O4bg by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@gsuberland I also recommend to look at your webserver's error log. On my s… |
|
|
|
Post #Aun66JN1GObkzFWifI by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@gsuberland how does an amateur do the same check then block the bots? |
|
|
|
Post #Aun66JVWklPhPdVVvU by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@europlus for blocking, search "apache2 block user agent" or "ng… |
|
|
|
Post #Aun66JfS9rLxuQ9ROi by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@gsuberland thank! Sorry to have been lazy, I’m a little overwhelmed right no… |
|
|
|
Post #Aun67u1UTVD8x9DQLw by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@gsuberland is your script available anywhere by chance? Wouldnt mind parsing m… |
|
|
|
Post #Aun67u8a38slJ8X5P6 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@jessienab I haven't finished it yet, so right now all it does is take the … |
|
|
|
Post #Aun68YWjsjySZe8wc4 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@gsuberland If they're actually making the most of that traffic, I wouldn&#… |
|
|
|
Post #Aun6C2qNca1pT6zgDQ by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@fbarton @gsuberland thanks for the reminder to block these user agents or serv… |
|
|
|
Post #Aun6C2zF5d7Lub8l1s by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@sycophantic @gsuberland moving target… they keep changing |
|
|
|
Post #Aun6C37ObJdiJsxGjo by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@fbarton @gsuberland damn |
|
|
|
Post #Aun6C3Fu5gRekGw400 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@sycophantic @gsuberland and if they notice that you’re blocking, they’ll j… |
|
|
|
Post #Aun6C3OlYjXBBl58oS by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@fbarton @gsuberland guess it's better to poison them |
|
|
|
Post #Aun6CUYGbWB1P2jbs0 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@gsuberland people don't want to hear that RSS is broken in the sense that … |
|
|
|
Post #Aun6FIMEOjwAS6RSGe by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@gsuberland that is why so many sites are deploying @cadey's Anubis https:/… |
|
|
|
Post #Aun6KLlZ9VBKTJhbiC by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@gsuberland I'm using this list:https://raw.githubusercontent.com/mitchellk… |
|
|
|
Post #Aun6KLv8Zuq0x0BFdA by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@wila the worst offenders I found are largely missing from that list.here are t… |
|
|
|
Post #Aun6KM53z0mHRmpB6O by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@wila @gsuberland in my experience (hosting a bunch of wikis) the absolute wors… |
|
|
|
Post #Aun6O3j2AZong4HphI by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@[email protected] oh yeah and the chinese ones use edge browser user age… |
|
|
|
Post #Aun6OPh0UnGjo9VWam by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@europlus all good :) |
|
|
|
Post #Aun6OPpVzA4gEXUJqy by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@gsuberland @europlus have you tried Anubis? https://github.com/TecharoHQ/anubi… |
|
|
|
Post #Aun6OQm0TgrX9wr21Y by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@hannsr @gsuberland @europlus it uses the UA; it only triggers when the user ag… |
|
|
|
Post #Aun6QNf714FA5bYjZo by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@miaI was about to suggest that it is time to deploy Anubis. Thank you for brin… |
|
|
|
Post #Aun6TaSZtHSYeME2AS by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@gsuberland congrats on having more RSS traffic than direct users ! |
|
|
|
Post #Aun6V56pQIJxzplTg8 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
muting this now |
|
|
|
Post #Aun6W0d3Z8y8OIHWKG by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@gsuberland They deserve to be fed zip bombs. |
|
|
|
Post #Aun6WV2GVyxWhAJ4me by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@gsuberland serious problem for sure. I have considered booting up a kind of �… |
|
|
|
Post #Aun6YKuP8YPLrnVPMG by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@gsuberland OK, I’ve put a useragent.rules file following https://www.xmodulo… |
|
|
|
Post #Aun6aPqzirKVmZu0S8 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@gsuberland yep. It’s mayhem. Here’s a great robots.txt file that works wel… |
|
|
|
Post #Aun6bIQeoTwV2p0FXM by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@hannsr @europlus it is good, but not compatible with my specific requirements … |
|
|
|
Post #Aun6bS7WmSaB6O876m by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@gsuberland yup. it’ll die down once you start dropping their requests at the… |
|
|
|
Post #Aun6efvNuhhomdzEwq by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@f4grx it makes sense; many RSS readers automatically pull a copy of the page. |
|
|
|
Post #AunBasyfwLtPsaXRM8 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@gsuberland I observe very similar traffic patterns. This is the only thing I a… |
|
|
|
Post #AunBfkjC2Wx3k1cL9U by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@gsuberland oh my mother! 😫 it is a distopic end |
|
|
|
Post #AunFcqGvN1XJsrGKp6 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@gsuberland I have practically zero legitimate traffic to my site outside of fe… |
