 |
Post AjFfmox9e3IU9yTi4W by [email protected] |
 |
More posts by [email protected] |
|
Post #AjFOZqmDr4BwpYatpg by [email protected] |
|
0 likes, 1 repeats |
|
|
|
Blocking AI through robots.txt is like putting up a list of known burglars on y… |
|
|
|
Post #AjFSYDCvt16JdUYu1o by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@mxbck True that. How can we block them effectively? |
|
|
|
Post #AjFSYDIxWbvBwBNiQC by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@kdekooter @mxbck guillotines |
|
|
|
Post #AjFSYDOzACk4EsCWoa by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@heydon @kdekooter @mxbck If you can identify them by UA tokens then can’t yo… |
|
|
|
Post #AjFUz2RoCSCVzWRJxY by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@siblingpastry @heydon @kdekooter you can, provided they actually use these UA … |
|
|
|
Post #AjFUz2xMJ9RDZNCW8W by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@mxbck @heydon @kdekooter Then how do you identify them in robots.txt? |
|
|
|
Post #AjFfibOk6HgmxfN2hM by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@siblingpastry @mxbck @heydon It is up to the visitor to respect the rules in r… |
|
|
|
Post #AjFfibV7iYnFHSM8e0 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@kdekooter @siblingpastry @heydon yeah that's exactly the problem: there… |
|
|
|
Post #AjFficV9zuPuNrNgLA by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@mxbck @kdekooter @siblingpastry @heydon is a honey pot technique viable here? … |
|
|
|
Post #AjFficbBdVEmgYCUjY by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@3dmac @mxbck @kdekooter @heydon I've heard of people writing junk to try a… |
|
|
|
Post #AjFfmox9e3IU9yTi4W by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@mxbck @kdekooter @siblingpastry @heydon Which you most likely only know about … |
|
|
|
Post #AjFfmp3BHe7MSfIWSu by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@Lippe @mxbck @kdekooter @heydon Sounds like these bots exist in a state of qua… |
|
|
|
Post #AjFzaXm3gk00ULiAF6 by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@mxbckI disallow for *, then allow for known search engines.That's not even… |
|
|
|
Post #AjFzaYSx7GJIdNmQ6K by [email protected] |
|
0 likes, 2 repeats |
|
|
|
@leeloo @mxbck yeah I've been thinking of doing the same. Disallow everyone… |
