---------------------------------------
reply to tomasino - robots.txt
May 25th, 2019
---------------------------------------
Recently, tomasino wrote over on gopher.black about his robots.txt
dilemma he's having -
gopher://gopher.black/1/phlog/20190524-robots-txt
Personally, I think the solution is rather simple :D
Why not just disallow google and other search engines, but allow
Veronica-2, etc?
That's how I would do it, at least. I've probably missed something,
somewhere though.
Catch you,
~fosslinux
