Robots only
The robots.txt file that most sites publish is only meant for software crawling the web, so better not visit mine with your browser!
The robots.txt file that most sites publish is only meant for software crawling the web, so better not visit mine with your browser!