# robots.txt file # This is how you tell the search engines not to index specific directories. User-agent: * Disallow: / Disallow: /images/ # This is how you deal with a specific robot User-agent: cybermapper Disallow: /notused/ Disallow: /picts/