Yahoo! recognizes and honors the access policy for robots specified within the robots.txt file that lives (or can be created) on any WWW server.

To prevent most robots, with the exception of Yahoo!, from scanning your site, you can add these lines to the /robots.txt file on your server:

User-agent: *

Disallow: /

User-agent: YahooSeeker

Disallow:

The first line prevents all robots from crawling your site with the exception of Yahoo!'s crawler (YahooSeeker) as commanded on the second line.

You can also be more selective and indicate which parts of your server robots cannot visit. Learn more about robots.txt.