How do I stop Yahoo! from crawling my web site for Yahoo! Product Search?
Text Size: A A A

Save to My Help

Save this article to My Help for easy reference. You can visit the article at any time from any computer.

Replace an article

You have reached the maximum number of saved articles. Your oldest saved article will be replaced with the new one.

Yahoo! recognizes and honors the access policy for robots specified within the robots.txt file that lives (or can be created) on any WWW server.

To exclude your entire web site or a specific section (directory) of your server from the Yahoo! Product Search index, simply place a file at the root of your server called robots.txt.

To prevent most robots, including Yahoo!'s, from scanning your site, you can add these lines to the /robots.txt file on your server:

User-agent: *

Disallow: /

To specifically prevent Yahoo! from crawling your site, you can add these lines to the /robots.txt file on your server:

User-agent: YahooSeeker

Disallow: /

You can also be more selective and indicate which parts of your server robots cannot visit. Learn more about robots.txt.

Was this information helpful?      

My Help

Forgot your ID or password?

Sign In

Sign in to see your account information saved articles and more.
  1. Recent Searches

  2. Saved Articles

    Sign in to see your account information saved articles and more.

Still Need Help?