Yahoo!
My Yahoo!
Mail
Yahoo! Search
Search the Web
Yahoo! Search Home
-
Help
Go Back to Yahoo! Search
Yahoo! Search
>
Search
>
Search
Yahoo! Slurp—Yahoo!'s Web Crawler
Why are you crawling my site?
How do I prevent my site or certain subdirectories from being crawled?
How does the Yahoo! Web Crawler handle redirects?
How can I reduce the number of requests you make on my web site?
How do I prevent you from indexing certain pages?
How do I allow you to index pages, but not place them in your cache?
Why am I seeing repeated download requests?
Why is your crawler asking for strange URLs that have never existed on my site?
Why can't I find my web pages in your search engine?
How does your crawler find documents on my site?
Does your crawler follow dynamic links?
Top Questions
Search Tips
What are the different sections on the Search results page?
How do I keep my page from being cached in Yahoo! Search?
What is Yahoo's Safe Search?
Intro to Yahoo! Search
More Help Links
Sign-in and Registration Help
Marketing Preferences Help
Account Security
Privacy Policy
Make Yahoo! Your Home Page
Yahoo! Directory Help
Copyright © 2008 Yahoo Web Services India Pvt Ltd
Privacy Policy
-
Terms of Service