Search Help:  
 
Enter keywords to search help.

If I use Delete URL, do I also need to use robots.txt?

Yes. When you've used Delete URL/Path to remove a URL from our index, we recommend using robots.txt to exclude the content from being added to our indexed again. Robots.txt excludes Yahoo!'s crawler (Yahoo! Slurp) from re-indexing your content. A robots.txt exclusion rule reduces the number of pages Yahoo! Slurp will read from your server. It also helps you save bandwidth on your website.

Note: Site Explorer Delete URL/Path service facilitates the quick removal of your URL from our index and is helpful when a URL that you have excluded, continues to show up as a thin document, but it may not prevent our crawler from continuing to crawl the URL again. It is not an alternative to using robots.txt.

Was this article helpful?

Yes   No
Click to contact Customer Care for further assistance.