Adsense: Site Diagnostics

Adsense has just introduced a site diagnostics tool. The diagnostics tool can be viewed under your reports tab and will show you if there is any problems accessing the pages of your site(s).

People using Sitemaps will be familiar with the interface and reporting style. If the Adsense crawler is having trouble reaching any of your pages, you'll see those URLs listed in the Blocked URLs section of the Site Diagnostics table.

You will either see a "URL not found" or "Robots.txt" error. In the first case it means that your server might have been temporarily down or that there was some other error accessing the page. The "Robots.txt" error signifies that your Robot.txt file is preventing the crawler from accessing pages.