Google Mobile Test Fail Because Blocking Or Cloaking GoogleBot

Nov 26, 2014 - 8:19 am 3 by

The other day, Google launched the mobile testing tool and since then, Google has found two common repetitive trends when webmasters are claiming the tool does not work right.

Google's John Mueller wrote on Google+ that typically when the tool gives back an error saying your page is not mobile friendly, and you know it is indeed mobile friendly, is when you are (a) blocking GoogleBot from specific resources or (b) cloaking GoogleBot. In both cases, even if your site is mobile friendly, since GoogleBot doesn't know, it will mark it as not mobile friendly.

John wrote more detail on Google+ to explain:

1. Too much blocked by robots.txt. Googlebot needs to be able to recognize the mobile-friendliness through crawling. If a JavaScript file that does a redirect is blocked, if a CSS file that's necessary for the mobile version of the page is blocked, or if you use separate URLs and block those, then Googlebot won't be able to see your mobile site. The Mobile-Friendly Test will hint at this, the Fetch and Render tool in Webmaster Tools will give you details. The PageSpeed Insights tool doesn't use the robots.txt, so it may look normal there. Don't disallow crawling of your site's CSS or JS files!

2. Cloaking to Googlebot. Cloaking has been in our Webmaster Guidelines for a long time, it causes all kinds of problems. Some sites try to recognize Googlebot by looking for "Googlebot" in the user-agent, and will then serve it a "Googlebot-version" of the page (which is often the desktop page). If Googlebot-smartphone crawls and sees the desktop page, the page won't be seen as being mobile-friendy. Fetch and Render in Webmaster Tools can help you recognize this. The PageSpeed Insights tool doesn't use the Googlebot user-agent. Don't cloak!

This is Google once again, asking you nicely, to stop blocking GoogleBot from crawling your CSS and JavaScript files.

GoogleBot Confused

Forum discussion at Google+.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Google Core Update Flux, AdSense Ad Intent, California Link Tax & More - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Google Updates

Google March Core Update Still Rolling Out & Heated SEO Chatter Continue

Apr 25, 2024 - 7:51 am
Google

Report: How Prabhakar Raghavan Killed Google Search

Apr 25, 2024 - 7:41 am
Google Search Engine Optimization

Google Favicon Documentation Adds Rel Attribute Value Definitions

Apr 25, 2024 - 7:31 am
Google Ads

Google Ads API Version 16.1 Now Available

Apr 25, 2024 - 7:21 am
Google Search Engine Optimization

Google: Splitting & Merging Sites Takes Longer Than Normal Site Migrations

Apr 25, 2024 - 7:11 am
Search Forum Recap

Daily Search Forum Recap: April 24, 2024

Apr 24, 2024 - 4:00 pm
Previous Story: When Obama & I Became King Of The United States For The Day