Google Indexing Unlinked Pages?

In October, a WebmasterWorld member has been monitoring his website and has noticed that Google is beginning to index pages that seem unlinked from anywhere. He suspects that either Google is using Toolbar data, someone is linking to these pages deliberately, or he may have caused the pages to be linked somehow (but he's pretty sure that's not the case).

Others notice similar "creative" spidering, and as Tedster puts it, "googlebot [is] trying to eat almost anything that might be edible in even the least way."

After investigating further, this is what appears to be happening, according to the member who discovered the issue:

- Googlebot is spidering GET forms by getting the form variables and either leaving them blank or assigning values to them (sometimes taken from options in the form itself) - Google has a list of words present on the site - This list of words is being used to populate the form variables, and the URL requested via GET

It seems that it's now February and the same member found similar strange activity within Google. The site has over 519,000 spider requests from Google since the end of October. He believes that Googlebot is adding the GET data by itself, either by accident or to discover new content. What do you think it is?

Forum discussion continues at WebmasterWorld.

Like The Story? Vote For It On Yahoo Buzz! Or On Sphinn!

posted Tamar Weinberg in Google Optimization at February 19, 2008 9:26 AM Comments (10)

Comments

I created a blog for my website and it was liked nowhere from the website, but after a weeks time, the blog got indexed in Google :) with some good rankings.

How is that possible?

Pratheep

Posted by Pratheep at February 20, 2008 02:46

I uploaded a new website and sent a link to myself in my gmail account. The site was indexed and appeared on a search within a few days. I didn't post the link in my articles or press releases or promote the site in anyway.

Joy~

Jeanette

Posted by Jeanette at February 20, 2008 03:29

Wordpress blogs are normally indexed even without external links. However I also noticed that there are lots of internal links that probably lead to an already indexed website.

Posted by John at February 20, 2008 04:23

Already seen this, A website published, never linked from any website and visible in Google results. I never submitted the website on any search engine, never added link on any website, nor added adwords on web pages of the website.
I didn't found from where Google came in.

Posted by Phil at February 20, 2008 07:43

Folks check your blog's pings. Also think of crawled referrer stats and stuff like that.

Posted by Sebastian at February 20, 2008 08:52

blog engine like wordpress and blogspot will automatic "ping" your new post , it is another form of submit your post (new page) to blog engines, then google spider will crawl these engines and find your blogs.

Posted by James at February 20, 2008 11:11

I have a couple of sites that had their stats pages indexed, and no links to those pages are to be found.

Posted by Jon at February 20, 2008 11:21

No reciprocal from the stats host? I'm thinking maybe a link was followed from there.

Posted by Bill Kruse at February 20, 2008 13:44

Posted by No Name at February 22, 2008 02:58

Wordpress blogs normally ping at least something when posting, don't they? So no wonder about blogs getting indexed

Posted by IrishWonder at February 22, 2008 18:28