Thinking About Thinking

Google’s Spidering Rate Is 3000 Times Faster Than Bing In The First Month

Posted in Founder-Owned Businesses, Pop Culture, Technology by larrycheng on September 7, 2011

This is only one data point but I thought it was interesting.  About a month ago, my wife launched a website called Activity Yard.  It’s a website community where parents rate and review activities for their kids.  The URL was submitted to Google and Bing on the same day in August.  Out of sheer curiosity, I started to check the rate at which the two search engines spidered the site.  Fast forward about 4 weeks, and the results are interesting – Google spidered 3,000 times more pages than Bing.

You can see in this image – Google has spidered “about 12,000” pages on a site search of Activity Yard.

Now, here’s Bing’s result taken on exactly the same day (today).  It only registers “4 results” for the same site search of Activity Yard.  It would have almost been better if Bing’s result was at 0.  Again, only one data point, but if this data point is directionally correct – Bing’s not even in the same galaxy as Google when it comes to spidering pace.

8 Responses

Subscribe to comments with RSS.

  1. Alex said, on September 16, 2011 at 1:25 am

    What you have shown us is how many pages the search engine returns when you ask the search engine about a particular site. All I see is four links which might be considered more “connected” on your site returned by Bing, while Google vomits up the entire site. Bing is actually more useful in this instance, since the articles it returns consume less of your attention.

    This has nothing to do with “spidering rate”.

    To determine “spidering rate” you will need to examine the logs of the site and determine how quickly each search engine has trawled the pages on your site.

    Google seems to return better results for “soccer site:activity” for example, listing out each individual entry at the bottoms of the category trees. Bing seems to be confused. Quality of results is not related to spidering rate either.

  2. nope said, on September 16, 2011 at 2:37 am

    Kindly retract this tripe. You have no idea what you are talking about. Moreover, your blarticle is riddles with errors. And, your conclusions are idiotic. Catch a clue, will you?

  3. Pilot Shop said, on September 29, 2011 at 9:34 am

    I don’t know if your example really identifies crawl rates. I will say Google tends to find my pages a lot faster. About 1 – 2 days, but it might simply be that my page rankings are better on google rather than Bing.

  4. aminpan said, on March 6, 2012 at 2:03 am

    very good tnx

  5. fgcosoft said, on March 6, 2012 at 2:20 am

    How quickly it index my site

  6. hi tnx
    How quickly very fast it index my site?

  7. دانلود said, on March 6, 2012 at 6:19 am

    quickly very fast index content of site you must sumbit sitemap to Google Webmaster:)
    tank you for

  8. نرم افزار اس ام اس said, on March 20, 2012 at 9:00 am

    very good

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s


Get every new post delivered to your Inbox.

Join 119 other followers

%d bloggers like this: