AdSense and the Googlebot

by john on November 3, 2003

I finally decided to look into why I was getting duplicate searches from different IPs within my site search. Every time someone would search for something directly on my site within a few minutes another hit for the same search, but from a different IP, would occur. Via I was able to quickly determine that the second IP was always the Googlebot. At first I thought it was indexing the mt-search.cgi and by default Movable Type was referencing the previous query but looking at my logs I found that in fact it was calling the exact search.

How could that be? Simple – I had added the AdSense link to my search page template. Apparently the Googlebot goes out every time an AdSense ad is displayed. Since Google’s terms of service say you can’t include the AdSense code on a search results screen it was an easy decision to turn it off.

Speaking of AdSense and things Google doesn’t want me to tell you – I’ve had my best day to date today, just shy of #DELETED#. In one day. I recently received a check from Amazon for $12.50 which was for like a year or so.

One day. Damn.

[UPDATE – Via (found via my Google related articles link, you do use that, right?) I discovered that Google sends out the Googlebot only when the page isn’t in its index. Clearly that’s the reason Google doesn’t want you including the code on search results – they don’t want the Googlebots being over worked!]


Technically Speaking November 4, 2003 at 12:36 am

A Masterful observation

John has noticed a specific behavior in Adsense and the Googlebot. This could possibly be used to our advantage. I have only installed Adsense and it hasn’t really taken off for me, yet. So far, in 4 days, I have made just under $2. I’m intrigued to se…

Michael November 4, 2003 at 8:16 am

I saw your comment over at Technically Speaking. It appears that Google will cut a check after your earnings total $100, even if that takes a couple of months. I initially interpreted their payment policy the same way you did, but I’ve since been cut a check that proves I was wrong.

A #DELETED# day is great. My highest was about #DELETED#. I’d love to get the kid of money Matt’s getting at PVRBlog. And I’m glad to see that I’m not the only one who’s getting next to nothing from Amazon.

Money Talk March 27, 2004 at 12:01 pm

Makes some of the other affiliate programs seem like a waste of time, eh? Good idea to not discuss the earnings, don’t want to get in trouble for breaking the TOS!

john April 2, 2004 at 4:07 am

Previous post:

Next post: