Wednesday, 25 January 2012

Gotta love them gotta hate them...Google Bots

I have reentry opened a new shop on ETSY selling beads and jewelry supplies so I am as giddy as the day I opened my first etsy shop. I check it every few minutes to see if I have had any new views hearts or if anyone has added me to their circle.

After a few years of trying to sell my wares on the internet I have a little bit more knowledge about how it all works but I thought I would do a test all the same. After listing a new item tweeting it and face booking it you generally end up after about 10-15 mins with about 4-6 views. I would like to think that they are real people but I know they are bots.

So I listed an item and I resisted the urge to post it anywhere, I left it over night and when I checked it in the morning still not a single view...BOOOO, not even a bot!

So even though those first 3-4 views are not real people they  play a very important roll in the internet. They harvest information and index it for google and other search engines so that others may find us at a later date.

I found this article on google bots that will explain it much better than I ever could...damn those google bots.


Google Bots Types

google bot1. Google Bot: This is the bot used by Google to scour the web to identify new pages. It has two different versions. Deep bot and Fresh bot. As the name suggests, Deep bottries to follow every link and downloads as many pages as possible. It tries to read minute details of a site including the internal structure.
Fresh bot crawls the web in search of fresh content. The Fresh bot crawls the already indexed pages in search of newly updated content. This way Google tries to give fresh and updated information in the search results. Hence it is important to have quality inbound links if you’d like Fresh bot crawling your site more and more often.
2. Media Bot: If you are wondering how Google places different relevant ads in your different pages, here is the answer. Media bot analyzes AdSense pages and decides which ads to be placed on different pages.
So if you want to allow Media bot to access your entire site put this code in robot.txt file.
User-agent: Mediapartners-Google*
Remember that ads will still be shown in your pages even if Media bot has not visited your site yet. In such a case, ads will be chosen based on the overall theme of your site.
3. Image Bot: Image bot is used to crawl the images and place them in Google’s image search. Images are ranked based on their file name, alt text, surrounding text and page title.  If your website is primarily image based, then you’d definitely want to tweak and optimize your images to receive extra traffic from Google image search results.
However, all the Google traffic may not convert into buyers as many people are just looking for images. So if you want to block Image Bot from accessing your images and save bandwidth, you can do it in your robot.txt file.
4. Ads Bot: It crawls and analyzes the advertising landing pages and determines the quality score that will be assigned to your ads. Along with this score, Google uses your bid amount to determine the position of your ads. Hence it is important to have quality content on the landing page of your advertisement. Sometimes Google positions high quality ads first even when others are willing to pay more. It is advised to give AdsBot complete access to your site.
By now you must have understood that it is important to give complete access to Google if you want to increase your search engine visibility. One way is to create a sitemap for your site. A sitemap tells Google about your most important, new and updated pages. Google inturn tells you the pages it was unable to crawl. This helps you pinpoint the problems and fix them as soon as possible with which you can gain increased traffic and exposure from search engine results.
Google is ever-changing and Google spiders are becoming more advanced all the time. However, relevant, updated and quality content along with good inbound links make your site stand front in this every changing search engine world.

13 comments:

IsabellesAttic said...

intresting! Don't worry I'm sure before you know it your store will be booming!

Sewinggranny - Mona said...

Wow...interesting but now sure how I can use that info...lol.. I am lucky to get an item stumbled or tweeted.

Sewinggranny - Mona said...

Interesting information but sorry I am not computer literate to follow it....lol...lucky I can stumble my items.

Susie Tenzer said...

good info, next time can you expand on site map info?

Mt. Baldy Glassworks said...

This was all so interesting ... but ...how does one do his stuff. I do not know how to put things in the places you suggested! LOL

BillGuestPhoto said...

Wow I never knew about all those bots! the internet is amazing! good luck with the new shop I am sure it will do well!

Romantic.Treasures said...

Interesting info. Still don't really understand how it all works, but at least you planted some seeds. I may have to research it further and consider adding ads to my blog.

Romantic.Treasures said...

I'll try again and see if my comment sticks. the info is interesting... but I am not quite sure how to use it

saraelynch said...

WHOA! I had no idea! Thank you, this was really interesting.

Ruth said...

Very good information ! Wish I knew what to do with it :\

* said...

uniquecozytreasures- WOW! Thanks for explaining all of that information.

petite hermine said...

Oooo, this is really good stuff! Thanks for the lesson, I needed it!

nangatesdesigns said...

I had no idea there were so many bots!!! Very interesting information. Thanks for sharing.