Google’s Gary Illye announced that Google had added a new crawler called GoogleOther to alleviate strain from GoogleBot. GoogleOther is a new crawler to optimize GoogleBot.GoogleOther will be similar in infrastructure to Google Bot, lifting some R&D strain off GoogleBot.
It will ensure that GoogleBot works better towards improving the search index only.
Let us look into what GoogleOther is and how it will affect SEO and websites.
Contents
What Is A Web Crawler? What Is GoogleOther?
A web crawler sometimes called a spider or spider bot, indexes Web Searches. Web crawlers scan websites, access publicly accessible data, and index websites according to SEO rules.
GoogleBot is a web crawler whose primary function is indexing the search results. GoogleOther, the new crawler, will help GoogleBot perform better by lifting unnecessary strain on GoogleBot. Thus the introduced new crawler to Optimize Googlebot.
GoogleBot vs GoogleOther
GoogleOther uses the same infrastructure and technologies as used by GoogleBot. Thus, both will have the same host load limitations, robots.txt, HTTP protocol version, and fetch size. Therefore, the texts pre-written on web pages will have few website impacts or SEO troubles.
So, the only differences between the two are that of the functions they perform. Additionally, it will also use a different user agent token. GoogleBot will focus on search indexing, and GoogleBot’s main task will be to improve Search Indexing.
GoogleOther will focus on the non-essential tasks that GoogleBot carried out earlier. Likewise, these tasks will mainly include research and development (R&D) tasks unrelated to search indexing. Thus, this will help GoogleBot function better.
Changes In SEO And Website Content And Settings
The new crawler, GoogleOther, will hardly affect SEO and website setting and content, and it is because GoogleOther will use the same infrastructure as GoogleBot.
GoogleOther will also use the same IP ranges as GoogleBot.
What To Do To Understand GoogleOther Better?
You can monitor GoogleOther’s functioning and crawling activities on your website by the following steps:
- Analyze server logs: You can keep track of your server log and check the activities to notice how many times GoogleOther has visited your website and then improve your SEO accordingly. You can also see how many times it has crawled into other websites.
- Update robots.txt: You can update your robots.txt to change the number of times GoogleOther crawls into your website. Make sure to make it fall under the rules of the web crawler.
- Monitor crawling statistics: You can use Google Search Console to check the statistics of the web crawler. You can see the requests it makes to your website and make changes accordingly. You can even block the web crawler, although we do not see a reason that supports the need for it.
- Track website performance: regularly monitor your website’s engagement rates and visits to check if the crawling activities of GoogleOther affect your website in any way. It may help you to block or change the number of times GoogleOther crawls into your website.
Thus, GoogleOther is simply an additional web crawler introduced to lift the strain from GoogleBot. Therefore, this will help GoogleBot function better and perform search indexing in better ways.
See Also: Google Debut search technology in video search