A website not ranking higher, even on optimizing the content? You are sure about your website obtaining a higher rank but still not deserving it. The problem might be in the website crawling as google had a crawling issue that impacted many sites.
So, let us first know what is crawling. Crawling is a process in which different search engines use different bots to collect parameters of the website pages.
See also: Data Seemingly Proves Googlebot Crawling has Slowed
After collecting the data, the search engines include the pages in the search index. That is, the users can now find the pages. So for your page to find access, you need to ensure that the search bots see your pages. One should also ensure that the search bots obtain a permit and read them.
Google Had a Crawling Issue That Impacted Many Sites. Google confirmed that crawling for some of the AMP caches had slowed down for some of the sites. Curious about what happened and when did it happen? Stay tuned and read the article for unlocking the answers.
This issue happened within the time span of 11th November and 17th November, when the google bot slowed down crawling on certain websites. What happened? A bug prevented Google from crawling for the AMP cache.
Contents
Who first noticed the crawling issue?
Oliver Papon first noticed this entire issue from Seolyzer. He analyzed the problem and said that he had seen Google bot, the web crawler of Google, has entirely stopped crawling a large part of the web. This started at 6 PM on 11th November and was resolved at 8 PM on 17th November.
What did he notice? He noticed several sites were showing a decline in crawling in the crawl status report of Google Search Control. Although, Oliver Papon has also mentioned that it did not affect or impact most of the sites in the Search Control that he has verified access to.
What was the issue all about?
The issue was mainly based on a bug that prevented Google from crawling the AMP cache. The process of crawling had severely slowed down for some sites, and it seemed that the issue had only impacted a few numbers of crawling caches for specific sites.
Can you guess what the news that was a relief was? Google was able to resolve the bug that prevented crawling. Above all, an internal analysis showed that the issue was not widespread, and overall, there were no negative effects.
How are we aware of ourselves?
If we notice any of the following, we need to understand that a problem related to crawling has arisen. Now the issues are:
- There can be a problem with the indexing part of the new pages.
- There can also be a problem with the old and updated pages not being able to reflect the changes that have been made.
See also: IndexNow is a Major Change to Search Engine Indexing
Conclusion
Problems always come with solutions. Crawling is a very common issue in this technological age, where everything is done online. Google also faces the problem but it’s a blessing that a resolution happens within 6-7 days.