Google provides two new Googlebot crawlers: GoogleOther-Picture and GoogleOther-Video

Google has added two new crawlers to the Googlebot household of internet crawlers:

  • GoogleOther-Picture
  • GoogleOther-Video

Google mentioned these two new crawlers are variations of GoogleOther optimized for fetching picture and video bytes. GoogleOther was added in April 2023 for use internally by Google groups to crawl the general public internet and unencumber some assets for the principle Googlebot crawlers.

GoogleOther-Picture. GoogleOther-Picture, in response to the documentation, is the model of GoogleOther optimized for fetching publicly accessible picture URLs. It would go below the consumer agent tokens of GoogleOther-Picture and GoogleOther and the total consumer agent string will likely be GoogleOther-Picture/1.0.

GoogleOther-Video. GoogleOther-Video, in response to the documentation, is the model of GoogleOther optimized for fetching publicly accessible video URLs. It would go below the consumer agent tokens of GoogleOther-Video and GoogleOther and the total consumer agent string will likely be GoogleOther-Video/1.0.

Why these new crawlers. Google said, “the brand new crawlers had been launched to higher assist crawling of binary information which may be used for analysis and improvement.”

Extra on Google crawlers. The sorts of Googlebot crawlers embody:

  • Googlebot – The principle crawler for Google’s search merchandise. Google says this crawler all the time respects robots.txt guidelines.
  • Particular-case crawlers – Crawlers that carry out particular capabilities (equivalent to AdsBot), which can or might not respect robots.txt guidelines.
  • Consumer-triggered fetchers – Instruments and product capabilities the place the end-user triggers a fetch. For instance, Google Web site Verifier acts on the request of a consumer or some Google Search Console instruments will ship Google to fetch the web page based mostly on an motion a consumer takes.

Google additionally has listed IP tackle ranges and reverse DNS masks for every sort:

Why we care. Lots of you verify your crawling actions and bot exercise in your web site and in your log information. Once you see this new GoogleOther crawlers, don’t be alarmed. It’s a actual Googlebot.


New on Search Engine Land

In regards to the creator

Barry SchwartzBarry Schwartz

Barry Schwartz is a Contributing Editor to Search Engine Land and a member of the programming crew for SMX occasions. He owns RustyBrick, a NY based mostly internet consulting agency. He additionally runs Search Engine Roundtable, a well-liked search weblog on very superior SEM matters. Barry will be adopted on Twitter here.