The difference between Bing and Google's crawlers causes me physical pain.
As part of a team that runs several large sites, the performance difference between them is stunning, but not any any way complimentary to Bing. We want Bing to do better. We want them to challenges Google pole position.
Bingbot will crawl the exact same set pages 10 times in a week, and will make hundreds of requests per minute doing so. Googlebot will crawl them once, at a much more reasonable pace.
The bandwidth and power costs we incur from Bing crawlers are a hundredfold (at least) what we incur from Googlebot.
Please, Microsoft, make Bingbots not suck so badly.
As part of a team that runs several large sites, the performance difference between them is stunning, but not any any way complimentary to Bing. We want Bing to do better. We want them to challenges Google pole position.
Bingbot will crawl the exact same set pages 10 times in a week, and will make hundreds of requests per minute doing so. Googlebot will crawl them once, at a much more reasonable pace.
The bandwidth and power costs we incur from Bing crawlers are a hundredfold (at least) what we incur from Googlebot.
Please, Microsoft, make Bingbots not suck so badly.