Google feeds its search engine’s index with site data from a virtual army of “bots"—Web-crawling applications that scour sites for content. But in the past, Google’s bots hit a wall when they ran into ...