Multiple times each day, Google recomputes the relative ranking of the world's Web sites. And it must index several billion new Web pages added daily. Stephen Shankland worked at CNET from 1998 to ...

Google turned its Web-crawling technology loose to hunt down malware-serving pages and found 3 million, meaning about one out of every 1,000 pages is malicious The Web is scarier than most people ...

Web users make a billion visits every month to websites of dubious character, according to a survey enabled by “web crawling” software developed by a US company. The survey, carried out over the last ...