Jargon Defined: Crawler

A Crawler, or Web Crawler is a program that systematically browses the World Wide Web in order to create an index of data.