Definition Day: Crawler

Definition DayA Crawler, or Web Crawler is a program that systematically browses the World Wide Web in order to create an index of data.