Web crawler

noun
variants: or

web crawler

Definition of Web crawler

  1. :  a computer program that automatically and systematically searches Web pages for certain keywords Each search engine has its own proprietary computation (called an “algorithm”) that ranks websites for each keyword or combination of keywords. These algorithms use Web crawlers … that collect data from your website to determine where it ranks with respect to search terms. — Julie Brinton

First Known Use of web crawler

1994


Seen and Heard

What made you want to look up Web crawler? Please tell us where you read or heard it (including the quote, if possible).

Love words? Need even more definitions?

Subscribe to America's largest dictionary and get thousands more definitions and advanced search—ad free!

WORD OF THE DAY

conspicuously offensive

Get Word of the Day daily email!

Love words? Need even more definitions?

Subscribe to America's largest dictionary and get thousands more definitions and advanced search—ad free!