web crawler


variants or Web crawler
: a computer program that automatically and systematically searches web pages for certain keywords
Each search engine has its own proprietary computation (called an "algorithm") that ranks websites for each keyword or combination of keywords. These algorithms use Web crawlers … that collect data from your website to determine where it ranks with respect to search terms.Julie Brinton

Word History

First Known Use

1994, in the meaning defined above

Time Traveler
The first known use of web crawler was in 1994

Dictionary Entries Near web crawler

Cite this Entry

“Web crawler.” Merriam-Webster.com Dictionary, Merriam-Webster, https://www.merriam-webster.com/dictionary/web%20crawler. Accessed 20 May. 2024.

Love words? Need even more definitions?

Subscribe to America's largest dictionary and get thousands more definitions and advanced search—ad free!