web crawler

noun
variants: or Web crawler

Definition of web crawler

: a computer program that automatically and systematically searches web pages for certain keywords Each search engine has its own proprietary computation (called an "algorithm") that ranks websites for each keyword or combination of keywords. These algorithms use Web crawlers … that collect data from your website to determine where it ranks with respect to search terms.— Julie Brinton

First Known Use of web crawler

1994, in the meaning defined above

Keep scrolling for more

Learn More About web crawler

Time Traveler for web crawler

Time Traveler

The first known use of web crawler was in 1994

See more words from the same year

Dictionary Entries Near web crawler

webby

webcam

webcast

web crawler

webelos

weber

Weber

See More Nearby Entries 

Statistics for web crawler

Cite this Entry

“Web crawler.” Merriam-Webster.com Dictionary, Merriam-Webster, https://www.merriam-webster.com/dictionary/web%20crawler. Accessed 25 Jun. 2021.

Style: MLA
MLACheck Mark Icon ChicagoCheck Mark Icon APACheck Mark Icon Merriam-WebsterCheck Mark Icon

WORD OF THE DAY

Test Your Vocabulary

Return of Name that Color!

  • a light greenish blue color
  • Name that color:
Spell It

Can you spell these 10 commonly misspelled words?

TAKE THE QUIZ
 AlphaBear 2

Spell words. Make bears.

TAKE THE QUIZ
Love words? Need even more definitions?

Subscribe to America's largest dictionary and get thousands more definitions and advanced search—ad free!