variants:
or Web crawler
Definition of web crawler
: a computer program that automatically and systematically searches web pages for certain keywords
Each search engine has its own proprietary computation (called an "algorithm") that ranks websites for each keyword or combination of keywords. These algorithms use Web crawlers … that collect data from your website to determine where it ranks with respect to search terms.— Julie Brinton
Buying Guide
Our Reviews team has selected the best monitors.
Learn More About web crawler
Statistics for web crawler
Look-up Popularity
Cite this Entry
“Web crawler.” Merriam-Webster.com Dictionary, Merriam-Webster, https://www.merriam-webster.com/dictionary/web%20crawler. Accessed 9 Aug. 2022.
Style: MLA
MLA
Chicago
APA
Merriam-Webster
Chicago
APA
Merriam-Webster
Test Your Vocabulary
Odd Habits and Quirks
-
- Which of the following best describes an easily irritated person?
Test your visual vocabulary with our 10-question challenge!
TAKE THE QUIZ
A daily challenge for crossword fanatics.
TAKE THE QUIZLove words? Need even more definitions?
Merriam-Webster unabridged
Words at Play
Ask the Editors
Word Games
-
Name That Animal: Volume 2
Can you tell a meerkat from a wombat?
Take the quiz
-
Fashionable Words
A vocab quiz with panache
Take the quiz
-
Name That Thing
Test your visual vocabulary with our 10-question ...
Take the quiz
-
Spelling Bee Quiz
Can you outdo past winners of the National Spelli...
Take the quiz
Share web crawler
Time Traveler for web crawler
The first known use of web crawler was in 1994
See more words from the same year