SINCE 1828
web crawler
noun
variants:
or Web crawler
Definition of web crawler
: a computer program that automatically and systematically searches web pages for certain keywords
Each search engine has its own proprietary computation (called an "algorithm") that ranks websites for each keyword or combination of keywords. These algorithms use Web crawlers … that collect data from your website to determine where it ranks with respect to search terms.— Julie Brinton
Keep scrolling for more
Comments on web crawler
What made you want to look up web crawler? Please tell us where you read or heard it (including the quote, if possible).
Test Your Vocabulary
Original Meanings Quiz
-
- Which of the following is the earliest known sense of the word awe?
Can you spell these 10 commonly misspelled words?
TAKE THE QUIZ
Test Your Knowledge - and learn some interesting things along the way.
TAKE THE QUIZLove words? Need even more definitions?
Merriam-Webster unabridgedWords at Play
Ask the Editors
Word Games
-
Original Meanings Quiz
A quiz for the pedantic and those annoyed by them!
Take the quiz -
A Green Quiz
How many questions can you answer about the word "green"?
Take the quiz -
Spell It
Can you spell these 10 commonly misspelled words?
Take the quiz -
SCRABBLE® Sprint
SCRABBLE® fans, sharpen your skills!
Play the game
Share web crawler
Resources for web crawler