SINCE 1828
web crawler
noun
variants:
or Web crawler
Definition of web crawler
: a computer program that automatically and systematically searches web pages for certain keywords
Each search engine has its own proprietary computation (called an "algorithm") that ranks websites for each keyword or combination of keywords. These algorithms use Web crawlers … that collect data from your website to determine where it ranks with respect to search terms.— Julie Brinton
Keep scrolling for more
Comments on web crawler
What made you want to look up web crawler? Please tell us where you read or heard it (including the quote, if possible).
Test Your Vocabulary
Farm Idioms Quiz
-
- What does 'poke' refer to in the expression 'pig in a poke'?
Can you spell these 10 commonly misspelled words?
TAKE THE QUIZ
Test Your Knowledge - and learn some interesting things along the way.
TAKE THE QUIZLove words? Need even more definitions?
Merriam-Webster unabridged
Words at Play
Ask the Editors
Word Games
-
Farm Idioms Quiz
Not your children's farm quiz.
Take the quiz -
Up in the Sky: A Quiz
It's a bird? It's a plane? No, I'm really asking. What is it?
Take the quiz -
Spell It
Can you spell these 10 commonly misspelled words?
Take the quiz -
Dictionary Devil
The dictionary has been scrambled—can you put it back together?
Play the game
Share web crawler
Resources for web crawler