web crawler
nounDefinition of web crawler
: a computer program that automatically and systematically searches web pages for certain keywords Each search engine has its own proprietary computation (called an "algorithm") that ranks websites for each keyword or combination of keywords. These algorithms use Web crawlers … that collect data from your website to determine where it ranks with respect to search terms.— Julie Brinton
Keep scrolling for more
Comments on web crawler
What made you want to look up web crawler? Please tell us where you read or heard it (including the quote, if possible).
Test Your Vocabulary
Great Scrabble Words—A Quiz
-
- Which of the following Q-without-U words means the number five in cards or dice?
Test your visual vocabulary with our 10-question challenge!
TAKE THE QUIZ
Test Your Knowledge - and learn some interesting things along the way.
TAKE THE QUIZLove words? Need even more definitions?
Merriam-Webster unabridgedWords at Play
Ask the Editors
Word Games
-
Great Scrabble Words—A Quiz
Words to improve your Scrabble game
Take the quiz -
Which Came First? Quiz
Do you know which word is older?
Take the quiz -
Name That Thing
Test your visual vocabulary with our 10-question challenge!
Take the quiz -
SCRABBLE® Sprint
SCRABBLE® fans, sharpen your skills!
Play the game
Share web crawler
Resources for web crawler