web crawler

noun

variants: or Web crawler

Definition of web crawler

: a computer program that automatically and systematically searches web pages for certain keywords Each search engine has its own proprietary computation (called an "algorithm") that ranks websites for each keyword or combination of keywords. These algorithms use Web crawlers … that collect data from your website to determine where it ranks with respect to search terms.— Julie Brinton

Keep scrolling for more

Learn More about web crawler

Dictionary Entries near web crawler

Statistics for web crawler

Look-up Popularity

Time Traveler for web crawler

The first known use of web crawler was in 1994

See more words from the same year

Comments on web crawler

What made you want to look up web crawler? Please tell us where you read or heard it (including the quote, if possible).

WORD OF THE DAY

epitome

a typical or ideal example

Test Your Vocabulary

Find the Cousins

Which pair shares a common word ancestor?

How Strong Is Your Vocabulary?

Test your vocabulary with our 10-question quiz!

TAKE THE QUIZ

SCRABBLE® Sprint

Test Your Knowledge - and learn some interesting things along the way.

TAKE THE QUIZ

Words at Play

Ask the Editors

Word Games