Wikidata

(Q45842)

English

web crawler

internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing (web spidering)

  • ant
  • automatic indexer
  • web spider
  • web scutter
  • web crawlers
  • spider
  • search engine spider
In more languages

Statements

subclass of
Internet bot
0 references
has use
web scraping
0 references
image
Robots(dot)txt.png
458 × 443; 17 KB
0 references

Identifiers

TDKIV term ID
000000655
0 references
Techopedia ID
10008
0 references
WordNet 3.1 Synset ID
06591891-n
1 reference
stated in
GF WordNet
 
edit
edit
    edit
      edit
        edit
          edit
            edit
              edit
                edit
                  Retrieved from "https://www.wikidata.org/w/index.php?title=Q45842&oldid=2125473518"