Hello friends,
I want to know what is web crawler and how it works?
Printable View
Hello friends,
I want to know what is web crawler and how it works?
A Web Crawler (also known as a search engine spider, searchbot, robot) is a program which is used by search engine to find what is new on Internet(website). This process is called Crawling.
Web Crawler makes a beginning by crawling the pages of websites. Then it indexed the words and contents found on that website. And then it visits the links available on that website.
Thanks for your reply mate. I am much glad to know about the defination of web crawler.Quote:
Originally Posted by jasonhalle
Every thing starts with just a search search results will based from crawling. see google crawling and indexing https://www.google.com/insidesearch/...-indexing.html
The webcrawler is nothing but spiders,bots, it crawl your all website information for proper indexing then only your website show the search engines
Web spider is also called web crawler . it is software by search engine for crawling and indexing website to their database.
web crawler is also called as web spider. it will analyse your website completely and also compare your website with other website, which results indexing your website.
web crawler: google bot is google search engine crawler, which is index the website and keep the data in the data base