Welcome to the IMTalk - Internet Marketing & SEO Forum.
  • Login:
+ Reply to Thread
Results 1 to 9 of 9
  1. #1
    Digitalpursuit is offline IM & SEO Whisperer Digitalpursuit is on a distinguished road
    Join Date
    Dec 2016
    Posts
    26
    Thanks Given
    5
    Thanked 2 Times in 2 Posts

    Lightbulb What is Web Crawler?

    Hello friends,

    I want to know what is web crawler and how it works?

  2. #2
    wink0r's Avatar
    wink0r is offline Moderator wink0r is a splendid one to behold wink0r is a splendid one to behold wink0r is a splendid one to behold wink0r is a splendid one to behold wink0r is a splendid one to behold wink0r is a splendid one to behold wink0r is a splendid one to behold
    Join Date
    Oct 2010
    Location
    East Coast, USA
    Posts
    2,183
    Thanks Given
    941
    Thanked 651 Times in 491 Posts

  3. #3
    jasonhalle is offline IM & SEO Whisperer jasonhalle is on a distinguished road
    Join Date
    Jun 2016
    Location
    India
    Posts
    81
    Thanks Given
    4
    Thanked 1 Time in 1 Post
    A Web Crawler (also known as a search engine spider, searchbot, robot) is a program which is used by search engine to find what is new on Internet(website). This process is called Crawling.

    Web Crawler makes a beginning by crawling the pages of websites. Then it indexed the words and contents found on that website. And then it visits the links available on that website.

  4. #4
    Fungiso99 is offline IM & SEO Whisperer Fungiso99 is on a distinguished road
    Join Date
    Mar 2017
    Posts
    25
    Thanks Given
    1
    Thanked 0 Times in 0 Posts
    Quote Originally Posted by jasonhalle View Post
    A Web Crawler (also known as a search engine spider, searchbot, robot) is a program which is used by search engine to find what is new on Internet(website). This process is called Crawling.

    Web Crawler makes a beginning by crawling the pages of websites. Then it indexed the words and contents found on that website. And then it visits the links available on that website.
    Thanks for your reply mate. I am much glad to know about the defination of web crawler.

  5. #5
    rameshrath is offline IM & SEO Whisperer rameshrath is on a distinguished road
    Join Date
    Sep 2016
    Posts
    45
    Thanks Given
    0
    Thanked 2 Times in 2 Posts
    Every thing starts with just a search search results will based from crawling. see google crawling and indexing https://www.google.com/insidesearch/...-indexing.html

  6. #6
    arunpandi is offline IM & SEO Quiet One arunpandi is on a distinguished road
    Join Date
    Apr 2017
    Posts
    12
    Thanks Given
    0
    Thanked 0 Times in 0 Posts
    The webcrawler is nothing but spiders,bots, it crawl your all website information for proper indexing then only your website show the search engines

  7. #7
    jackar56 is offline IM & SEO Weak Jaw jackar56 is on a distinguished road
    Join Date
    Sep 2016
    Posts
    103
    Thanks Given
    1
    Thanked 0 Times in 0 Posts
    Web spider is also called web crawler . it is software by search engine for crawling and indexing website to their database.

  8. #8
    webee is offline IM & SEO Whisperer webee is on a distinguished road
    Join Date
    Jan 2016
    Posts
    80
    Thanks Given
    2
    Thanked 3 Times in 3 Posts
    web crawler is also called as web spider. it will analyse your website completely and also compare your website with other website, which results indexing your website.

  9. #9
    manchun is offline IM & SEO Weak Jaw manchun is on a distinguished road
    Join Date
    May 2016
    Posts
    100
    Thanks Given
    0
    Thanked 1 Time in 1 Post
    web crawler: google bot is google search engine crawler, which is index the website and keep the data in the data base


 

Similar Threads

  1. Replies: 2
    Last Post: 06-23-2011, 12:26 PM
  2. Replies: 7
    Last Post: 04-20-2011, 07:59 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts