Welcome to the IMTalk - Internet Marketing & SEO Forum.
  • Login:
+ Reply to Thread
Results 1 to 6 of 6
  1. #1
    franberries's Avatar
    franberries is offline IM & SEO Chatty franberries has a spectacular aura about franberries has a spectacular aura about franberries has a spectacular aura about
    Join Date
    Oct 2010
    Location
    Class C IP
    Posts
    1,826
    Thanks Given
    173
    Thanked 206 Times in 163 Posts

    How to make changes in robot.txt

    How to make changes in robot.txt so as to make sure certain pages are disallowed to be index

  2. #2
    wink0r's Avatar
    wink0r is offline Moderator wink0r is a splendid one to behold wink0r is a splendid one to behold wink0r is a splendid one to behold wink0r is a splendid one to behold wink0r is a splendid one to behold wink0r is a splendid one to behold wink0r is a splendid one to behold
    Join Date
    Oct 2010
    Location
    East Coast, USA
    Posts
    2,183
    Thanks Given
    941
    Thanked 651 Times in 491 Posts
    Webmaster tools has a robots.txt generator at: crawler access>generate robots.txt tab.

  3. #3
    franberries's Avatar
    franberries is offline IM & SEO Chatty franberries has a spectacular aura about franberries has a spectacular aura about franberries has a spectacular aura about
    Join Date
    Oct 2010
    Location
    Class C IP
    Posts
    1,826
    Thanks Given
    173
    Thanked 206 Times in 163 Posts
    Quote Originally Posted by wink0r View Post
    Webmaster tools has a robots.txt generator at: crawler access>generate robots.txt tab.
    You mean google webmaster tools?? i still confusing how to change, but i'll give a try soon

  4. #4
    wink0r's Avatar
    wink0r is offline Moderator wink0r is a splendid one to behold wink0r is a splendid one to behold wink0r is a splendid one to behold wink0r is a splendid one to behold wink0r is a splendid one to behold wink0r is a splendid one to behold wink0r is a splendid one to behold
    Join Date
    Oct 2010
    Location
    East Coast, USA
    Posts
    2,183
    Thanks Given
    941
    Thanked 651 Times in 491 Posts
    Yes, Google Webmaster tools. The crawler access link is under Site Configuration. The page opens to test robots.txt and shows the content of your current robots.txt file if one is available. The next tab is generate robots.txt and provides a wizard driven interface. The results will show up in the box below so that you may copy them and paste into your robots.txt file or a notepad page that you will then save as robots.txt and upload to the root directory for your site. If you have a WP blog in a sub-folder you will need to move the robots.txt to the root directory.

  5. The Following 2 Users Say Thank You to wink0r For This Useful Post:


  6. #5
    idreesfarooq's Avatar
    idreesfarooq is offline IM & SEO Chatty idreesfarooq is a jewel in the rough idreesfarooq is a jewel in the rough idreesfarooq is a jewel in the rough idreesfarooq is a jewel in the rough
    Join Date
    Mar 2011
    Location
    Pakistan
    Posts
    1,315
    Thanks Given
    214
    Thanked 306 Times in 213 Posts
    Quote Originally Posted by wink0r View Post
    Yes, Google Webmaster tools. The crawler access link is under Site Configuration. The page opens to test robots.txt and shows the content of your current robots.txt file if one is available. The next tab is generate robots.txt and provides a wizard driven interface. The results will show up in the box below so that you may copy them and paste into your robots.txt file or a notepad page that you will then save as robots.txt and upload to the root directory for your site. If you have a WP blog in a sub-folder you will need to move the robots.txt to the root directory.

    New thing to me. I was also looking for some plugins but you have provided a simple way for this. Thanks, i am going to check it.

  7. #6
    wink0r's Avatar
    wink0r is offline Moderator wink0r is a splendid one to behold wink0r is a splendid one to behold wink0r is a splendid one to behold wink0r is a splendid one to behold wink0r is a splendid one to behold wink0r is a splendid one to behold wink0r is a splendid one to behold
    Join Date
    Oct 2010
    Location
    East Coast, USA
    Posts
    2,183
    Thanks Given
    941
    Thanked 651 Times in 491 Posts
    New thing to me.
    I had just noticed it shortly before franberries question. It may be a new feature, or one I had just overlooked in the past. There is a lot of depth to both Webmaster tools and Analytics, it is hard to keep track of all the features.


 

Similar Threads

  1. Replies: 6
    Last Post: 10-06-2011, 03:47 AM
  2. Need to make $50 in two days
    By jgessentials in forum Money Making Talk
    Replies: 10
    Last Post: 05-16-2011, 06:41 PM
  3. how to make money at PTC
    By aethak in forum Affiliate, CPC, CPA Programs
    Replies: 8
    Last Post: 04-29-2011, 07:11 AM
  4. Wp twin + wp robot + cpa ninja course = big profit
    By SuccessKit90 in forum IMT Main Marketplace
    Replies: 2
    Last Post: 03-02-2011, 10:33 AM
  5. SEO make better
    By ndarutantra in forum General SEO Talk
    Replies: 0
    Last Post: 08-31-2010, 04:51 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts