robots.txt file

how to use robots.txt file, please share some valuable tips ?

take a look to this website: Robots.txt Tutorial

please take a look to this website and learn how to use robots txt file freefind.com/library/howto/robots/.

robots.txt is file which is added to serve which helps the google to read all posts from website. robot.txt not only allow to read but help in dis-allow the post or selected post in website.