Is the Robots.txt is useful for Search Engine Optimization

Roborts.txt it is the file with the help of you save your data with is available on your site, when you make your site there is many type of content and codes for your website which is help for running on web but the some content or codes are not for publically essential this is for only internet purpose that why search engine crawl the site by the help of link of website, this is the seo expert strategies in this we use the robort.txt file this is use with a some code, this is file for protection and safety to our site ,when we define in this code to not crawl to search engine but those file are important for our site and user not access to the information , here is show the syntax of robots. Txt file, in this code firstly we show the user agent, user agent means related search engine spiders or crawler.
User-agent:
Disallow:

The spider is search a link to available on your website and then show for users when crawler attend the robots file they drop the result and going to next link , where as disallow refers to content that should not be exposed to the users . For make a optimum site and the best perform on search engine, we use many tools and techniques here the robots .txt is very important on the site that you have found these web pages, all the web pages are connected to exte
al link, his ranking, some keywords are very important to our site, and then we see the pages which is related to our keyword and our query the methods of redirection and link is connected which is show the more traffic on our site. This is useful, if the Web page that you want to convert, the save for safety of your site. Sometimes the companies don’t want the spider or search engines to index data that is present on their websites. This is the general code;
User-agent: *
Disallow: /temp/

So it is essential to safety of our web pages, this is not provide real time safety, this is for user that they not to log on and use the admin information. however the user might or might not try to get access to the information so very sensitive information should not be kept on websites, so also the prevent of some information for users that is done by search engine there search methods of crawler it is only a another important things is the location of the Robots.txt because Google don’t search through whole of the website for presence of Robots.txt.
For fast crawling and the fast result show or any other reason to block the some information many companies not inform the search engines there important part to avoid and make use of robot meta tags or Robots.txt file Robot, so mostly Robots.txt file format is used the coding is simple it is a never ending list of user agents and disallowed files and directories.