WordPress Security Tips - Robots.txt and WordPress
(Page 3 of 5 )
WordPress files (not your post) are indexable by default. The primary reason is that the default WordPress installation has links pointing to it. For example, there are links pointing to your login page.
Is this a serious problem? Yes, because it will expose your admin page to the public, ready to be hacked. Try doing an advanced search in Google and place "wp-login.php" in the exact match found in the URL; you will be surprised how many blogs on the Internet are afflicted with this problem.
Robots.txt provides a solution for this. This will keep your admin files from showing up in Google search engine results. I know there are millions of blogs on the Internet, but using robots.txt to prevent search engines from crawling admin pages decreases the risk of hacking. This will ensure that no one can search your login page intentionally from the search engine results; hackers commonly use this method to find blogs to abuse.
The solution is simple, if you have full ftp access to your site:
Open your notepad.
Copy and paste the syntax below:
User-agent: *
Disallow: /wp-
Upload the file to the root directory of your website.
The syntax will prevent the Googlebot or other search engines following the robots exclusion protocol from crawling your WordPress files.
Next: Unsecured WordPress Login Page >>
More Blog Help Articles
More By Codex-M