How to remove crawl error

1. CRAWL ERROR

2. What is Crawl Error Crawl error are those error in which page not found problem occur. When you encounter crawl errors, your website can be obstruct from appearing in a search results page, even when your target audience has performed the ideal search query. The crawl error report comes about and gives details of the website's URLs that Google is not able to successfully crawl, or those that returned with an HTTP error code

3. How to remove crawl error There is no hard and fast rule, the methods vary from one webmaster to another. Here we are providing some ways to remove crawl error: • Find The Sources Which Are Causing 404 Not Found Errors • Fixing Broken Links From Spam Comments •  Remove the Already Crawled URL’s from Google Webmaster Tools

4. Find The Sources Which Are Causing 404 Not Found Errors • The initial step is to find the source of the “Not found” links. Page not found exception can occur from various reason such as : Problem 1: When an external site is linking to a Non Existent 404 page of your site solution :  Install the Redirection Plugin and 301 redirect that bad link to the correct link yourself.

5. problem 2: When an internal page is linking to a Non existent 404 page of your site , you have the choice to edit the link and let it point to the correct source. There are two ways to achieve this 1. Open the source page in question and edit that link.2. 301 redirect the bad link to the correct link.

6. Solution: I would prefer using the former option but in some situations you might want to use the redirection option. Examples: Permalink migration, category or tag base removed etc. • Problem3: When the Target Page No longer exists if the target page in which you are working is deleated due to any reason , Now since external sites are pointing to that bad link, this will show a 404 crawl error on Google Webmaster tools.

7. Solution: Use the Robots.txt file and completely disallow access to any search bot. Alternatively, create a dummy page e.g.domain.com/no-longer-exists.html and redirect the source link to that page. Remember that the new page (e.g. domain.com/no-longer-exists.html) should not return a 404 error.

8.  Fixing Broken Links From Spam Comments • When your site or blog become more famous then the spammers takes the advantage of your blog and post some other html links or post some fake comment on that blog. Solution :  Install the Broken Link Checker WordPress plug in and scan your entire website for broken links. This includes links within comment forms, so you can quickly check comment links in bulk and remove all of the “Server not found” links in one shot.

9. Do not delete all those comments. • Instead, select all the comments or trackbacks that return a 404 not found or server not found error and choose “Unlink”. Done !

11. Remove the Already Crawled URL’s from Google Webmaster Tools When you have fixed all the broken links and bad redirects on your site, then request Google to remove the already existing crawled links that return a 404 and update it’s index.

12.  Go to Google Webmaster tools and find “Remove URL(s)” under Site configuration > Crawler Access > Remove URL. Then click “New Removal request”

13. Then open the “Crawl errors” page under Diagnostics, copy one of the broken links and paste it on the “Remove URL” text box.

14. In the next page, select “remove from search results and cache” and click “Submit”. You have to do this for all the URL(s) that are listed in the crawl error page of Google Webmaster tools crawl reports.

15. Thank you