Skip to main content

Screaming Frog SEO Spider Tool & Crawling Software

Hello Friends,
In our series of ‘10 SEO Tools you must have to optimize your Website’, today, we will discuss an SEO Audit Tool, which is very necessaryto check your internal links, external Links & it also crawls your Website. There are many Audit Tools available in the Market like Deep Crawl, Site Bulb, Screaming Frog, Spotibo, Pulno, Hexometer, Checkbot… Out of these, I will discuss Screaming Frog. This tool is free (upto 500 URL Crawl Limit) & if you want the Crawl limit to be set ‘Unlimited’ then it will cost around £150 per year.
How to Install Screaming Frog:
If you goto Official website of Screaming Frog , it will give you 2 options either go with Free Version or Purchase a Licence. Under Free Version, Click on Download Free Version and a file ScreamingFrogSEOSpider-11.3.exe will be downloaded onto your Desktop/Laptop. Once you run this file, an application Screaming Frog SEO Spider will come in your Start
Under Free Version, Click on Download Free Version and a file ScreamingFrogSEOSpider-11.3.exe will be downloaded onto your Desktop/Laptop. Once you run this file, an application Screaming Frog SEO Spider will come in your Start Menu. Just Click on it and this SEO Audit Tool Opens. 
Working with Screaming Frog SEo Spider
As in the screenshot above, it shows, No Data, No URL Selected and No Data for Crawl. If we enter the URL in the empty field, www.w3developers.co.in and click on Start then Crawler will start. Once it reaches to 100%, 
Here, we need to check Total no. of URLS Encountered & if there are any blocked by robot.txt. It is showing the screenshot of Internal Links. If we need to check the External links, Click on External, just below the Screaming Frog’s Logo.
What we should Check in External & Internal links
After Address & Content, we see 2 Columns Status Code & Status. We need to do full attention on these 2 columns. There are basically 6 Status Codes:
  1. 200 (OK)
  2. 301 (Moved Permanently)
  3. 302 (Moved Temporarily) / (Found)
  4. 404 ( Not Found)
  5. 500 ( Internal Server Error)
  6. 999 ( Request Denied)
Request Denied can be the option likely in Linkedin case. However, we need to keep a check, if there is any 404 or 500 error code is there. Suppose you have created a link on github site and Github blocked you. If you have provided that link in your website, Screaming Frog will display 404 Error. If hosting of Codepen is down and you have displayed Codepen’s link onto your Website, it will display 500 Error in SEO Spider. Your Ranking will improve at greater pace, if you remove these error codes from your Website and crawl again to check if these Error Codes are coming or Not.
What to check in Page Titles
In Page Title, it will show if you have any Page Title Duplication. It should not be over 65 Characters. In the same way, in meta-Description, it should not be more than 155 characters.
I hope Screaming Frog is Clear now. If you have any issue, please type your issue/concern in the comment box below. We will be more than happy to assist you. If you want, you can mail us at replytow3developers@gmail.com or can call us at 7042717217. 3rd SEO Tool to optimize our website is Keyword Planner. We already have a blog on the same. You may follow the Link Keyword Planner: Search Tool by Google
In our next Blog, we will discuss about Keywords Everywhere, A Google Chrome Extension.

Comments

Post a Comment

Popular posts from this blog

All in One SEO Pack Wordpress Plugin Hello Friends, In our series of ‘ 10 SEO Tools you must have to optimize your Website ’, today, we will discouss a WordPress Plugin, which is like a boon for any Blogging Website. Just Login into your wp-admin and goto Plugins. If you goto ‘Add Plugin’ and type SEO to find search results. Out of these, I will suggest Yoast SEO & All in One SEO Pack. My person opinion, I recommend All in One SEO. It has more than 1 million installations & 4.5 Star rating with 447 reviews. Because it’s the ONLY free plugin to provide SEO Integration for e-Commerce sites, including WooCommerce. This plugin is for all. For beginners, you don’t even have to look at the options, it works out-of-the-box. Just install. For advanced users, you can fine-tune everything to optimize your SEO. You can override any title and set any META description and any META keywords you want. Here, you can see all your posts together and good thing is that if you wish to...
Post a Comment
Read more
Bing Webmaster Tool | W3Developers Hello Friends, Thanks for showing your love for our 6 SEO Tools, we have discussed so far. In continuation to our series, we will discuss our 7th SEO Tool, Bing Webmaster Tool . For the previous 6 SEO Tools, you may goto our Blog Section. Why Bing Webmaster Tool? Everyone knows that the Hold of Google Search Engine more than 85% across the Globe. So, SEO Strategists mainly concentrate on Google Webmaster Tools and ignore Bing, Yahoo, Ask, msn etc. Bing holds more than 10% of the traffic. So, Why not take the benefit of second largest Search Engine Traffic provider? How to configure Bing Webmaster Tool? In order to configure Bing, please search ‘Bing Webmaster Tool’ in Google Search Bar It will take you to a screen to create your account or login with Facebook or gmail account. Once you enter these details, your screen will look like this: Here you need to add your Website to the ‘Bing Webmaster Tool’.  Once you enter your webs...
Post a Comment
Read more