As rudimentary as it sound, ensuring that your site is being properly indexed is vital to your rankings and is often be overlooked. In the early stage of the SEO audit, we run crawl tests to see if there are pages not being indexed or have any crawl issues. Below is a list of deliverables for this phase.
Robots.txt Analysis
The robots.txt file indicates to Google and other search engines what they are allowed to index. In many cases, companies do not want certain pages to be found online, so they direct Google through robots.txt file what to exclude or induce. In the audit, we pull your robots.txt file and determine where you have decided the search engines should or should not index your site.
Screaming Frog Analysis
Screaming Frog SEO Spider is software that crawls your website and distributes the SEO elements in a spreadsheet. In the initial phase we use this tool to verify crawl status and ensure that there are not crawl ability errors, if so we indicate them in the spreadsheet and implement the appropriate fixes.