Tom is the technical SEO manager at Blue Array, he mentions that in his role the standard SEO tasks can take up a huge amount of time when working with big data. He’s found that MAC OS Terminal is a really good way to speed this up.
What is Terminal?
Command Interface between you and the computer within the applications folder of MAC, when you open it up you don’t get anything much. It will take time to learn these commands.
What commands do I use?
Curl is a command that can be used to check response codes. This pulls the entire HTML reponse of what you’re testing, you can also just get the HTTP headers using curl – I. You can also follow redirects by adding in a second modifier. By putting in -O you can download the file directly to your home directory. Type man curl
This sorts things such as keyword data so you can import a csv and order this correctly. sort filename.csv. If a file is tens of thousands of rows maybe try to avoid these but you can get around this by pushing it to a new file.
You can use this to see the first (head) or last (tail) rows helping you manage these large csv files and see if your file has worked.
Short for concatenate, used to combine create and organise files. This can also be used to sort keywords into CSV files. Make sure you use this in the right place as you don’t what to concatenate all of your CSV’s!
Allows you to add text to rows. This can be used in conjunction with regex to add things like www or protocols to the start of URLs in your CSV’s.
This command is almost a programming language on its own which has many applications, Tom goes on to use log file analysis as an example
Case Study – Log File Analysis
Tom shows an example of log files he’s worked on with a client. He was able to extract all of the 404 errors from the log files along with all other status codes such as 404’s, 200’s and 301’s. He was also able to extract ALL search engine bot hits using the awk command which means you can review how crawlers are hitting your website.
Overall some really handy tips on how to use terminal as an SEO to speed up your workflow whilst making it look like you are coding!
This post is one of 28 in our Brighton SEO 2018 collection
- Brighton SEO: Christoph C. Cemper – 20 Free SEO Tools You Should be Using
- Brighton SEO – Ways to to definitely get links for your business
- Brighton SEO: 5 Truths The Gurus Won’t Tell You About Facebook Ads
- Brighton SEO: Alex Major – Comparison Shopping: The Future of Google Shopping Ads
- Brighton SEO Keynote – Live Google Webmasters Hangout with John Mueller & Aleyda Solis
- Brighton SEO – Killing giants and competing in the SERPs
- Brighton SEO: Jeroen Maljers – Hidden Messages: The Psychology Behind PPC & SEO
- Brighton SEO: Arianne Donoghue – The PPC Automation Revolution Is Coming
- Brighton SEO: Laura Hogan – Big Links for £0
- Brighton SEO: Nichola Stott – Speed metrics in context of the UK Top 5,000 websites
- Brighton SEO 2018: We need to talk about competitor campaigns
- Brighton SEO: Bastian Grimm – Web Performance Madness: Critical Rendering Path Optimization
- Brighton SEO: Rob Bucci – Featured Snippets From Then To Now, Volatility, & Voice Search
- BrightonSEO 2018: Fili Wise – Optimising for SearchBot
- Advanced & Practical Structured Data
- Brighton SEO: Gavin Bell – Amplifying Your Content With Facebook Ads
- Brighton SEO 2018 : Craig Campbell – Risks and Rewards of PBNs
- Brighton SEO: Chelsea Blacker – Taming the Wild West of ASO
- Brighton SEO: George Karapalidis – Using machine learning and statistical models to predict revenue potential for search
- Brighton SEO: Barry Adams – Technical SEO in the Mobile First Indexing Era
- Brighton SEO: Kaspar Szymanski – Understanding Google Penalties by ex-Googler Kaspar Szymanski
- Brighton SEO: Mark Thomas – How much positive impact can crawl budget optimization have in a mobile first index era?
- Brighton SEO: Chris Liversidge – Using Machine Learning Technology To Build Audience-Led Analytics
- Brighton SEO: Emily Mace – Diagnosing Common Hreflang Tag Issues On Page & In Sitemaps
- Brighton SEO: Steve Rayson & Giles Palmer – How Metrics and Data Drive Advocacy Effectiveness
- Brighton SEO: Tom Anthony – Diving Into HTTP/2 – A Guide For SEOs
- Brighton SEO: Tom Pool – Command Line Hacks For SEO
- Brighton SEO: Eleni Cashell – How to Unleash The Power Of Unique Content