Nice little article mainly on the pitfalls and things to avoid doing with your site’s robot.txt file.
It does miss things you should be doing like providing a link to your sitemap.xml file, etc.
Related Posts
23 Mar
2023
Two of my favorite things in one: Back to the Future and front end development – specifically CSS. There’s no JS — even for the flux capacitor’s fluxing.
14 Jun
2019
Like any software, Apple’s Mac OS’s Time Machine started out with pretty humble and simple beginnings and soon expanded into a better product, with more robust features, nuances, and arguably better reliability.
09 Nov
2018
CSS Tricks continues to be my favorite and go-to for all things CSS and front-end. Years ago, I discovered the […]
06 Dec
2017
The latest Safari Tech preview adds the ability to have MP4s in img tags. If this catches, on it means we can keep animations on the web, but lose all the downsides of animated GIFs.
10 Nov
2017
Here’s a piece I wrote on my Clean dev team all attending the 2017 All Things Open Conference here in Raleigh, NC and our experiences and takeaways.
10 Jul
2017
A guy on my team today shared this, and I had to immediately share as well. Regular Expression (RegEx) is […]