15 Amazing Websites You Didn't Know Existed

15. Google=Skynet

What with being undisputed Kings Of The Internet and all, it stands to reason that Google would also be the Kings Of Internet Secrets, too. The search engine giant's numerous easter eggs are pretty well known at this point, such as typing "do a barrell roll" into the query box and hitting enter, or telling YouTube to "do the Harlem Shake" (if you're a fan of last year's memes). Thankfully, the total geeks who work behind-the-scenes at Google have also managed to conceal some hidden pages amongst their structure that are a little harder to find, and also way nerdier. In fact most websites have a robot.txt index, and you've most likely never come across it or even know what they are unless you're a techie type yourself. Also known as the Robot Exclusion Standard or Robots Exclusion Protocol, a robots.txt page will instruct search engine bots how to crawl and index pages on their website. Deciding to have a bit of fun with this bit of coding insider knowledge, the Google have a humans.txt page (which suggests you try their careers site) along with a killer-robots.txt, which makes you a little worried about the company's existing android experiments... Okay, and one more for the road: Reddit's actual robots.txt is one of the geekiest things we've ever seen, and we love it. Almost makes up for all the fedoras. Almost.
 
First Posted On: 
Contributor
Contributor

Tom Baker is the Comics Editor at WhatCulture! He's heard all the Doctor Who jokes, but not many about Randall and Hopkirk. He also blogs at http://communibearsilostate.wordpress.com/