Smart article on changing your browser’s useragent to gain access to pay sites:
Ever wondered why Google returned search results that lead to sites that require a registration? How did Google index the site without a registration? Many sites want their site indexed in Google to receive more hits, so they allow Googlebots in. Because of this reason we can take advantage of this. All we have to do is disguise ourself as a Googlebot and many sites will let us in without registration.
I was planning to do exactly that with an online learning site I built in 2000, but the feature got lost on the cutting room floor …
1 CommentLeave a comment
I never thought about this, very interesting. It’s frustrating to search out info, only to find it’s a ‘login site’ or a ‘pay site’.