{"id":214,"date":"2008-01-31T13:14:19","date_gmt":"2008-01-31T13:14:19","guid":{"rendered":"https:\/\/andybeard.eu\/?p=214"},"modified":"2017-09-10T18:44:24","modified_gmt":"2017-09-10T18:44:24","slug":"techmeme-pagerank-penalty","status":"publish","type":"post","link":"https:\/\/andybeard.eu\/2008\/01\/techmeme-pagerank-penalty.html","title":{"rendered":"Techmeme PageRank Penalty?"},"content":{"rendered":"

I just happened to glance down at my Search status toolbar in the status window of Firefox, and noticed that Techmeme\u2019s Google Toolbar PageRank had been reduced to PR-4:<\/p>\n

\"Techmeme
Techmeme Google Toolbar PageRank<\/figcaption><\/figure>\n

Techmeme Sell Links<\/h2>\n

Techmeme has very clear advertising with sponsored posts:<\/p>\n

\"Techmeme
Techmeme Sponsored Post<\/figcaption><\/figure>\n

The links they use are redirects.<\/p>\n

http:\/\/www.techmeme.com\/goto\/onair.adobe.com\/blogs\/onair\/2008\/01\/30\/businessweek-on-air-applications-at-demo\/?sdid=BQUCI<\/p>\n

If you check the Http Status Codes:<\/p>\n

Current Date and Time: 2008-01-31T03:10:07-0700
\nUser IP Address: 213.158.xxx.xx<\/p>\n

#1 Server Response: http:\/\/www.techmeme.com\/goto\/onair.adobe.com\/blogs\/onair\/2008\/01\/30\/businessweek-on-air-applications-at-demo\/?sdid=BQUCI
\nHTTP Status Code: HTTP\/1.1 301 Moved Permanently
\nDate: Thu, 31 Jan 2008 11:10:06 GMT
\nServer: Apache\/2.2.3 (Red Hat)
\nLocation: http:\/\/onair.adobe.com\/blogs\/onair\/2008\/01\/30\/businessweek-on-air-applications-at-demo\/?sdid=BQUCI
\nContent-Length: 388
\nConnection: close
\nContent-Type: text\/html; charset=iso-8859-1
\nRedirect Target: http:\/\/onair.adobe.com\/blogs\/onair\/2008\/01\/30\/businessweek-on-air-applications-at-demo\/?sdid=BQUCI<\/p>\n

#2 Server Response: http:\/\/onair.adobe.com\/blogs\/onair\/2008\/01\/30\/businessweek-on-air-applications-at-demo\/?sdid=BQUCI
\nHTTP Status Code: HTTP\/1.1 200 OK
\nDate: Thu, 31 Jan 2008 11:09:22 GMT
\nServer: Apache
\nX-Powered-By: PHP\/5.2.0-8+etch7
\nX-Pingback: http:\/\/onair.adobe.com\/blogs\/onair\/xmlrpc.php
\nConnection: close
\nContent-Type: text\/html; charset=UTF-8<\/p><\/blockquote>\n

You discover that it is a 301 redirect used for tracking, and in theory could pass \u201cGoogle Juice\u201d \u2013 the link could be counted as a real link by search engines.<\/p>\n

However, you then need to look at the Techmeme robots.txt file<\/p>\n

\n
User-Agent: MSIECrawler\r\nDisallow: \/\r\n\r\nUser-agent: Googlebot\r\nNoindex: \/goto\/\r\n\r\nUser-agent: *\r\nDisallow: \/goto\/\r\nDisallow: \/do\/<\/pre>\n<\/blockquote>\n
Traditional SEO thinking is that robots.txt blocks the passing of Google Juice and PageRank.<\/p>\n
That, however, isn\u2019t how it has been confirmed by Matt Cutts to operate.<\/p>\n
As I discussed in my SEO Linking Gotcha\u2019s<\/a> post, Robots.txt does not prevent a page from accumulating PageRank, it purely stops a page from being crawled most of the time, though that is fallible<\/a> (There was further discussion on Sphinn<\/a>).<\/p>\n
Confused? So Am I<\/h2>\n
I can remember seeing Techmeme as a PR6, maybe even as high as a PR7. Robert Scoble<\/a> seems to have removed his blogroll link to them, but they don\u2019t honestly need the juice anymore. Techmeme honestly has tons of links.<\/p>\n
I can\u2019t believe as some might suggest that there is less PageRank in the technology sector, as has been suggested about the SEO sector in the past.<\/p>\n
Techmeme hasn\u2019t really changed its internal linking structure. From an SEO perspective, it’s not really ideal in my way of thinking, but that again would be highly contested as many people believe you can\u2019t benefit from controlling internal linking<\/a>.<\/p>\n
So Why A Penalty?<\/h2>\n
If those redirects were actually linking to a static page, they would still accumulate PageRank, even if blocked with robots.txt and could still appear in search results based upon whatever data Google derives from the pages linking to it.<\/p>\n
Linking again to my SEO linking Gotchas<\/a> just in case you ignored the first link.<\/p>\n
It is possible that for a period of time Techmeme didn\u2019t have a robots.txt file, mistakes happen, though when I last checked back in October, the robots.txt was exactly the same as it is now.<\/p>\n
The page is blocked with robots.txt, so the Googlebot shouldn\u2019t crawl the page unless for some reason it did.<\/p>\n
It seems to me, relying on robots.txt for paid links isn\u2019t safe.<\/p>\n
2 safe options:<\/p>\n
    \n
  1. Nofollow all links<\/li>\n
  2. Use meta nofollow on the redirect page<\/li>\n<\/ol>\n
    The only people who can confirm that Techmeme has some kind of penalty one way or the other are Google<\/p>\n
    If Techmeme has been given a penalty, they are not the only ones to have been given a PageRank penalty unfairly<\/a>.<\/p>\n
    Update<\/h2>\n
    It seems that whatever caused this has been fixed by Google or maybe hand edited. I wonder whether we will ever find out the cause.<\/p>\n
    I am not yet seeing the change on my Search Status toolbar, but a quick check on Pagerank reveals that Techmeme is back to PR7.<\/p>\n
    RELATED POSTS<\/h4>\n