This means that if they show a search result for something, if a user clicks the result, they should be given the information they expect – what is promised in the headline and snippet in the search results.

Given as in free

There should be no exceptions.

This is especially true for news results in Google news and mainstream media – if they want search traffic based upon their content that is behind a paywall or other restriction, they have to give Google and their users free access for that first page view.

It is quite possible to get stubs of a story to rank, but that is likely to result (long-term) in a poorer quality rating of your site contents by Google (more coming on that in future blog posts).

This is technically called “First Click Free”

First Click Free In Action

There is a story on Techmeme from the Financial Times about Google possibly looking to publish Pay Per View Videos on YouTube.

This is the link they provide

http://www.ft.com/cms/s/0/e638714e-b396-11df-81aa-00144feabdc0.html

If you click that link you hit the FT.com paywall – well freewall as you can register for free to read a certain number fo stories per month – any more and you have to pay.

However if you are accessing the article from Google, you skip the barrier

Wanna Watch Movies Online?

Lots of people want to watch movies online, but most of the people want to watch the latest box office movies online, and quite possibly many of them want to do it for free.

At the end of June U.S. Immigration and Customs Enforcement (ICE) cracked down on online video streaming sites in “Operation In Our Sites“.

More commentary on this in a July 1st post by Torrent Freak.

So that shows the demand might be there… but Google have a problem.

First Click Free With Movies

Hollywood face a constant struggle to keep full (illegal) feature length movies off the internet, or at least out of the search engine results and the internet is international as are search results.
There is nothing more frustrating for an international user than discovering content through a search engine, or even manually whilst navigating Youtube, and being constantly presented with content they are not allowed to watch.

Current movies on Youtube whilst not available to all countries, are available to many locations – even to me here in Poland. Some of them are even in colour.

For online video you might compare a site search of Youtube vs Hulu

Youtube – http://www.google.com/search?hl=en&safe=off&gl=US&tbs=vid%3A1&q=site%3Ayoutube.com
Hulu – http://www.google.com/search?hl=en&safe=off&gl=US&tbs=vid%3A1&q=site%3Ahulu.com

Hulu videos are not being indexed as videos… possibly because of the streaming method they use.

But they do appear in normal search

Clicking that result brings me to this page

What happened to “First Click Free” Google?

Here is an alternative which is even less helpful

Those searches were using Google.com & US geo-location, but it is just the same with Google.pl and PL geo-location.

http://www.google.pl/search?q=Fringe+-+Full+Episodes&pws=0&hl=en&gl=PL

Google With Vevo

Google already have some funny content deals with Vevo

Custom branded channels
Custom Player with clickable link to Vevo
Custom Navigation Bar

Custom restrictions on access to some content internationally. Recently I have been going through my 3 year old son’s Youtube playlists removing videos that have recently had access restrictions added to them.

Pay Per View vs First Click Free / Freewall & Paywall vs Geotargeting

I am bundling all of these technology solutions together because ultimately they are all appearing in my search results. If I go to click one of the results and I don’t have access, I feel jilted… by Google.

Barry (from Pierce Communications in Belfast)recently posted an article over on the Dojo/Huomah SEO Training blog about The Death of SEO.

His point was that search is moving to other platforms, and in particular search on other devices.

People are watching movies on their iPad – they will soon also be watching movies on their new Apple iTVs or whatever they end up calling them and paying money to Steve Jobs rather than Google.

You search for a movie, find it, pay and have access and it is much easier to handle regional access controls with regional catalogues.

Currently the results being returned for video searches in Google are little better than search spam – in many cases the spam results are actually better as they often lead to what people are looking for, at the risk of malware infestation.

Have you ever tried explaining geotargeting access restrictions to a 3 year old?

Akismet – Proof of False Positives

Just today a reader using Akismet posted about me being a comment spammer. He was joking, but it was because Akismet had flagged one of my comments as spam.

• It was a brand new blog
• That was my second comment posted on the blog
• The first comment I posted was not flagged as spam

A Picture Tells A Thousand Words

7 Months Of Historical Data

• Most of my readers know I live in Poland, so that could factor into any Akismet calculations. I also use an internet service provider that uses a variable IP address.
• Most of the comments I have made on 100s of blogs over the last 7 months have been to this domain. A few have included my other public sites for wordpress plugins or google toolbar buttons.

With that amount of historical data I should be able to post a comment about any subject I like, and Akismet should give me the benefit of the doubt

Akismet

Whenever someone writes a list of plugins featuring Akismet at the top of the list, the blog spammers rejoice.

Blog spam is about eyeballs on their links, even if it is only in an admin panel.

Spammers even target things like referral stats for traffic, making you think someone has linked to your domain to go and check, and for old sites that still have top referrers.

Every time a blogger has to go trawling through their spam folders to check for legitimate comments, the spammers get eyeballs on their links, and with the primary content of spam being the most popular content and products on the internet, their market is not just the links from dead blogs, but also the eyeballs of active bloggers, many of whom are young males, who spend far too much time in dark rooms lit only by the glare from their computers.

Akismet will never succeed in killing comment spam until it totally removes the need of eyeballs on all those links.
It is a noble cause, and I am sure it will eventually be a successful one, but there seems to be something wrong with the collective intelligence, or certainly the “binary” spam/no spam black/white decision process, whereas Spam Karma offers lots of shades of grey.

How To Set Up Spam Karma

One of the biggest problems people face when they think about alternatives to Akismet for spam control is how complicated many of the alternatives are to configure.

I decided the best solution is to provide you with a crib sheet for Spam Karma, featuring the exact settings I use on my blogs.

These settings will result in some comments being flagged for moderation. Some spam will also get through, especially manual spam, and some trackback spam from splogs sending you legitimate trackbacks will also have to be moderated, at least initially.
Some of that could possibly be avoided with the plugins at the end of this article.

Those comments that do get flagged as potential spam end up at the top of the moderation queue highlighted in green, and as people comment more frequently on your blog, the chances of that happening to someone who is a regular is effectively zero.

If you want to add some extra layers of defense, Akismet can still be used as a plugin to Spam Karma, although this is an additional download.

Basic Spam Karma Configuration

Here is the exact basic configuration I use on my sites, some of which have been using Spam Karma for 2 years.

Download Spam Karma

Here is the basic configuration

Link to Full Size Image

With these settings I get nice emails every 8 hours for potential spam, those comments between 0 and -20 Karma – first time commenters with javascript switched off typically fall around -5
The first 2 or 3 trackbacks (with a link) from sploggers get through, and from then on they dig themselves into a grave never to appear again with the snowball effect, or I can totally blacklist them.

If you wish to also add some collective intelligence to the mix, then you can use the 3rd party developed Spam Karma Akismet Module

If you are using WP-Cache, it is advisable to also use this fix for Spam Karma with WP-Cache.

For Those That Insist On Using Akismet

Use the Antispam Collateral Condolences plugin from Mark Jaquith of B5 Media (announced a couple of days ago that he was joining). I can think of so many blogging network and business blog things that Mark’s talents could be put towards, and I might have to convince Aaron that he needs them ;)

Engtech’s Auntie Spam plugin for Greasemonkey which allows you to search through Akismet spam faster.

Alternative Plugins

Recently I have been hearing good things about using http:BL and the Simple Spam Filter
Some people swear by Bad Behaviour

I have seen lots of people test other combinations, but almost everyone I know who has an in-depth knowledge of plugins (independent of Automattic developers) and who has experience using Spam Karma ends up returning to it, possibly with the use of Akismet as an additional filter.

Akismet is a very smart and effective system for controlling comment spam on blogs, and I know thousands of bloggers swear by it, listing it as their number one plugin for their blogging platform.

Increasingly I have started having problems posting comments on popular blogs such as Problogger. Initially it was when I included a link to a relevant post, which is within Darren’s comment policy. Recently I have had comments that didn’t include a link enter the moderation queue on new posts. Maybe I am going to have to start commenting without entering an optional URL (I know that affects Spam Karma)
It is well known among those that visit Darrens blog on a regular basis that Automattic use Problogger as a yardstick – the site attracts a great deal of spam.

Collective Intelligence

No one outside Automattic know the inner workings of Akismet, but it is known that it collects data from all the blogs using the service, and uses an algorithm to determine if a comment is spam. Such a system can be very effective. If someone spams one blog, they in some way get a black flag on all blogs, although how much weighting is transferred from one blog to another is unknown.

Rogue Data

I know Matt Mullenweg wouldn’t flag criticism on his blog as spam, but that might not be the case of every blogger. The same could be true for trackbacks – instead of just deleting a trackback that was in some way critical, or from a competitor joining in the conversation, it would be easy to flag it as spam.

The Danger of Collective Intelligence

Collective Intelligence isn’t just used for blog comment spam, it is also used for email spam. Every day I pull emails out of my spam folder in gmail. Some of it is highly important, such as data sent to me from this domain, contact form results, spam karma results etc. Often those reports contain “naughty” words – one day Gmail will learn that I really need this information.
I also pull lots of email from marketers out of the spam bin. If I have signed up for the mailing list, it shouldn’t be in the spam bin, even if I might not read it every time. If you don’t take this action, the email filters have no data to work with, or might take it that if you leave the comment in the spam bin, that it made a correct decision.

My Own Commenting

Whilst I am sure there are more active blog commenters than me, I am fairly active, and always try to add value. I am a repeat commenter on many blogs, and 95% appear without any problems, even on sites running Akismet.

Here are some things I have noticed:-

• Links in the Body – If you include a link in the body of a comment, you have a high risk of being flagged for the moderation queue. Even when the owner of the site has asked for a link to be posted, I avoid it.
• Optional Links – In your optional link to your site, that is actively encouraged, if you use it to link not to your root domain, but to highly relevant deep content, it has a higher chance of being flagged as spam.
• Long comments – If you make a longer comment, adding true value to the blog where you are posting it, you are more likely to be flagged as spam. I am not sure if that is because you have a higher chance of snagging a particular word filter, but I am less inclined to write long comments. I write lots of comments on blogs discussing monetization. I avoid using words such as money
• Constructive Criticism – I avoid linking / pinging blogs that are adverse to criticism, or don’t show trackbacks. If a trackback doesn’t show up, it suggests to me that there is a chance my trackback is remaining in the moderation queue, or even worse is being flagged as spam.

A blog which isn’t comment / trackback friendly for me becomes a “bad neighbourhood“, in much the same way as linking to a grey boxed website might damage your ranking in search engines, commenting on or linking with a trackback might damage your ability to comment on other sites.

Require Signups to Comment?

No matter how much you think this helps with spam, it deters constructive comments. I have declined commenting on 2 blogs today simply because they required me to sign up to their blog to place a comment.
I have just deleted the broken trackback from one of them after I wrote a long comment, only to discover after I hit submit that I needed to sign up to comment. I didn’t however flag it as spam as many would.

Liability and Reputation Management

Reputation management is often discussed – I frequently get comments from the owners of various products and services I review, whether the post was positive or negative. I always try to be constuctive in my opinions, and even when what I say is critical in some way, generally the time I have spent looking at something in depth is appreciated.

Due to collective intelligence, the actions of a rogue webmaster who flags critical comments and trackbacks as spam, could prevent legitimate commenters voicing their opinion on hundreds of other blogs. Who would ultimately be responsible, Akismet or the webmaster who flagged comments as spam that were just voicing a different opinion?
Who knows, maybe that is why I am having increasing difficulties posting comments on Problogger, and other high traffic blogs using Akismet. I am fairly certain that Darren has never flagged one of my comments as spam, and I have been leaving comments there for some time. Surely Akismet should have learned by now?

Spammers are actively working to improve their Akismet reputation by posting comments containing absolutely no links. If a comment gets approved or slips through, many comment systems would give a significant bonus for any future comments, they would no longer be a first time commenter.

GeoTargeting Blacklists

I am not sure if GeoTargeting is used in some way for blog spam blacklists. I really hope it isn’t. I am based in Poland, maybe that is having an increasing affect on my ability to post comments. Blogging is a global community.

Tips For Akismet Users

Many people who use Akismet as a way to control comment spam believe that it saves them a lot of time. In many cases that is true, but there are certainly an increasing number of posts I have read regarding false positives.

This post isn’t intended to deter people from using Akisment, but to be aware of the effects of collective intelligence and how they can help to improve it.

• Use delete – Don’t flag critical comments and trackbacks as spam – you could always leave them, or answer them in a constructive manner – the latter shows real class
• Monitor your spam frequently – don’t just assume everything Akismet catches is spam – not taking action could be harming your customers ability to give feedback
• Actively recover comments even if they are critical – you can always delete the comments afterwards – I don’t know if comments detected as spam and not recovered affect the collective intelligence, but having briefly looked at the Akismet WP plugin code, white flag signals are being sent.
• Upgrade Akismet – newer versions of Akismet plugins use different functions to check for spam, and sometimes remove functions that were determined to cause too many false positives.

The Automattic guys are constantly working on Akismet to improve it. They rely in part on the data you provide them, both flagging comments as spam, and recovering comments from the sin bin.

Maybe one day I will happily use Akismet, but currently I am uncomfortable by the amount of times my own comments end up in someone’s moderation queue, only to sometimes appear a few hours or days later when a good webmaster does some house keeping. It interrupts the flow of conversation.