Akismet False Positives & Spam Karma Configuration

Spam Karma for me is the most effective comment and trackback spam management solution because it doesn’t cause me problems with false positives on many blogs where I comment on a regular basis.
As a blogger, it is a huge time saver by sending me email notifications a few times per day if it finds entries that are “possible” good comments and trackbacks, but which tripped up one or more of the various algorithms it uses.

Akismet – Proof of False Positives

Just today a reader using Akismet posted about me being a comment spammer. He was joking, but it was because Akismet had flagged one of my comments as spam.

  • It was a brand new blog
  • That was my second comment posted on the blog
  • The first comment I posted was not flagged as spam

A Picture Tells A Thousand Words

Akismet Spammer

7 Months Of Historical Data

  • Most of my readers know I live in Poland, so that could factor into any Akismet calculations. I also use an internet service provider that uses a variable IP address.
  • Most of the comments I have made on 100s of blogs over the last 7 months have been to this domain. A few have included my other public sites for wordpress plugins or google toolbar buttons.

With that amount of historical data I should be able to post a comment about any subject I like, and Akismet should give me the benefit of the doubt

Akismet

Whenever someone writes a list of plugins featuring Akismet at the top of the list, the blog spammers rejoice.

Blog spam is about eyeballs on their links, even if it is only in an admin panel.

Spammers even target things like referral stats for traffic, making you think someone has linked to your domain to go and check, and for old sites that still have top referrers.

Every time a blogger has to go trawling through their spam folders to check for legitimate comments, the spammers get eyeballs on their links, and with the primary content of spam being the most popular content and products on the internet, their market is not just the links from dead blogs, but also the eyeballs of active bloggers, many of whom are young males, who spend far too much time in dark rooms lit only by the glare from their computers.

Akismet will never succeed in killing comment spam until it totally removes the need of eyeballs on all those links.
It is a noble cause, and I am sure it will eventually be a successful one, but there seems to be something wrong with the collective intelligence, or certainly the “binary” spam/no spam black/white decision process, whereas Spam Karma offers lots of shades of grey.

How To Set Up Spam Karma

One of the biggest problems people face when they think about alternatives to Akismet for spam control is how complicated many of the alternatives are to configure.

I decided the best solution is to provide you with a crib sheet for Spam Karma, featuring the exact settings I use on my blogs.

These settings will result in some comments being flagged for moderation. Some spam will also get through, especially manual spam, and some trackback spam from splogs sending you legitimate trackbacks will also have to be moderated, at least initially.
Some of that could possibly be avoided with the plugins at the end of this article.

Those comments that do get flagged as potential spam end up at the top of the moderation queue highlighted in green, and as people comment more frequently on your blog, the chances of that happening to someone who is a regular is effectively zero.

If you want to add some extra layers of defense, Akismet can still be used as a plugin to Spam Karma, although this is an additional download.

Basic Spam Karma Configuration

Here is the exact basic configuration I use on my sites, some of which have been using Spam Karma for 2 years.

Download Spam Karma

Here is the basic configuration

Spam Karma Settings
Link to Full Size Image

With these settings I get nice emails every 8 hours for potential spam, those comments between 0 and -20 Karma – first time commenters with javascript switched off typically fall around -5
The first 2 or 3 trackbacks (with a link) from sploggers get through, and from then on they dig themselves into a grave never to appear again with the snowball effect, or I can totally blacklist them.

If you wish to also add some collective intelligence to the mix, then you can use the 3rd party developed Spam Karma Akismet Module

If you are using WP-Cache, it is advisable to also use this fix for Spam Karma with WP-Cache.

For Those That Insist On Using Akismet

Use the Antispam Collateral Condolences plugin from Mark Jaquith of B5 Media (announced a couple of days ago that he was joining). I can think of so many blogging network and business blog things that Mark’s talents could be put towards, and I might have to convince Aaron that he needs them ;)

Engtech’s Auntie Spam plugin for Greasemonkey which allows you to search through Akismet spam faster.

Alternative Plugins

Recently I have been hearing good things about using http:BL and the Simple Spam Filter
Some people swear by Bad Behaviour

I have seen lots of people test other combinations, but almost everyone I know who has an in-depth knowledge of plugins (independent of Automattic developers) and who has experience using Spam Karma ends up returning to it, possibly with the use of Akismet as an additional filter.

Tags: , , , , , , , , , , , , ,
This entry was posted in blogging tips, plugins, wordpress and tagged , , , , , , , , , , , , , . Bookmark the permalink. Both comments and trackbacks are currently closed.

32 Comments

  1. Chris (20 comments.)
    Posted May 31, 2007 at 11:37 am | Permalink

    Oddly, I’ve never used Spam Karma, and for now my current combination works quite well: 500spams in Akismet> 1 or 2.

    I found Bad Behavior to have an immediate effect, although it did have a problem with Indian IP’s for some reason. The latest version appears to have cured that.

  2. Posted May 31, 2007 at 2:29 pm | Permalink

    If you’re stuck with Akismet as your only solution, turning off comments on older posts really seems to be working at cutting out 90% of spam.

  3. Derek Wong (3 comments.)
    Posted May 31, 2007 at 2:39 pm | Permalink

    many of whom are young males, who spend far too much time in dark rooms lit only by the glare from their computers.

    That got my attention real quick. Because that’s me. Right now at 7:30 AM because I usually want to check to see that my server is still connected. :P

    In any case thanks for sharing. I think that I will definitely have to take a look at this plugin later (right now all I’m doing is using Akismet because it has worked for me).

    On another note, I’d like to say that even though you are generally an SEO-targeted blog, I have enjoyed that you also cover a larger number of topics, especially wordpress-related things. It spices things up and makes your blog that much more interesting.

  4. Tobsy (2 comments.)
    Posted May 31, 2007 at 2:57 pm | Permalink

    I’ll give it a try. The amount of spam is really getting out of hand. Thanks Andy.

  5. Arpit Jacob (1 comments.)
    Posted May 31, 2007 at 3:40 pm | Permalink

    I use akismet and simple spam Filter since the amountof spam cought by akismet is too overwhleming to wade through

    http://tantannoodles.com/toolkit/spam-filter/

  6. Vlad (117 comments.)
    Posted May 31, 2007 at 4:07 pm | Permalink

    Thanks Andy, this is just what I was looking for.

  7. Opal: Vegan Momma (2 comments.)
    Posted May 31, 2007 at 4:45 pm | Permalink

    I really like Spam Karma I’ve been using it since last year.

    I have the same issue with Akismet on a few blogs visit it views me as spam. I’ve commented on numerous blogs over the past few years I really didn’t think I would be still facing this issue.

    On average, I receive at least 100 spam daily.

  8. Vlad (117 comments.)
    Posted May 31, 2007 at 5:10 pm | Permalink

    Andy i have just configured the SK and was not able to recover the trackback from http://andybeard.eu/2007/03/ugly-in-pink.html

    You can ping my blog again. I have configured the plugin exactly as it shown in the screen shot, I am keeping my fingers crossed.

  9. Sunny (2 comments.)
    Posted May 31, 2007 at 5:21 pm | Permalink

    Thanks for this post. First impression is that this is very useful information. I am in the process of migrating to wordpress, so I will keep spam karma in mind.

  10. Randa Clay (1 comments.)
    Posted May 31, 2007 at 6:44 pm | Permalink

    Looks like this is something I’m going to have to check out. Thanks for providing all your settings, that’s especially helpful.

  11. Franck Silvestre (13 comments.)
    Posted May 31, 2007 at 7:39 pm | Permalink

    I never used Aksimet. I just moderate my comments on a daily basis.

    I bulk delete the spam and approve the good comments. It takes me 1 minute per day.

    For now, I will stay like this.

  12. Tobsy (2 comments.)
    Posted June 1, 2007 at 3:21 pm | Permalink

    Okay, I installed it yesterday, configured it, and until now I haven’t had to deal with one single spam comment. Everything works perfect, no false positives.

    Thanks again Andy. Exactly what I was looking (and hoping) for.

  13. Meg (19 comments.)
    Posted June 2, 2007 at 7:49 am | Permalink

    Hi Andy

    Another great “how to” article. One good thing about setting up a new blog, is that it takes a while for the spammers to catch up. Consequently, I’ve only had 450 spam in the last 4 weeks, but will certainly look at this plugin when it becomes necessary.

    BTW, I had to fish one of your comments out of Akismet too. Was really surprised to see it there! But the false positives are fewer as time goes on.

  14. HMTKSteve (3 comments.)
    Posted June 2, 2007 at 3:47 pm | Permalink

    I get over 1,000 spam comments every day. I used to be able to wade through them to find any false positives but now, I don’t have the time to sift through 50 pages of possible spam comments!

    I trust Akismet to weed out the bad stuff.

  15. guilherme (1 comments.)
    Posted June 2, 2007 at 5:27 pm | Permalink

    akismet blacklisted me.. but i’m not a spammer..

  16. Leo Plaw (1 comments.)
    Posted June 10, 2007 at 8:29 pm | Permalink

    Andy, as for your comment about eyeballs on those spam links, this logic seems to fail when one has to go through the initial period of “teaching” Spam Karma what is good and what is not. So those same weak willed people illuminated in their dark rooms are still prone to looking at the same links.

    Secondly, there never is a silver bullet for spam. It is the nature of the internet, especially for something as freely available as Spam Karma. Spammers simple pay for programmers to look for the exploits and write a script to take advantage.

    I’ll be writing up more on my own blog.

    • Andy Beard (1633 comments.)
      Posted June 10, 2007 at 8:39 pm | Permalink

      Leo I would disagree with that

      Trackbacks from splogs need some training certainly, but I think in the time I have been running Spam Karma, on multiple domains, I doubt more than 5 potentially offensive spam messages have got through… and I don’t use Akismet as an additional filter.

      Most spammers spend as little time on each site as possible, and don’t fake the javascript, so Spam Karma stops most of that stuff dead.

      I have some public blogs listed in my MBL profile, which use Dofollow, have some reasonable pagerank, and comments are swiched on, even on old content.

      At least one of those blogs I haven’t even visited in a month.

      In fact I should do a couple of upgrades on them, but I wouldn’t have to visit them to check my spam filters for false positives every couple of days.

  17. Las Vegas Guy (2 comments.)
    Posted September 29, 2007 at 9:21 pm | Permalink

    I’m converting my site to drupal and was going to install askimet. My current site gets spammed A LOT and any help I can get I’ll take. It does concern me that I may lose potential clients by the spam blocker, but the gains outweigh the negatives. I know that some spam will still get through, but at least if the majority of it is gone than I can handle the rest.

  18. Rebecca (1 comments.)
    Posted October 4, 2007 at 12:55 am | Permalink

    I had to laugh at the comment about young males being trapped in dark rooms for too long – I guess being female helps in this instance :-)

    I do like akismet, and haven’t found too many false positives. Though I must admit to not always looking through them properly when the volume of spam got too high

  19. Dan Thies
    Posted October 30, 2007 at 4:36 pm | Permalink

    You know, I’d be happy if I could find one comment spam plug-in that consistently recognized the posts that say:

    I couldn’t understand some parts of… (etc.)

    The exact phrase. Exactly the same every time. Yet NONE of them catches it consistently. I mean honestly, how hard could it be? You know EXACTLY what it’s going to say!

    I usually fish about 1 in 100 Akismet “spams” out as a legit comment, and I find that Akismet does save me some time. I’m gonna give the Auntie a try.

  20. Maciej MiÄ…sik (1 comments.)
    Posted February 9, 2008 at 11:31 pm | Permalink

    Well, I started with Spam Karma and was happy with until one bad day came – my hosting provider closed my account because it was using too much of CPU resources, mostly because of DB queries generated by spambots and Spam Karma fighting them. Changing the hosting company isn’t an easy task, especially when you want to get you site running again – I had to get rid of Spam Karma and switch to Akismet.

    The biggest problem with Akismet is that once one of my regular commenters gets flagged as spammer (with no apparent reason), he stays flagged that way no matter how often I “no spam” him. Akismet is supposed to learn but I have yet to see the results of those lessons.

  21. caryscott (1 comments.)
    Posted March 1, 2008 at 3:10 pm | Permalink

    I just wrote a little piece about Askimet. I was wondering if you have noticed the same phenomenon as I have. I seem to have very little spam on my WordPress blogs until the day that I activate Askimet. The day after it’s activated Askimet is already catching an unusual increased amount of spam. After this 3rd time of noticing this happening I wrote a little note to Askimet.

    The artlicle is called Askimet, are you sending me spam. All last week Google listed my article in the #1 spot when typing in “askimet sending spam.” Today the listing magically and completely disappeared from Google — are they protecting an advertiser. Hmmm… Any thoughts?

  22. Zubair (1 comments.)
    Posted March 16, 2008 at 9:27 am | Permalink

    Great post :)

    But i really prefer Akismet over other spam protection :)

    The latest version of Akismet is very neat and improved.

  23. Reginald (8 comments.)
    Posted March 26, 2008 at 11:46 pm | Permalink

    Are you saying that ‘Span Karma’ allows more spams and is not as particular as Askimet?

    If that’s the case, why would I want that?

  24. Dan - Life Coaching (2 comments.)
    Posted March 27, 2008 at 10:19 pm | Permalink

    I notice that Spam Karma is not going to be supported beyond the next release – with wordpress 2.5 on the horizon, does this mean we’ll need to consider alternatives??

  25. GettyCash (1 comments.)
    Posted May 30, 2008 at 11:01 am | Permalink

    My blog is new and Askimet marked my comment as SPAM. I only post my comment once in awhile. :(

  26. Teri Orlando Florida (3 comments.)
    Posted June 24, 2008 at 7:03 pm | Permalink

    Spam no matter where it comes from is a pain. But for the few times this has flagged you I wonder if it will continue to have value. This may be over my expertise but I will ask the people I trust that monitor the site to let me know what they think. Thanks for the heads up.

  27. Posted June 25, 2008 at 8:48 pm | Permalink

    I have the askimet on one of my blogs and there are indeed some false positives and sometimes things get through as well that shouldn’t. I think I will look into the spam karma one that you mention.

  28. Ann, Portsmouth NH (4 comments.)
    Posted June 29, 2008 at 10:59 am | Permalink

    I’ve heard from friends that have used Askimet that they receive a good number of false positives. One of them continued receiving what he thought was a very high number of them so he quit using it, and I never tried it out because of his experience. I’ve just recently been reading some better reviews on spam karma, and now that I’ve read this post, I might check them out myself.

    Thanks for the info.

  29. Susan (1 comments.)
    Posted July 30, 2008 at 3:31 pm | Permalink

    I did the same thing you did and used a blog I haven’t even setup yet to test how it was handling comments and yep…went straight to spam. I’ve been doing a lot of tests and I’m really unhappy with the results.

  30. yorumla (1 comments.)
    Posted August 10, 2008 at 9:34 pm | Permalink

    Andy, as for your comment about eyeballs on those spam links, this logic seems to fail when one has to go through the initial period of “teaching” Spam Karma what is good and what is not. So those same weak willed people illuminated in their dark rooms are still prone to looking at the same links.

  31. KeyifKafe (1 comments.)
    Posted August 11, 2008 at 5:52 am | Permalink

    Sadly a lot of people due :(

    Dateline did an interesting story about catching an ID Thief and started tracking back the spam and just kept following the trail 2 years later and in Africa they “met” the closest person to the organization who in the end admitted what it was and said, “What are you going to do about it?” and left the room.

    Scary -

13 Trackbacks

  1. By Give Comment Spam no Chance on June 8, 2007 at 4:22 pm

    [...] configure Spam Karma, take a look at Andy’s configuration post (That’s where I got my setting from and it’s working like a [...]

  2. [...] this occassion I was directed towards Andy Beard's post "Akismet False Positives & Spam Karma Configuration". While Andy does not actually say Spam Karma is the be all and end all for blog spam, his [...]

  3. By out with the old, in with the new » Andy C on July 10, 2007 at 10:46 am

    [...] Karma from the footer in Tim Hall’s excellent blog as well as Andy Beard’s positive review and useful tutorial on configuring Spam Karma. This blog is protected by dr Dave’s Spam Karma [...]

  4. [...] accidentally recognised comments as spam, you might want to read Andy Beard’s tips on the SK2 setting you can [...]

  5. By Akismet - Auntie Spam | Andy Beard - Niche Marketing on September 14, 2007 at 12:10 pm

    [...] you still insist on using purely Akismet for spam control on your WordPress blog rather than other alternatives, then you will be glad to know Engtech has released a new version of Auntie Spam, which helps you [...]

  6. [...] Comment moderation with Spam Karma can take time if you get a lot of comments but not much more than the time it takes to read them, and if you are using subscribe to comments, you are much less likely to be hit with a CAN SPAM complaint – I see some fairly nasty comment spam come through to my mailbox all the time from Akismet protected blogs. [...]

  7. By moxygen » [insert expletive here] on October 29, 2007 at 7:14 pm

    [...] I was reading a post about Akismet and false spam on a blog I found by reading about something else that has nothing to do with spam, in fact, I can’t [...]

  8. By T=Machine » Spam Karma 2 rocks on December 17, 2007 at 5:23 pm

    [...] do know that Akismet rejects genuine posts, don’t you? Sure, it’s not its fault – spam filtering is [...]

  9. [...] But no matter how many times I tell you they’re not spam, you insist that they are. Even Andy Beard has apparently been caught in your piece of shit [...]

  10. [...] что это не спам, ты настаиваешь на обратном. Даже Andy Beard (популярный блогер) попался в твои [...]

  11. By out with the old, in with the new - My Habari on February 2, 2008 at 1:58 pm

    [...] well as Andy Beard’s positive review and useful tutorial on configuring Spam [...]

  12. By Buh-bye Akismet… Again on March 14, 2008 at 7:54 pm

    [...] Karma on your blog but are not sure what is the best configuration for the plugin, take a look at Andy’s settings for SK2. Share and Enjoy: These icons link to social bookmarking sites where readers can share and [...]

  13. By Good Bye Akismet Hello Spam Karma 2 on April 6, 2008 at 4:10 pm

    [...] a good example of how ineffective Akismet really is. So after Andy’s recent decision to drop Akismet and go with Spam Karma, Caroline’s experience with some guy who abused the system and my own experiences I’ve [...]