{"id":51063,"date":"2003-05-28T02:37:29","date_gmt":"2003-05-28T02:37:29","guid":{"rendered":"http:\/\/www.soulhuntre.com\/items\/date\/2003\/05\/28\/stopping-spam-some-info-and-tools\/"},"modified":"2003-05-28T02:37:29","modified_gmt":"2003-05-28T02:37:29","slug":"stopping-spam-some-info-and-tools-2","status":"publish","type":"post","link":"http:\/\/legacyiamsenseiken.local\/2003\/05\/28\/stopping-spam-some-info-and-tools-2\/","title":{"rendered":"Stopping SPAM, some info and tools\u2026"},"content":{"rendered":"<p>Tatsumi commented the other day that she was a little disappointed (to say the least) with our current anti-spam software. The stuff we are using now is part of the <a href=\"http:\/\/www.symantec.com\/sabu\/nis\/nis_pr\/index.html\">NIS 2003 Pro<\/a> software and while it did an OK job (about 60% success) it just wasn&#8217;t doing as well as we hoped.<\/p>\n<p><!--more--><\/p>\n<p>Interestingly, just after this I came across a <a href=\"http:\/\/slashdot.org\/article.pl?sid=03\/05\/26\/219200&amp;mode=nested&amp;tid=111&amp;tid=126\">thread\/discussion on Slashdot<\/a> about this very topic, so I read through it looking for alternatives. I had a short list of requirements and preferences.<\/p>\n<ul>\n<li>WindowsXP compatible\n<li>Easy to install\n<li>Usable by Tatsumi and Kimiko\n<li>No conflict with or existing spam, firewall and anti-virus software\n<li>Free <\/li>\n<\/ul>\n<p>A lot of software showed up in the thread, most of it centered around the concept of Bayesian Filtering. Most notably as discussed <a href=\"http:\/\/www.paulgraham.com\/better.html\">in a paper by Paul Graham<\/a>. You can read below to see what I wound up with as well as a lot of info on the topic.<\/p>\n<p>I&#8217;ll let you know how it goes later on \ud83d\ude42<\/p>\n<p><b>What I picked:<\/b><\/p>\n<p>In the end, I wound up working with <a href=\"http:\/\/spambayes.sourceforge.net\">SpamBayes<\/a> in the form of the <a href=\"http:\/\/starship.python.net\/crew\/mhammond\/spambayes\/\">Outlook plug-in<\/a> partially because of the review <a href=\"http:\/\/weblog.infoworld.com\/udell\/2003\/05\/08.html\">Jon Udell<\/a> gave the combo. It will take me a little while to train it, but it sure looks like a good start. <\/p>\n<ul>\n<li><a href=\"http:\/\/spambayes.sourceforge.net\/\">SpamBayes Bayesian anti-spam classifier written in Python<\/a>\n<li><a href=\"http:\/\/starship.python.net\/crew\/mhammond\/spambayes\/\">SpamBayes Outlook Addin<\/a> <\/li>\n<\/ul>\n<p><b>Resources:<\/b><\/p>\n<ul>\n<li><a href=\"http:\/\/slashdot.org\/article.pl?sid=03\/05\/26\/219200&amp;mode=nested&amp;tid=111&amp;tid=126\">Slashdot Bayesian Filtering For Dummies<\/a> &#8211; a nice thread with some good info.\n<li><a href=\"http:\/\/mail.python.org\/mailman-21\/listinfo\/spambayes\">Spambayes Mailing List<\/a> &#8211; this list has emerged as one of the central places to discuss spam filtering.\n<li><a href=\"http:\/\/radio.weblogs.com\/0101454\/categories\/spam\/\">Gary Robinson&#8217;s Spam Rants<\/a> &#8211; a weblog devoted to stopping spam.\n<li><a href=\"http:\/\/wecanstopspam.org\/\">wecanstopspam.org<\/a> &#8211; a resource page on stopping spam <\/li>\n<\/ul>\n<p><b>References:<\/b><\/p>\n<ul>\n<li><a href=\"http:\/\/news.bbc.co.uk\/1\/hi\/technology\/3014029.stm\">BBC NEWS Technology How to spot and stop spam<\/a> &#8211; an article discussing methods of spam detection.\n<li><a href=\"http:\/\/www.paulgraham.com\/spam.html\">A Plan for Spam<\/a> &#8211; the August 2002 paper by <a href=\"http:\/\/www.paulgraham.com\">Paul Graham<\/a> laying out the basic concept.\n<li><a href=\"http:\/\/www.paulgraham.com\/better.html\">Better Bayesian Filtering<\/a> &#8211; the January 2003 refinement by <a href=\"http:\/\/www.paulgraham.com\">Paul Graham<\/a>.\n<li><a href=\"http:\/\/radio.weblogs.com\/0101454\/stories\/2002\/09\/16\/spamDetection.html\">Spam Detection<\/a> &#8211; a long article by <a href=\"http:\/\/radio.weblogs.com\/0101454\/\">Gary Robinson<\/a> that gives some good info and puts some of Paul Graham&#8217;s work under a microscope.\n<li><a href=\"http:\/\/spambayes.sourceforge.net\/background.html\">SpamBayes Background Reading<\/a> <\/li>\n<\/ul>\n<p><b>Seriously technical references:<\/b><\/p>\n<ul>\n<li><a href=\"http:\/\/citeseer.nj.nec.com\/135897.html\">A Tutorial on Learning Bayesian Networks<\/a> &#8211; a very technical paper defining true [[wp:Bayesian]] networks.\n<li><a href=\"http:\/\/arxiv.org\/abs\/cs.CL\/0006013\">[cs-0006013] An evaluation of Naive Bayesian anti-spam filtering<\/a> <\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Tatsumi commented the other day that she was a little disappointed (to say the least) with our current anti-spam software. The stuff we are using now is part of the NIS 2003 Pro software and while it did an OK job (about 60% success) it just wasn&#8217;t doing as well as we hoped.<\/p>\n","protected":false},"author":3,"featured_media":53186,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"aside","meta":{"footnotes":""},"categories":[278],"tags":[],"_links":{"self":[{"href":"http:\/\/legacyiamsenseiken.local\/wp-json\/wp\/v2\/posts\/51063"}],"collection":[{"href":"http:\/\/legacyiamsenseiken.local\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/legacyiamsenseiken.local\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/legacyiamsenseiken.local\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"http:\/\/legacyiamsenseiken.local\/wp-json\/wp\/v2\/comments?post=51063"}],"version-history":[{"count":0,"href":"http:\/\/legacyiamsenseiken.local\/wp-json\/wp\/v2\/posts\/51063\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/legacyiamsenseiken.local\/wp-json\/wp\/v2\/media\/53186"}],"wp:attachment":[{"href":"http:\/\/legacyiamsenseiken.local\/wp-json\/wp\/v2\/media?parent=51063"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/legacyiamsenseiken.local\/wp-json\/wp\/v2\/categories?post=51063"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/legacyiamsenseiken.local\/wp-json\/wp\/v2\/tags?post=51063"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}