{"id":760,"date":"2018-10-30T19:51:54","date_gmt":"2018-10-30T23:51:54","guid":{"rendered":"https:\/\/sites.temple.edu\/geophysics\/?p=760"},"modified":"2018-10-30T19:57:43","modified_gmt":"2018-10-30T23:57:43","slug":"benfords-law-fraud-evil-plots-and-geophysics","status":"publish","type":"post","link":"https:\/\/sites.temple.edu\/geophysics\/2018\/10\/30\/benfords-law-fraud-evil-plots-and-geophysics\/","title":{"rendered":"Benford\u2019s Law, Fraud, Evil Plots and Geophysics"},"content":{"rendered":"

As mentioned in an earlier post<\/a>, I\u2019m teaching a new general education<\/a> class entitled \u201cEvil Plots\u201d about how graphs, maps and other forms of visual data communication can be used to persuade or mislead. \u00a0The idea is to teach students to be informed consumer of data. My hope is that along the way they will learn foundations of proper data visualization and some tools they can apply in their own studies, whatever their major. Evil plots is not just about the graphical trickery. Sometimes the problem is not with the graph but with the data. Detecting fraudulent data is its own field, but surprisingly effective and easy to implement technique is to test whether the data comply with Benford\u2019s Law.<\/p>\n

In brief, Benford discovered that is you have data that spans many orders of magnitude — populations of cities in the U.S., the length of streams and rivers, even financial data — that it is six times more likely that the numbers will start with a 1 than a 9. In fact, the frequency distribution looks like this (from Wikipedia<\/a>):<\/p>\n

\"A<\/p>\n

The this seems counterintuitive, but is actually a consequence of the numbers spanning such a wide range of values. \u00a0The law fails for quantities that have a limited range, such as people\u2019s height in meters, where I challenge you to find value starting with 9. There is a nice video introduction to Benford\u2019s Law <\/span>here<\/span><\/a>, and here is a short video how Benford\u2019s Law can be used to <\/span>detect fraud<\/span><\/a>. It seems that when people make up numbers to fudge their expense accounts or cook their books, few think to fabricate in accordance with Benford. One hopes I\u2019m not simple educating my students to be better cheats!<\/span><\/p>\n

Here is the simple case I had my students run by hand. The data are actually from a court case of fraudulent expenditures. Yes, Benford\u2019s Law is permissible in court as evidence of fraud!<\/span><\/p>\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n
Checks<\/b><\/td>\n<\/td>\nFirst Digit<\/span><\/td>\nCount<\/span><\/td>\n<\/tr>\n
$1,927.48<\/span><\/td>\n<\/td>\n1<\/span><\/td>\n<\/td>\n<\/tr>\n
$27,902.31<\/span><\/td>\n<\/td>\n2<\/span><\/td>\n<\/td>\n<\/tr>\n
$86,241.90<\/span><\/td>\n<\/td>\n3<\/span><\/td>\n<\/td>\n<\/tr>\n
$72,117.46<\/span><\/td>\n<\/td>\n4<\/span><\/td>\n<\/td>\n<\/tr>\n
$81,321.75<\/span><\/td>\n<\/td>\n5<\/span><\/td>\n<\/td>\n<\/tr>\n
$97,473.96<\/span><\/td>\n<\/td>\n6<\/span><\/td>\n<\/td>\n<\/tr>\n
$93,249.11<\/span><\/td>\n<\/td>\n7<\/span><\/td>\n<\/td>\n<\/tr>\n
$89,658.16<\/span><\/td>\n<\/td>\n8<\/span><\/td>\n<\/td>\n<\/tr>\n
$87,776.89<\/span><\/td>\n<\/td>\n9<\/span><\/td>\n<\/td>\n<\/tr>\n
$92,105.83<\/span><\/td>\n<\/td>\n<\/td>\n<\/td>\n<\/tr>\n
$79,949.16<\/span><\/td>\n<\/td>\n<\/td>\n<\/td>\n<\/tr>\n
$87,602.93<\/span><\/td>\n<\/td>\n<\/td>\n<\/td>\n<\/tr>\n
$96,879.27<\/span><\/td>\n<\/td>\n<\/td>\n<\/td>\n<\/tr>\n
$91,806.47<\/span><\/td>\n<\/td>\n<\/td>\n<\/td>\n<\/tr>\n
$84,991.67<\/span><\/td>\n<\/td>\n<\/td>\n<\/td>\n<\/tr>\n
$90,831.83<\/span><\/td>\n<\/td>\n<\/td>\n<\/td>\n<\/tr>\n
$93,766.67<\/span><\/td>\n<\/td>\n<\/td>\n<\/td>\n<\/tr>\n
$88,336.72<\/span><\/td>\n<\/td>\n<\/td>\n<\/td>\n<\/tr>\n
$94,639.49<\/span><\/td>\n<\/td>\n<\/td>\n<\/td>\n<\/tr>\n
$83,709.26<\/span><\/td>\n<\/td>\n<\/td>\n<\/td>\n<\/tr>\n
$96,412.21<\/span><\/td>\n<\/td>\n<\/td>\n<\/td>\n<\/tr>\n
$88,432.86<\/span><\/td>\n<\/td>\n<\/td>\n<\/td>\n<\/tr>\n
$71,552.16<\/span><\/td>\n<\/td>\n<\/td>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

Just count the frequencies of the numbers starting with, 1, 2, etc., then plot the distribution. Bam! Benford\u2019s got you!<\/span><\/p>\n

Benford and Geophysics<\/b><\/p>\n

Out of curiosity, I decided to run Benford\u2019s against some of my own geophysical data, specifically, apparent resistivity measurements from a sounding at a site on Temple\u2019s Ambler Campus. The details aren\u2019t important for Benford, but what is important is that apparent resistivity measurements typically follow a log-normal distribution with their being orders of magnitude between the mosts and least resistive parts of survey line. To do the calculation, I took advantage of a free package written in python (<\/span>https:\/\/github.com\/milcent\/benford_py<\/span><\/a>). Isn\u2019t open source wonderful? The site also includes a photo of Benford and information on the history of his discover (and he wasn’t the first!) along with math details.<\/span><\/p>\n

So I loaded my data into a Jupyter notebook and check it against Benford. Here is the result:<\/span><\/p>\n

\"\"<\/a><\/span>Not a bad fit!<\/span><\/p>\n

This is only a cursory exploration, but I encourage you to test you own data sets against Benford\u2019s law. Send me an email if you discover something interesting!<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

As mentioned in an earlier post, I\u2019m teaching a new general education class entitled \u201cEvil Plots\u201d about how graphs, maps and other forms of visual data communication can be used to persuade or mislead. \u00a0The idea is to teach students … Continue reading →<\/span><\/a><\/p>\n","protected":false},"author":606,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-760","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/sites.temple.edu\/geophysics\/wp-json\/wp\/v2\/posts\/760","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sites.temple.edu\/geophysics\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sites.temple.edu\/geophysics\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sites.temple.edu\/geophysics\/wp-json\/wp\/v2\/users\/606"}],"replies":[{"embeddable":true,"href":"https:\/\/sites.temple.edu\/geophysics\/wp-json\/wp\/v2\/comments?post=760"}],"version-history":[{"count":0,"href":"https:\/\/sites.temple.edu\/geophysics\/wp-json\/wp\/v2\/posts\/760\/revisions"}],"wp:attachment":[{"href":"https:\/\/sites.temple.edu\/geophysics\/wp-json\/wp\/v2\/media?parent=760"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sites.temple.edu\/geophysics\/wp-json\/wp\/v2\/categories?post=760"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sites.temple.edu\/geophysics\/wp-json\/wp\/v2\/tags?post=760"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}