{"id":267,"date":"2020-07-17T19:56:12","date_gmt":"2020-07-17T23:56:12","guid":{"rendered":"https:\/\/sites.temple.edu\/klugman\/?p=267"},"modified":"2020-07-17T20:53:23","modified_gmt":"2020-07-18T00:53:23","slug":"does-the-us-have-too-stringent-a-lockdown-policy","status":"publish","type":"post","link":"https:\/\/sites.temple.edu\/klugman\/2020\/07\/17\/does-the-us-have-too-stringent-a-lockdown-policy\/","title":{"rendered":"Does the US have too stringent a lockdown policy?"},"content":{"rendered":"<p><a href=\"https:\/\/sites.temple.edu\/klugman\/files\/2020\/07\/a-man-escaped-1200-1200-675-675-crop-000000.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-268\" src=\"https:\/\/sites.temple.edu\/klugman\/files\/2020\/07\/a-man-escaped-1200-1200-675-675-crop-000000-300x169.jpg\" alt=\"\" width=\"300\" height=\"169\" srcset=\"https:\/\/sites.temple.edu\/klugman\/files\/2020\/07\/a-man-escaped-1200-1200-675-675-crop-000000-300x169.jpg 300w, https:\/\/sites.temple.edu\/klugman\/files\/2020\/07\/a-man-escaped-1200-1200-675-675-crop-000000-1024x576.jpg 1024w, https:\/\/sites.temple.edu\/klugman\/files\/2020\/07\/a-man-escaped-1200-1200-675-675-crop-000000-768x432.jpg 768w, https:\/\/sites.temple.edu\/klugman\/files\/2020\/07\/a-man-escaped-1200-1200-675-675-crop-000000.jpg 1200w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p>On Wednesday, the economist <a href=\"http:\/\/philmagness.com\/\">Phil Magness<\/a> posted this tweet with a graph from <a href=\"https:\/\/ourworldindata.org\/policy-responses-covid\">OurWorldInData<\/a> (which I reproduce because his graph is hard to read in his tweet).<\/p>\n<p><a style=\"font-size: 16px\" href=\"https:\/\/sites.temple.edu\/klugman\/files\/2020\/07\/magness20200715.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-269\" src=\"https:\/\/sites.temple.edu\/klugman\/files\/2020\/07\/magness20200715-243x300.png\" alt=\"\" width=\"243\" height=\"300\" srcset=\"https:\/\/sites.temple.edu\/klugman\/files\/2020\/07\/magness20200715-243x300.png 243w, https:\/\/sites.temple.edu\/klugman\/files\/2020\/07\/magness20200715.png 652w\" sizes=\"auto, (max-width: 243px) 100vw, 243px\" \/><\/a><\/p>\n<p><a href=\"https:\/\/sites.temple.edu\/klugman\/files\/2020\/07\/magness-graph.png\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-270 size-medium\" src=\"https:\/\/sites.temple.edu\/klugman\/files\/2020\/07\/magness-graph-300x215.png\" alt=\"\" width=\"300\" height=\"215\" srcset=\"https:\/\/sites.temple.edu\/klugman\/files\/2020\/07\/magness-graph-300x215.png 300w, https:\/\/sites.temple.edu\/klugman\/files\/2020\/07\/magness-graph-768x549.png 768w, https:\/\/sites.temple.edu\/klugman\/files\/2020\/07\/magness-graph.png 804w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p>I have looked at different take-downs of the U.S. policy response to COVID, and a supposed late start of lock-downs has not been a prominent theme.\u00a0 Mostly writers have been focusing on the lack of testing, the lack of protective gear for medical workers, Trump&#8217;s idiotic pronouncements about the virus, and Trump&#8217;s mismanagement of Sino-U.S. relations (e.g. <a href=\"https:\/\/www.vox.com\/2020\/6\/8\/21242003\/trump-failed-coronavirus-response\"><em>Vox<\/em> 6\/8<\/a>, <a href=\"https:\/\/www.theatlantic.com\/politics\/archive\/2020\/06\/how-white-house-coronavirus-response-went-wrong\/613591\/\"><em>Atlantic<\/em> 6\/28,<\/a> <a href=\"https:\/\/time.com\/5861697\/us-uk-failed-coronavirus-response\/\"><em>Time<\/em> 7\/1<\/a>, <a href=\"https:\/\/www.usatoday.com\/story\/sports\/columnist\/dan-wolken\/2020\/07\/16\/college-football-united-states-covid-19-testing-failures\/5454303002\/\"><em>USA Today<\/em>, er, yesterday<\/a>).\u00a0 But maybe Magness has a point.\u00a0 Early on during the pandemic there was ire directed towards the federal government&#8217;s lack of guidance and devolving responsibility to states, municipalities, and private actors (see <a href=\"https:\/\/www.theatlantic.com\/ideas\/archive\/2020\/03\/america-isnt-failing-its-pandemic-testwashington-is\/608026\/\"><em>Atlantic<\/em> 3\/14<\/a>).\u00a0 And now people are making the connection between states&#8217; re-opening and the new surge in COVID-19 cases (e.g. <a href=\"https:\/\/nymag.com\/intelligencer\/2020\/06\/failed-us-reopening-serves-up-a-feast-for-the-coronavirus.html\"><em>New York<\/em> 6\/29<\/a>).<\/p>\n<p>Or does he?\u00a0 The graph he posted uses data from the <a href=\"https:\/\/www.bsg.ox.ac.uk\/research\/research-projects\/coronavirus-government-response-tracker#data\">Oxford COVID-19 Government Response Tracker<\/a> (OxCGRT) put together by researchers at the Blavatnik School of Government at the University of Oxford.\u00a0 The OxCGRT is an\u00a0<em>index <\/em>(also known as a <em>scale)<\/em>, that is, a statistic that aggregates (usually through summing or average) measures of different but related concepts to get the best measure of some broader concept.\u00a0 One index that statistics professors have a lot of fun with are college rankings, as the inclusion and weighting of different measures\/concepts tend to be pretty arbitrary, especially with the <em>U.S. News and World Report<\/em> rankings.\u00a0 Joel Best, in\u00a0<em>More Damned Lies and Statistics<\/em>, says that we risk turning such indices into <em>magical numbers<\/em> where we do not pay attention to the decisions that went into creating the index, and hence accord them an authoritativeness they do not deserve.<\/p>\n<p>Magness&#8217;s graph focuses specifically on the OxCGRT&#8217;s &#8220;stringency&#8221; index (they have multiple indices).\u00a0 This index is based on nine measures:<\/p>\n<ul>\n<li>C1 \u2022 School closings (0-3)<\/li>\n<li>C2 \u2022 Workplace closings (0-3)<\/li>\n<li>C3 \u2022 Cancellation of public events (0-2)<\/li>\n<li>C4 \u2022 Restrictions on private gatherings (0-4)<\/li>\n<li>C5 \u2022 Closing public transport (0-2)<\/li>\n<li>C6 \u2022 Stay at home requirements (0-3)<\/li>\n<li>C7 \u2022 Restrictions on internal movement (0-2)<\/li>\n<li>C8 \u2022 International travel controls (0-4)<\/li>\n<li>H1 \u2022 Public information campaigns (0-2)<\/li>\n<\/ul>\n<p>Having looked into the construction of this index, I would be cautious about using it make comparisons over time, but especially between countries (as Magness does).\u00a0 There&#8217;s a couple of problems with the index:<\/p>\n<p>First, there is the matter of actually quantifying government responses to COVID.\u00a0 The OxCGRT team are not very <a href=\"https:\/\/www.bsg.ox.ac.uk\/sites\/default\/files\/2020-05\/BSG-WP-2020-032-v6.0.pdf\">clear<\/a> on how exactly they took public information and scored it.\u00a0 I am not sure what sources they consulted to score government actions (I am guessing news reports?).\u00a0 Plus, deciding what value to assign a country seems to involve a level of personal discretion for the coder.\u00a0 Take, for example, measure C2, workplace closings.\u00a0\u00a0Their <a href=\"https:\/\/github.com\/OxCGRT\/covid-policy-tracker\/blob\/master\/documentation\/codebook.md\">codebook<\/a> describes the meaning of the four possible values this measure can take:<\/p>\n<ol start=\"0\">\n<li>no measure<\/li>\n<li>recommend closing (or work from home)<\/li>\n<li>require closing for some sectors or categories of workers<\/li>\n<li>require closing for all-but-essential workplaces (e.g. grocery stores, doctors)<\/li>\n<\/ol>\n<p>The difference between 2 and 3 is quite blurry, especially depending on how broad a country defines &#8220;essential&#8221; workers. Bear in mind, the OxCGRT team&#8211;consisting of six primary investigators and over 120 contributors&#8211;are measuring these things for each country twice a week.\u00a0 Maintaining consistent coding for many cases over so many dates, and coordinating this across over a hundred people seems terribly daunting to me.<\/p>\n<p>But set this aside.\u00a0 These are public policy scholars, maybe we can trust their subjective assessments.\u00a0 But we have another issue&#8211;what do they do about <em>intra<\/em>-national heterogeneity in policy response?\u00a0 After all, in the United States, state governments, not the national government, have been making the call to &#8220;lockdown&#8221; or &#8220;reopen&#8221;.\u00a0 Here is what the OxCGRT team <a href=\"https:\/\/github.com\/OxCGRT\/covid-policy-tracker\/blob\/master\/documentation\/codebook.md\">say<\/a>:<\/p>\n<p style=\"padding-left: 40px\"><em>Government coronavirus policies often vary by region within countries. We code the most stringent government policy that is in place in a country, as represented by the highest ordinal value. Sometimes the most stringent policy in a country will only apply to a small part of the population.<\/em><\/p>\n<p><strong>This is a big, big problem.<\/strong>\u00a0 In other words, a country like the United States is being recorded as having the policy response of the most stringest state.\u00a0 Magness wants to use this graph to compare\u00a0the US to other European countries, and conclude that the U.S.&#8217;s policy was just like other European countries&#8217;, but the reality is that the U.S. has an unusual federal system of government with a lot of power delegated to the states.\u00a0 By using the OxCGRT index, he is really comparing the stringest state to other European countries.\u00a0 He is stacking the deck in favor of his conclusion that the U.S. was like other European countries and is not suffering from a lack of lockdown.<\/p>\n<p><strong>Now, all is not lost for Magness&#8217;s case.<\/strong>\u00a0 The OxCGRT team have a statistical fix for this issue: if a country has a COVID policy response that was &#8220;targeted&#8221;, the country&#8217;s score for that particular indicator is penalized.\u00a0 But here is where you can see all of the cumbersome, arbitrary decisions that go into index construction.\u00a0 \u00a0How is that score penalized?\u00a0 By half a point.\u00a0 So, in the United States, for most of the lockdown period it has been coded as &#8220;3&#8221; on the &#8220;workplace closings&#8221; indicator, meaning &#8220;require closing for all-but-essential workplaces&#8221;.\u00a0 When the OxCGRT team aggregate the measures into the stringency index, they express them as out of 100, so the U.S.&#8217;s score without the penalty would be 3 out of 3, or 100%.\u00a0 But the OxCGRT data record nearly all of the U.S. policies as &#8220;targeted&#8221;, so the score that the OxCGRT index actually uses when it creates the stringency index is not 3\/3 but 2.5\/3, or 83.3% (the half point penalty turns into a 17 percentage point penalty).<\/p>\n<p>But if you look at my list above, you can see that not all of the measures have a range of 0-3.\u00a0 Cancellation of public events has a range of 0-2.\u00a0 For most of the lockdown period, the U.S. is coded as 2\/2, but since this policy was targeted in the U.S., the score used to construct the index is 1.5\/2, or 75% (the half-point penalty turns into a 25 percentage point penalty).\u00a0 Likewise with restricting private gatherings: the U.S. is again mostly coded as 4\/4, but again, this is targeted, so the score used to construct the index is 3.5\/4 or 87.5% (the half point penalty turns into a 13 percentage point penalty).\u00a0 So the fact that the U.S. has a federal system results in a penalty that is alternatively 13, 17, or 25 percentage points.\u00a0 See how arbitrary this is?\u00a0 And are these penalties even in the correct ballpark for evaluating how &#8220;targeted&#8221; or &#8220;general&#8221; a policy is in the United States?\u00a0 Beats me, but it is also evident that is something the OxCGRT people are not concerned with.\u00a0 But this index allows someone with an agenda, who wants to argue that the U.S. has had too much lockdown, to use this scale to push that argument without really thinking about how to compare a federal system like the U.S. to more centralized governments.<\/p>\n<p>If you want to see how unique the U.S. is among the countries in the OurWorldInData graph, for each measure, here is the proportion of times the policy was coded as &#8220;general&#8221; (as opposed to &#8220;targeted&#8221; by OxCGRT.<\/p>\n<p><a href=\"https:\/\/sites.temple.edu\/klugman\/files\/2020\/07\/oxcgrt-flag-table.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-274\" src=\"https:\/\/sites.temple.edu\/klugman\/files\/2020\/07\/oxcgrt-flag-table-300x132.png\" alt=\"\" width=\"300\" height=\"132\" srcset=\"https:\/\/sites.temple.edu\/klugman\/files\/2020\/07\/oxcgrt-flag-table-300x132.png 300w, https:\/\/sites.temple.edu\/klugman\/files\/2020\/07\/oxcgrt-flag-table.png 656w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p>Essentially, for all of the days and aspects when and where the United States was coded as having a COVID-19 containment policy,\u00a0 only in 13 percent of them were they general policies.\u00a0 The country that comes next after the United States in relying on targeted policies?\u00a0 That is Germany, which is not surprising since the U.S. imposed the federal model on Germany after WWII.\u00a0 What is surprising is that even a federal system like Germany still has general policies in 49 percent of the days and aspects.\u00a0 The remaining countries are at 77 percent or higher.<\/p>\n<p>If I were a libertarian and wanted to argue that lockdowns were not the solution to COVID-19, and that the U.S. has had too much lockdown, I would probably not take too much solace in the OxCGRT data.\u00a0 If anything, I would be worried by the implication of the federal system in a government&#8217;s failure to respond to COVID-19.<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>On Wednesday, the economist Phil Magness posted this tweet with a graph from OurWorldInData (which I reproduce because his graph is hard to read in his tweet). I have looked at different take-downs of the U.S. policy response to COVID, and a supposed late start of lock-downs has not been a prominent theme.\u00a0 Mostly writers &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/sites.temple.edu\/klugman\/2020\/07\/17\/does-the-us-have-too-stringent-a-lockdown-policy\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Does the US have too stringent a lockdown policy?&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1802,"featured_media":268,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[11,9,4],"class_list":["post-267","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized","tag-cherry-picking","tag-international-comparisons","tag-measurement","entry"],"_links":{"self":[{"href":"https:\/\/sites.temple.edu\/klugman\/wp-json\/wp\/v2\/posts\/267","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sites.temple.edu\/klugman\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sites.temple.edu\/klugman\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sites.temple.edu\/klugman\/wp-json\/wp\/v2\/users\/1802"}],"replies":[{"embeddable":true,"href":"https:\/\/sites.temple.edu\/klugman\/wp-json\/wp\/v2\/comments?post=267"}],"version-history":[{"count":0,"href":"https:\/\/sites.temple.edu\/klugman\/wp-json\/wp\/v2\/posts\/267\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sites.temple.edu\/klugman\/wp-json\/wp\/v2\/media\/268"}],"wp:attachment":[{"href":"https:\/\/sites.temple.edu\/klugman\/wp-json\/wp\/v2\/media?parent=267"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sites.temple.edu\/klugman\/wp-json\/wp\/v2\/categories?post=267"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sites.temple.edu\/klugman\/wp-json\/wp\/v2\/tags?post=267"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}