{"id":579,"date":"2010-05-20T18:22:18","date_gmt":"2010-05-20T22:22:18","guid":{"rendered":"http:\/\/businessconflictmanagement.com\/blog\/?p=579"},"modified":"2010-05-20T18:22:18","modified_gmt":"2010-05-20T22:22:18","slug":"psychological-barriers-to-accurate-risk-assessment","status":"publish","type":"post","link":"http:\/\/www.businessconflictmanagement.com\/blog\/2010\/05\/psychological-barriers-to-accurate-risk-assessment\/","title":{"rendered":"Psychological Barriers to Accurate Risk Assessment"},"content":{"rendered":"<p class=\"MsoNormal\" style=\"text-align: center;\">\n<p class=\"MsoNormal\" style=\"margin: 0in 0in 0pt;\">A recent article has been making the rounds of ADR professionals.<span style=\"mso-spacerun: yes;\"> <\/span>The current issue of the American Psychological Association\u2019s publication <em style=\"mso-bidi-font-style: normal;\">Psychology, Public Policy and Law<\/em> (Vol. 16, No. 2, at 133-57) features a report of a study conducted by a group of scholars from Australia, Sweden and the United States.<span style=\"mso-spacerun: yes;\"> <\/span>The group canvassed 481 American attorneys \u2013 in civil and criminal cases, both plaintiffs\/prosecutors and defense \u2013 and found that lawyers are prone to overconfidence.<span style=\"mso-spacerun: yes;\"> <\/span>That is, they predict outcomes of their cases that are not only erroneous, but generally too optimistic.<\/p>\n<p class=\"MsoNormal\" style=\"margin: 0in 0in 0pt;\">I\u2019m wondering why this is news.<span style=\"mso-spacerun: yes;\"> <\/span>I think that we mediators have known this all along; in fact, that\u2019s why we\u2019re hired.<!--more--><\/p>\n<p class=\"MsoNormal\" style=\"margin: 0in 0in 0pt;\">Participants in the study each had a case expected to go to trial within 6 to 12 months.<span style=\"mso-spacerun: yes;\"> <\/span>They were asked to designate an outcome that \u201cwould be a win\u201d and then to state the probability of achieving that outcome or a better one.<\/p>\n<p class=\"MsoNormal\" style=\"margin: 0in 0in 0pt;\">After the case resolved, whether by verdict or by settlement, the participants were contacted again to determine the case outcome or resolution.<span style=\"mso-spacerun: yes;\"> <\/span>Approximately 59% of the cases were settled; 31% were tried; and 10% were dismissed.<\/p>\n<p class=\"MsoNormal\" style=\"margin: 0in 0in 0pt;\">A mean of 64% and a median of 70% of the participants expressed confidence estimates exceeding 50%.<span style=\"mso-spacerun: yes;\"> <\/span>Female lawyers tended to be overconfident only when their predicted success was high, while men tended to be overconfident whether their prediction was moderate or high probability.<span style=\"mso-spacerun: yes;\"> <\/span>Both lawyers of less experience and of greater experience exhibited the same levels of overconfidence, and there was no correlation with respect to whether trial date was a few months away or imminent.<span style=\"mso-spacerun: yes;\"> <\/span><\/p>\n<p class=\"MsoNormal\" style=\"margin: 0in 0in 0pt;\">Yet only 50% of the civil lawyers achieved their goals, though their mean confidence estimate had been 64%.<\/p>\n<p class=\"MsoNormal\" style=\"margin: 0in 0in 0pt;\">This overconfidence persisted even when an effort was made to manipulate the subjects towards more realistic predictions.<span style=\"mso-spacerun: yes;\"> <\/span>Participant attorneys were asked to generate arguments counter to their own predictions, or to give reasons for their predictions, in what the authors termed a \u201cdebiasing technique.\u201d<span style=\"mso-spacerun: yes;\"> <\/span>The participants\u2019 overconfidence did not decrease.<\/p>\n<p class=\"MsoNormal\" style=\"text-align: center;\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter\" src=\"http:\/\/uncivilsociety.org\/smug.jpg\" alt=\"\" width=\"242\" height=\"114\" \/><\/p>\n<p class=\"MsoNormal\" style=\"margin: 0in 0in 0pt;\">The authors conclude that, irrespective of their trial experience, \u201c[l]awyers frequently made substantial judgmental errors, showing a proclivity to overoptimism\u2026. Lawyers choose a desirable outcome, the anchor, and thereafter make insufficient adjustments for uncertainty even when asked to generate reasons against their initial goal.\u201d<span style=\"mso-spacerun: yes;\"> <\/span>Lawyers are poorer predictors than, say, weathermen because (a) lawyers can influence the outcome of their cases and (b) lawyers have an interest in influencing the outcome of their cases.<span style=\"mso-spacerun: yes;\"> <\/span>Meteorologists, on the other hand, neither can make it rain nor make money when it does, and thus are less prone to misinterpret the data in favor of their self-serving preconceptions.<\/p>\n<div style=\"text-align: center;\"><a href=\"http:\/\/www.google.com\/imgres?imgurl=http:\/\/images.clipartof.com\/small\/12340-Clay-Sculpture-Of-A-Weatherman-Giving-A-Five-Day-Forcast-On-The-News-Clipart-Picture.jpg&amp;imgrefurl=http:\/\/www.clipartof.com\/details\/clipart\/12340.html&amp;usg=__D7y1l3rHFOWs8IlqkKZRnCqdo1g=&amp;h=268&amp;w=450&amp;sz=68&amp;hl=en&amp;start=18&amp;itbs=1&amp;tbnid=E640Ox5yFW4tiM:&amp;tbnh=76&amp;tbnw=127&amp;prev=\/images%3Fq%3Dweatherman%2Bfunny%26hl%3Den%26gbv%3D2%26tbs%3Disch:1\"><img loading=\"lazy\" decoding=\"async\" style=\"vertical-align: bottom; border: #ccc 1px solid; padding: 1px;\" src=\"http:\/\/t0.gstatic.com\/images?q=tbn:E640Ox5yFW4tiM:http:\/\/images.clipartof.com\/small\/12340-Clay-Sculpture-Of-A-Weatherman-Giving-A-Five-Day-Forcast-On-The-News-Clipart-Picture.jpg\" alt=\"\" width=\"218\" height=\"92\" \/><\/a><\/div>\n<p class=\"MsoNormal\" style=\"margin: 0in 0in 0pt;\">I have no reason to doubt these outcomes.<span style=\"mso-spacerun: yes;\"> <\/span>I just don\u2019t think it ought to be a surprise.<span style=\"mso-spacerun: yes;\"> <\/span>And whatever the authors say about weather forecasters, overconfidence is a phenomenon shared by businesspeople, fishermen, grooms, poker players and well-diggers, not just lawyers and their clients.<span style=\"mso-spacerun: yes;\"> <\/span>And that\u2019s why God made mediators.<\/p>\n<p class=\"MsoNormal\" style=\"margin: 0in 0in 0pt;\">\n<p class=\"MsoNormal\" style=\"margin: 0in 0in 0pt;\"><img loading=\"lazy\" decoding=\"async\" class=\"alignright size-medium wp-image-7253\" title=\"god and creation\" src=\"http:\/\/samuelatgilgal.files.wordpress.com\/2009\/08\/god-and-creation.jpg?w=300&amp;h=170\" alt=\"god and creation\" width=\"300\" height=\"170\" \/>When I was first trained as a mediator, by <a href=\"http:\/\/www.jamsadr.com\/professionals\/xpqProfDet.aspx?xpST=ProfessionalDetail&amp;professional=1132&amp;ajax=no&amp;nbioID=7fd307d5-6fcd-4cf5-bbb1-377d521acab4\" target=\"_self\">Michael Lewis <\/a>and <a href=\"http:\/\/www.jamsadr.com\/singer\/\" target=\"_self\">Linda Singer<\/a>, I was taught that people \u2013 whether lawyers or their clients \u2013 suffer from cognitive dissonance and tend to ignore information that does not comport with their understanding of the facts.<span style=\"mso-spacerun: yes;\"> <\/span>Dwight Golann and I had a hard time training Chinese judges in American-style mediation in Beijing in 2005, but Dwight had no difficulty at all in discussing cognitive dissonance, which the trainees found absorbing.<\/p>\n<p class=\"MsoNormal\" style=\"margin: 0in 0in 0pt;\">In his recent book, <em style=\"mso-bidi-font-style: normal;\"><a href=\"http:\/\/www.amazon.com\/Mediating-Legal-Disputes-Dwight-Golann\/dp\/0316319899\" target=\"_self\">Mediating Legal Disputes<\/a><\/em>, Dwight discusses the \u201cendowment effect.\u201d He reports on an experiment in which people were assigned to negotiate the sale (or purchase) of a coffee mug.<span style=\"mso-spacerun: yes;\"> <\/span>Each participant was told to make a preliminary confidential estimate of the intrinsic value of the mug, and a control group of observers was asked to make the same estimate.<span style=\"mso-spacerun: yes;\"> <\/span>Those assigned to sell the mug estimated its value at $7.12; those assigned to buy it estimated its value at $2.87; and the observers valued the mug at $3.12.<\/p>\n<p class=\"MsoNormal\" style=\"margin: 0in 0in 0pt;\">Negotiation literature is chock full of illustrations of psychological obstacles to realistic appraisal.<span style=\"mso-spacerun: yes;\"> <\/span>A compelling example of cognitive distortion is related in Dwight\u2019s book as follows:<\/p>\n<blockquote>\n<p class=\"MsoNormal\" style=\"text-indent: 0.5in; margin: 0in 0in 0pt;\">S<em>tudents at Harvard Law School are preparing to negotiate the settlement of a personal injury case.<span style=\"mso-spacerun: yes;\"> <\/span>Before they begin, the students are asked to make a private prediction of their chances of winning based on their private instructions.<span style=\"mso-spacerun: yes;\"> <\/span>What the students don\u2019t know is that there is nothing confidential about the instructions: both sides have received exactly the same data, with different labels.<span style=\"mso-spacerun: yes;\"> <\/span>Because both sides have the same information, they should come out with the same answers \u2013 but this is not what occurs.<\/em><\/p>\n<p class=\"MsoNormal\" style=\"text-indent: 0.5in; margin: 0in 0in 0pt;\"><em>In fact, hundreds of law and business students told to negotiate for the plaintiff assess her chances of winning as being nearly 20 percent higher than students who are assigned to the defense.<span style=\"mso-spacerun: yes;\"> <\/span>The two sides\u2019 predictions total nearly 120 percent.<\/em><\/p>\n<p class=\"MsoNormal\" style=\"margin: 0in 0in 0pt;\"><em>Asked to estimate what damages a jury will award if the plaintiff does win, there is a similar disparity: plaintiff bargainers estimate her damages at an average of $264,000, while defense negotiators looking at the same data estimate a verdict of only $188,000.<\/em><\/p>\n<\/blockquote>\n<p class=\"MsoNormal\" style=\"margin: 0in 0in 0pt;\">There is no sense in bemoaning this data, or in adding it to the tools of the lawyer-bashers.<span style=\"mso-spacerun: yes;\"> <\/span>We are who we are; part of who we are is that our observations mature into convictions, and we defend our convictions against perceived attack. Most students of negotiation readily concede that unfacilitated bargaining is necessarily inefficient, because neither negotiator will be completely candid with the other.<span style=\"mso-spacerun: yes;\"> <\/span>A facilitator, on the other hand, can become a repository for the data that is not known by the adversary, and thus gains a perception of an economically efficient outcome that is denied the participants because of their own self-imposed constraints.<\/p>\n<p class=\"MsoNormal\" style=\"margin: 0in 0in 0pt;\">Not just lawyers make assessments based on imperfect knowledge.<span style=\"mso-spacerun: yes;\"> <\/span>Not just lawyers\u2019 assessments\u00a0are hindered by\u00a0cognitive obstacles.<span style=\"mso-spacerun: yes;\"> <\/span>And not just lawyers\u00a0benefit when\u00a0their assessments, and the assumptions underlying them, are subjected to rigorous <a href=\"http:\/\/businessconflictmanagement.com\/blog\/2010\/03\/can-you-recognize-when-youre-being-reality-tested\/\" target=\"_self\">reality testing<\/a>.<\/p>\n<p class=\"MsoNormal\" style=\"text-align: center;\"><img decoding=\"async\" src=\"http:\/\/4.bp.blogspot.com\/_iXGIO_F58e4\/Rl9VA2nTLGI\/AAAAAAAAAgs\/kCHjyUijgQI\/s400\/peanuts-theology.jpg\" alt=\"\" \/><\/p>\n","protected":false},"excerpt":{"rendered":"<p>A new study on lawyers\u2019 overconfident assessments of their cases proves not to be so new after all.<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[11,37,26],"tags":[8,38,31,27,28],"class_list":["post-579","post","type-post","status-publish","format-standard","hentry","category-conflict-resolution","category-negotiation","category-teaching","tag-adr","tag-lawyers","tag-negotiation","tag-teaching","tag-training"],"aioseo_notices":[],"_links":{"self":[{"href":"http:\/\/www.businessconflictmanagement.com\/blog\/wp-json\/wp\/v2\/posts\/579","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.businessconflictmanagement.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.businessconflictmanagement.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.businessconflictmanagement.com\/blog\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"http:\/\/www.businessconflictmanagement.com\/blog\/wp-json\/wp\/v2\/comments?post=579"}],"version-history":[{"count":0,"href":"http:\/\/www.businessconflictmanagement.com\/blog\/wp-json\/wp\/v2\/posts\/579\/revisions"}],"wp:attachment":[{"href":"http:\/\/www.businessconflictmanagement.com\/blog\/wp-json\/wp\/v2\/media?parent=579"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.businessconflictmanagement.com\/blog\/wp-json\/wp\/v2\/categories?post=579"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.businessconflictmanagement.com\/blog\/wp-json\/wp\/v2\/tags?post=579"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}