Abstract
Dissenting opinions are common in the US Supreme Court even though they take time and effort, risk infuriating colleagues, and have no precedential value. In spite of these drawbacks, dissents can potentially contribute to future legal development. We theorize that dissenting justices who use more memorable language are more successful in achieving such long-term impact. To test this theory, we amass an original dataset of citations to dissenting opinions extracted directly from majority opinion text. We further leverage these texts to build an algorithm that quantifies the distinctiveness of dissenting language within a dynamic context. Our results indicate that dissents using more negative emotion and more distinctive words are cited more in future majority opinions. These results contribute to our understanding of how language can influence long-term policy development.
Acknowledgments
We thank Steven Morgan and Rachel Fleisher for research assistance and Robert Hume for helpful comments.
Appendix A
Word Stems Excluded from LIWC Emotion Categories.
Negative emotion | Positive emotion |
---|---|
abandon* | accept |
advers* | accepta* |
aggravat* | Accepted |
argu* | Accepting |
assault* | accepts |
careless* | agree |
complain* | attachment* |
defect* | award* |
defenc* | benefit |
defens* | care |
gross* | convinc* |
harass* | faith* |
hostil* | forgiv* |
neglect* | free* |
pain | profit* |
prejudic* | satisf* |
resign* | secur* |
victim* | trust* |
value | |
valued | |
values | |
valuing |
*All words with these stems and various suffixes were counted.
Modified LIWC Positive Emotion Dictionary.
active* | cherish* | enjoy* | gorgeous* | importan* | okay | rich* | terrific* |
admir* | chuckl* | entertain* | grace | impress* | okays | rofl | thank |
ador* | clever* | enthus* | graced | improve* | oks | romanc* | thanked |
advantag* | comed* | excel* | graceful* | improving | openminded* | romantic* | thankf* |
adventur* | comfort* | excit* | graces | incentive* | openness | safe* | thanks |
affection* | commitment* | fab | graci* | innocen* | opport* | save | thoughtful* |
agreeab* | compassion* | fabulous* | grand | inspir* | optimal* | scrumptious* | thrill* |
agreed | compliment* | fantastic* | grande* | intell* | optimi* | sentimental* | toleran* |
agreeing | confidence | favor* | gratef* | interest* | original | share | tranquil* |
agreement* | confident | favour* | grati* | invigor* | outgoing | shared | treasur* |
agrees | confidently | fearless* | great | joke* | painl* | shares | treat |
alright* | considerate | festiv* | grin | joking | palatabl* | sharing | triumph* |
amaz* | contented* | fiesta* | grinn* | joll* | paradise | silli* | true |
amor* | contentment | fine | grins | joy* | partie* | silly | trueness |
amus* | cool | flatter* | ha | keen* | party* | sincer* | truer |
aok | courag* | flawless* | haha* | kidding | passion* | smart* | truest |
appreciat* | create* | flexib* | handsom* | kindly | peace* | smil* | truly |
assur* | creati* | flirt* | happi* | kindn* | perfect* | sociab* | truth* |
attract* | credit* | fond | happy | kiss* | play | soulmate* | useful* |
awesome | cute* | fondly | harmless* | laidback | played | special | valuabl* |
beaut* | cutie* | fondness | harmon* | laugh* | playful* | splend* | vigor* |
beloved | daring | forgave | heartfelt | libert* | playing | strength* | vigour* |
benefic* | darlin* | free | heartwarm* | likeab* | plays | strong* | virtue* |
benefit | dear* | freeb* | heaven* | liked | pleasant* | succeed* | virtuo* |
benefitt* | definite | freed* | heh* | likes | please* | success* | vital* |
benevolen* | definitely | freeing | helper* | liking | pleasing | sunnier | warm* |
benign* | delectabl* | freely | helpful* | livel* | pleasur* | sunniest | wealth* |
best | delicate* | freeness | helping | lmao | popular* | sunny | welcom* |
better | delicious* | freer | helps | lol | positiv* | sunshin* | well |
bless* | deligh* | frees* | hero* | love | prais* | super | win |
bold* | determina* | friend* | hilarious | loved | precious* | superior* | winn* |
bonus* | determined | fun | hoho* | lovely | prettie* | support | wins |
brave* | devot* | funn* | honest* | lover* | pretty | supported | wisdom |
bright* | digni* | genero* | honor* | loves | pride | supporter* | wise* |
brillian* | divin* | gentle | honour* | loving* | privileg* | supporting | won |
calm* | dynam* | gentler | hope | loyal* | prize* | supportive* | wonderf* |
cared | eager* | gentlest | hoped | luck | promis* | supports | worship* |
carefree | ease* | gently | hopeful | lucked | proud* | suprem* | worthwhile |
careful* | easie* | giggl* | hopefully | lucki* | radian* | sure* | wow* |
cares | easily | giver* | hopefulness | lucks | readiness | surpris* | yay |
caring | easiness | giving | hopes | lucky | ready | sweet | yays |
casual | easing | glad | hoping | madly | reassur* | sweetheart* | |
casually | easy* | gladly | hug | magnific* | relax* | sweetie* | |
certain* | ecsta* | glamor* | hugg* | merit* | relief | sweetly | |
challeng* | efficien* | glamour* | hugs | merr* | reliev* | sweetness* | |
champ* | elegan* | glori* | humor* | neat* | resolv* | sweets | |
charit* | encourag* | glory | humour* | nice* | respect | talent* | |
charm* | energ* | good | hurra* | nurtur* | revigor* | tehe | |
cheer* | engag* | goodness | ideal* | ok | reward* | tender* |
Modified LIWC Negative Emotion Dictionary.
abuse* | critici* | dwell* | griev* | kill* | numb* | rude* | stubborn* | uneas* |
abusi* | crude* | egotis* | grim* | lame* | obnoxious* | ruin* | stunk | unfortunate* |
ache* | cruel* | embarrass* | grouch* | lazie* | obsess* | sad | stunned | unfriendly |
aching | crushed | emotional | grr* | lazy | offence* | sadde* | stuns | ungrateful* |
afraid | cry | empt* | guilt* | liabilit* | offend* | sadly | stupid* | unhapp* |
aggress* | crying | enemie* | harm | liar* | offens* | sadness | stutter* | unimportant |
agitat* | cunt* | enemy* | harmed | lied | outrag* | sarcas* | submissive* | unimpress* |
agoniz* | cut | enrag* | harmful* | lies | overwhelm* | savage* | suck | unkind |
agony | cynic | envie* | harming | lone* | pained | scare* | sucked | unlov* |
alarm* | damag* | envious | harms | longing* | painf* | scaring | sucker* | unpleasant |
alone | damn* | envy* | hate | lose | paining | scary | sucks | unprotected |
anger* | danger* | evil* | hated | loser* | pains | sceptic* | sucky | unsavo* |
angr* | daze* | excruciat* | hateful* | loses | panic* | scream* | suffer | unsuccessful* |
anguish* | decay* | exhaust* | hater* | losing | paranoi* | screw* | suffered | unsure* |
annoy* | defeat* | fail* | hates | loss* | pathetic* | selfish* | sufferer* | unwelcom* |
antagoni* | degrad* | fake | hating | lost | peculiar* | serious | suffering | upset* |
anxi* | depress* | fatal* | hatred | lous* | perver* | seriously | suffers | uptight* |
apath* | depriv* | fatigu* | heartbreak* | low* | pessimis* | seriousness | suspicio* | useless* |
appall* | despair* | fault* | heartbroke* | luckless* | petrif* | severe* | tantrum* | vain |
apprehens* | desperat* | fear | heartless* | ludicrous* | pettie* | shake* | tears | vanity |
argh* | despis* | feared | hell | lying | petty* | shaki* | teas* | vicious* |
arrogan* | destroy* | fearful* | hellish | mad | phobi* | shaky | temper | vile |
asham* | destruct* | fearing | helpless* | maddening | piss* | shame* | tempers | villain* |
asshole* | devastat* | fears | hesita* | madder | piti* | shit* | tense* | violat* |
attack* | devil* | feroc* | hit | maddest | pity* | shock* | tensing | violent* |
aversi* | difficult* | feud* | homesick* | maniac* | poison* | shook | tension* | vulnerab* |
avoid* | disadvantage* | fiery | hopeless* | masochis* | pressur* | shy* | terribl* | vulture* |
awful | disagree* | fight* | horr* | melanchol* | prick* | sicken* | terrified | war |
awkward* | disappoint* | fired | humiliat* | mess | problem* | sin | terrifies | warfare* |
bad | disaster* | flunk* | hurt* | messy | protest | sinister | terrify | warred |
bashful* | discomfort* | foe* | idiot* | miser* | protested | sins | terrifying | warring |
bastard* | discourag* | fool* | ignor* | miss | protesting | skeptic* | terror* | wars |
battl* | disgust* | forbid* | immoral* | missed | puk* | slut* | thief | weak* |
beaten | dishearten* | fought | impatien* | misses | punish* | smother* | thieve* | weapon* |
bitch* | disillusion* | frantic* | impersonal | missing | rage* | smug* | threat* | weep* |
bitter* | dislike | freak* | impolite* | mistak* | raging | snob* | ticked | weird* |
blam* | disliked | fright* | inadequa* | mock | rancid* | sob | timid* | wept |
bore* | dislikes | frustrat* | indecis* | mocked | rape* | sobbed | tortur* | whine* |
boring | disliking | fuck | ineffect* | mocker* | raping | sobbing | tough* | whining |
bother* | dismay* | fucked* | inferior* | mocking | rapist* | sobs | traged* | whore* |
broke | dissatisf* | fucker* | inhib* | mocks | rebel* | solemn* | tragic* | wicked* |
brutal* | distract* | fuckin* | insecur* | molest* | reek* | sorrow* | trauma* | wimp* |
burden* | distraught | fucks | insincer* | mooch* | regret* | sorry | trembl* | witch |
cheat* | distress* | fume* | insult* | moodi* | reject* | spite* | trick* | woe* |
confront* | distrust* | fuming | interrup* | moody | reluctan* | stammer* | trite | worr* |
confus* | disturb* | furious* | intimidat* | moron* | remorse* | stank | trivi* | worse* |
contempt* | domina* | fury | irrational* | mourn* | repress* | startl* | troubl* | worst |
contradic* | doom* | geek* | irrita* | murder* | resent* | steal* | turmoil | worthless* |
crap | dork* | gloom* | isolat* | nag* | restless* | stench* | ugh | wrong* |
crappy | doubt* | goddam* | jaded | nast* | revenge* | stink* | ugl* | yearn* |
craz* | dread* | gossip* | jealous* | needy | ridicul* | strain* | unattractive | |
cried | dull* | grave* | jerk | nerd* | rigid* | strange | uncertain* | |
cries | dumb* | greed* | jerked | nervous* | risk* | stress* | uncomfortabl* | |
critical | dump* | grief | jerks | neurotic* | rotten | struggl* | uncontrol* |
The change in the predicted probability of a non-negative citation from Model 1 when moving each dichotomous variable from 0 to 1 and moving each continuous variable from its 25th percentile to its 75th percentile (while the age of the dissent is fixed at nine, the median age of a cited dissent, and all other variables are held at their median).
Change | 95% CI | |
---|---|---|
Negative emotion words | 0.0005 | [0.0002, 0.0008] |
Positive emotion words | 0.0004 | [−0.0001, 0.0008] |
Distinctive words | 0.0005 | [0.0001, 0.0009] |
“I Dissent” | −0.0007 | [−0.0015, 0.0002] |
First person pronouns | 0.0001 | [−0.0002, 0.0004] |
Case specific language | −0.0011 | [−0.0018, −0.0004] |
ln(Word count) | 0.0051 | [0.0037, 0.0066] |
3 Dissenting votes (compared to 4) | −0.0006 | [−0.0014, 0.0002] |
2 Dissenting votes (compared to 4) | −0.0016 | [−0.0026, −0.0006] |
1 Dissenting votes (compared to 4) | −0.0026 | [−0.0037, −0.0014] |
Ideological distance | −0.0015 | [−0.0022, −0.0007] |
Prop. of same issue on docket | 0.0007 | [0.0001, 0.0013] |
Age of dissent | −0.0028 | [−0.0037, −0.0020] |
The relevant 95% confidence interval appears in brackets next to each predicted change.
Appendix B: Coding Rules to Identify Negative Citations
A majority opinion’s citation to a dissent was classified as a negative citation (and therefore excluded from our analysis) if, and only if, one of the three following criteria were met:
The majority opinion cited a dissent in order to explicitly reject its reasoning.
The majority opinion only referenced the dissent to note that its reasoning had been rejected by a majority of the Court in the past.
The citation was prefaced with a “but see” signal (which indicates a source directly contradicts a stated proposition, see The Bluebook: A Uniform System of Legal Citation, Rule 1.2).
Only 6.1% of citations in our dataset fit one of these three criteria.
References
Abrams, D. E. (2017) “References to Football in Judicial Opinions and Written Advocacy,” Journal of the Missouri Bar, 73:34–38.Search in Google Scholar
Aldisert, R. J. (2009) Opinion Writing. Bloomington, IN: AuthorHouse.Search in Google Scholar
Baird, V. and T. Jacobi (2009) “How the Dissent Becomes the Majority: Using Federalism to Transform Coalitions in the US Supreme Court,” Duke Law Journal, 59(2):183–238.10.2139/ssrn.846585Search in Google Scholar
Baum, L. (1997) The Puzzle of Judicial Behavior. Ann Arbor, MI: University of Michigan Press.10.3998/mpub.14435Search in Google Scholar
Black, R. C. and J. F. Spriggs (2013) “The Citation and Depreciation of US Supreme Court Precedent.” Journal of Empirical Legal Studies, 10(2):325–358.10.1111/jels.12012Search in Google Scholar
Black, R. C., R. J. Owens, J. Wedeking and P. C. Wohlfarth (2016) US Supreme Court Opinions and Their Audiences. Cambridge: Cambridge University Press.10.1017/CBO9781316480366Search in Google Scholar
Bryan, A. C. and E. M. Ringsmuth (2016) “Jeremiad or Weapon of Words,” Journal of Law and Courts, 3(Spring):159–185.10.1086/684788Search in Google Scholar
Carson, H. L. (1894) “Great Dissenting Opinions,” Annual Report of the American Bar Association, 17:273–298.Search in Google Scholar
Carter, D. B. and C. S. Signorino (2010) “Back to the Future: Modeling Time Dependence in Binary Data,” Political Analysis, 18(3):271–292.10.1093/pan/mpq013Search in Google Scholar
Chemerinsky, E. (2000) “The Jurisprudence of Justice Scalia: A Critical Apprasial,” University of Hawai’i Law Review, 22:384–401.Search in Google Scholar
Chemerinsky, E. (2015) The Case Against the Supreme Court. London: Penguin Books.Search in Google Scholar
Chong, D. and J. N. Druckman (2007) “Framing Theory,” Annual Review of Political Science, 10:103.10.1146/annurev.polisci.10.072805.103054Search in Google Scholar
Civettini, A. J. W. and D. P. Redlawsk (2009) “Voters, Emotions, and Memory,” Political Psychology, 30(1):125–151.10.1111/j.1467-9221.2008.00683.xSearch in Google Scholar
Clark, T. S. and D. A. Linzer (2015) “Should I Use Fixed or Random Effects?” Political Science Research and Methods, 3(2):399–408.10.1017/psrm.2014.32Search in Google Scholar
Coscia, M. (2014) “Average is Boring: How Similarity Kills a Meme’s Success,” Scientific Reports, 4:6744.10.1038/srep06477Search in Google Scholar
Danescu-Niculescu-Mizil, C., J. Cheng, J. Kleinberg and L. Lee (2012) “You Had Me at Hello: How Phrasing Affects Memorability.” ACL ’12 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers, 1:892–901.Search in Google Scholar
D’Argembeau, A. and M. Van der Linden (2005) “Influence of Emotion on Memory for Temporal Information,” Emotion, 5(4):503–507.10.1037/1528-3542.5.4.503Search in Google Scholar
Epstein, L. and A. D. Martin (2010) “Does Public Opinion Influence the Supreme Court? Possibly Yes (But We’re Not Sure Why),” University of Pennsylvania Journal of Constitutional Law, 13:263–281.Search in Google Scholar
Epstein, L., J. A. Segal and H. J. Spaeth (2001) “The Norm of Consensus on the US Supreme Court,” American Journal of Political Science, 45(2):362–377.10.2307/2669346Search in Google Scholar
Epstein, L., W. M. Landes and R. A. Posner (2011) “Why (and When) Judges Dissent: A Theoretical and Empirical Analysis,” Journal of Legal Analysis, 3(1):101–137.10.1093/jla/3.1.101Search in Google Scholar
Garner, B. A., C. Bea, R. W. Berch, N. M. Gorsuch, H. L. Hartz, N. L. Hecht, B. M. Kavanaugh, A. Kozinski, S. L. Lynch, W. H. Pryor Jr., T. M. Reavley, J. S. Sutton and D. Wood (2016) The Law of Judicial Precedent. London: Thomson Reuters.Search in Google Scholar
Hand, L. (1958) The Bill of Rights. Cambridge, MA: Harvard University Press.10.4159/harvard.9780674332294Search in Google Scholar
Hansford, T. G. and J. F. Spriggs II (2006) The Politics of Precedent on the US Supreme Court. Princeton, NJ: Princeton University Press.10.1515/9780691188041Search in Google Scholar
Hinkle, R. K. (2015) “Legal Constraint in the US Courts of Appeals,” Journal of Politics, 77:721–735.10.1086/681059Search in Google Scholar
Kahn, J. H., R. M. Tobin, A. E. Massey and J. A. Anderson (2007) “Measuring Emotional Expression with the Linguistic Inquiry and Word Count,” The American Journal of Psychology, 120(2):263–286.10.2307/20445398Search in Google Scholar
Kern, R. P., T. M. Libkuman, H. Otani and K. Holmes (2005) “Emotional Stimuli, Divided Attention, and Memory,” Emotion, 5(4):408–417.10.1037/1528-3542.5.4.408Search in Google Scholar
Maltzman, F., J. F. Spriggs II and P. J. Wahlbeck (2000) Crafting Law on the Supreme Court: The Collegial Game. Cambridge: Cambridge University Press.Search in Google Scholar
Martin, A. D. and K. M. Quinn (2002) “Dynamic Ideal Point Estimation Via Markov Chain Monte Carlo for the US Supreme Court, 1953–1999,” Political Analysis, 10(2):134–153.10.1093/pan/10.2.134Search in Google Scholar
McGaugh, J. L. (2003) Memory and Emotion: The Making of Lasting Memories. New York, NY: Columbia University Press.Search in Google Scholar
Note (2011) “From Consensus to Collegiality: The Origins of the ‘Respectful’ Dissent,” Harvard Law Review, 124:1305–1326.Search in Google Scholar
Pennebaker, J. W., R. J. Booth and M. E. Francis (2007) “Linguistic Inquiry and Word Count: LIWC [Computer software].” Austin, TX: liwc.net.Search in Google Scholar
Peterson, S. A. (1981) “Dissent in American Courts,” Journal of Politics, 43(2):412–434.10.2307/2130375Search in Google Scholar
Pound, R. (1953) “Cacoethes Dissentiendi: The Heated Judicial Dissent,” American Bar Association Journal, 39(9):794–797.Search in Google Scholar
Prior, M. (2008) “The Incumbent in the Living Room: The Rise of Television and the Incumbency Advantage in US House Elections,” Journal of Politics, 68(3):657–673.10.1111/j.1468-2508.2006.00452.xSearch in Google Scholar
Senior, J. (2013) “In Conversation: Antonin Scalia,” New York. Available at http://nymag.com/news/features/antonin-scalia-2013-10. Accessed 4 Oct. 2016.Search in Google Scholar
Vloet, K. (2015) “Justice Ginsburg: ‘I Like to Think Most of My Dissents Will Be the Law Someday’.” 6 Feb. Available at https://www.law.umich.edu/newsandinfo/features/Pages/ginsburglecture020615.aspx. Accessed 20 Dec. 2016.Search in Google Scholar
Wahlbeck, P. J. and J. F. Spriggs II (1999) “The Politics of Dissents and Concurrences on the US Supreme Court,” American Politics Research, 27(4):488.10.1177/1532673X99027004006Search in Google Scholar
Wald, P. M. (1995) “The Rhetoric of Results and the Results of Rhetoric: Judiical Writings,” University of Chicago Law Review, 62(4):1371–1419.10.2307/1600107Search in Google Scholar
Article note:
Replication files are available at http://rachaelkhinkle.com/research.html.
©2017 Walter de Gruyter GmbH, Berlin/Boston
Articles in the same Issue
- Frontmatter
- Editor’s Note
- Editor’s Note
- Articles
- Unpacking Big Data in Education. A Research Framework
- A Semi-automatic Method to Retrieve Twitter Accounts
- Themes and Topics in Parliamentary Oversight Hearings: A New Direction in Textual Data Analysis
- How to Lose Cases and Influence People
- Policy and Voting
- Examining the Policy Learning Dynamics of Atypical Policies with an Application to State Preemption of Local Dog Laws
- Voting in Nigeria: Determinants of Turnout in the 2015 Presidential Election
Articles in the same Issue
- Frontmatter
- Editor’s Note
- Editor’s Note
- Articles
- Unpacking Big Data in Education. A Research Framework
- A Semi-automatic Method to Retrieve Twitter Accounts
- Themes and Topics in Parliamentary Oversight Hearings: A New Direction in Textual Data Analysis
- How to Lose Cases and Influence People
- Policy and Voting
- Examining the Policy Learning Dynamics of Atypical Policies with an Application to State Preemption of Local Dog Laws
- Voting in Nigeria: Determinants of Turnout in the 2015 Presidential Election