Empirical research in comparative constitutional law: The cool kid on the block or all smoke and mirrors?

Available in Russian

Price 299 Rub.

Authors: Konstantin Chatziathanasiou, Niels Petersen

DOI: 10.21128/1812-7126-2023-2-124-156

Keywords: methodology of legal research; empirical research; quantitative methods; constitutional design; constitutional rights; effectiveness of constitutional rights

Abstract

In recent years, we could observe an explosion of empirical research in the field of comparative constitutional law. This contribution seeks to evaluate the current state of affairs. It consists of four parts. The first part provides a basic introduction to quantitative empirical legal research. It identifies certain methodological challenges and discusses how to address them. The second part analyzes the literature on the institutional design choices that are made in constitutions. There is research both on the consequences of design choices and on the reasons why specific design features were included in the constitution. The third part looks at the empirical literature regarding constitutional rights, which mainly deals with the diffusion and with the effectiveness of individual rights enshrined in constitutions. In both parts, we do not aim at providing comprehensive reviews of the empirical research on comparative constitutional law. Instead, we concentrate on select studies that we consider to be particularly important and influential. The fourth part, finally, concludes by analyzing how the challenges that are particular to empirical research in constitutional law could be addressed. We find that the empirical identification strategies of many of the analyzed studies face significant unresolved challenges. These challenges concern, inter alia, the conceptualization of the measured variables and unobserved variable biases. For this reason, we should only have limited confidence in their results. Nevertheless, we argue that empirical research in comparative constitutional law is of fundamental importance. If comparative constitutional law scholars abandoned quantitative empirical projects, they would throw out the baby with the bathwater. Empirical research not only draws our attention to issues that would otherwise elude our view, but also gives us the chance to refine the methodology in order to develop better strategies to answer some of the decisive questions preoccupying comparative constitutional law scholarship. We therefore advocate not less, but more empirical research, while, at the same time, calling for more methodological pluralism.

About the authors: Konstantin Chatziathanasiou – Postdoctoral Research Fellow, Institute for International and Comparative Public Law, University of Münster, Münster, Germany; Visiting Researcher, Max Planck Institute for Research on Collective Goods, Bonn, Germany; Niels Petersen – Co-director, Institute for International and Comparative Public Law and Professor of Public Law, University of Münster, Münster, Germany; Research Affiliate, Max Planck Institute for Research on Collective Goods, Bonn, Germany.

Citation: Petersen N., Chatziathanasiou K. (2023) Empiricheskie issledovaniya v sravnitel’nom konstitutsionnom prave: krutoy paren’ “na rayone” ili sploshnye illyuzii? [Empirical research in comparative constitutional law: The cool kid on the block or all smoke and mirrors?]. Sravitel’noe konstitutsionnoe obozrenie, vol. 32, no. 2, pp. 124–151. (In Russian).

References

Acemoglu D. (2005) Constitutions, Politics, and Economics: A Review Essay on Persson and Tabellini’s The Economic Effects of Constitutions. Journal of Economic Literature, vol. 43, no. 4, pp. 1025–1048.

Acemoglu D., Johnson S., Robinson J.A., Yared P. (2008) Income and Democracy. American Economic Review, vol. 98, no. 3, pp. 808–842.

Acemoglu D., Robinson J.A. (2006) Economic Origins of Dictatorship and Democracy, Cambridge; New York: Cambridge University Press.

Ackerman B.A. (1989) Constitutional Politics/Constitutional Law. The Yale Law Journal, vol. 99, no. 3, pp. 453–548.

Ackerman B.A. (1984) The Storrs Lectures: Discovering the Constitution. The Yale Law Journal, vol. 93, no. 6, pp. 1013–1072.

Ackerman B.A. (1991) We the People: Foundations, Cambridge, MA: Belknap Press of Harvard University Press.

Ahmed D.I., Ginsburg T. (2014) Constitutional Islamization and Human Rights: The Surprising Origin and Spread of Islamic Supremacy in Constitutions. Virginia Journal of International Law, vol. 54, no. 3, pp. 615–696.

Angrist J.D., Pischke J.-S. (2009) Mostly Harmless Econometrics: An Empiricist’s Companion, Princeton, NJ: Princeton University Press.

Arceneaux K., Gerber A.S., Green D.P. (2006) Comparing Experimental and Matching Methods Using a Large-Scale Voter Mobilization Experiment. Political Analysis, vol. 14, no. 1, pp. 37–62.

Barro R.J. (1996) Democracy and Growth. Journal of Economic Growth, vol. 1, no. 1, pp. 1–27.

Barro R.J. (1999) Determinants of Democracy. Journal of Political Economy, vol. 107, no. S6, pp. S158-S183.

Bellamy R. (2007) Political Constitutionalism: A Republican Defence of the Constitutionality of Democracy, Cambridge: Cambridge University Press.

Benvenisti E. (2008) Reclaiming Democracy: The Strategic Uses of Foreign and International Law by National Courts. American Journal of International Law, vol. 102, no. 2, pp. 241–274.

Bezemek Ch. (2016) Grundrechte in der Rechtsprechung der Höchstgerichte: allgemeiner Teil, Fundamentalgarantien, Freiheitsrechte, Gleichheitsrechte, Wahl- und Petitionsrecht, Wien: Facultas.

Bickel A.M. (1962) The Least Dangerous Branch: The Supreme Court at the Bar of Politics, Indianapolis, IN: Bobbs-Merrill.

Bjørnskov C., Voigt S. (2018) The Architecture of Emergency Constitutions. International Journal of Constitutional Law, vol. 16, no. 1, pp. 101–127.

Black R.C., Owens R.J., Brookhart J.L. (2014) We Are the World: The U.S. Supreme Court’s Use of Foreign Sources of Law. The British Journal of Political Science, vol. 46, no. 4, pp. 891–913.

Blume L., Müller J., Voigt S., Wolf C. (2009) The Economic Effects of Constitutions: Replicating – and Extending – Persson and Tabellini. Public Choice, vol. 139, no. 1–2, pp. 197–225.

Boix C., Stokes S.C. (2003) Endogenous Democratization. World Politics, vol. 55, no. 4, pp. 517–549.

Bollen K.A. (1979) Political Democracy and the Timing of Development. American Sociological Review, vol. 44, no. 4, pp. 572–587.

Bollen K.A. (1989) Structural Equations with Latent Variables, New York: Wiley.

Bollen K.A., Jackman R.W. (1985) Economic and Noneconomic Determinants of Political Democracy in the 1960s. Research in Political Sociology, vol. 1, no. 1, pp. 27–48.

Bork R.H. (1971) Neutral Principles and Some First Amendment Problems. Indiana Law Journal, vol. 47, no. 1, pp. 1–35.

Bork R.H. (1990) The Tempting of America: The Political Seduction of the Law, New York: Free Press; London: Collier Macmillan.

Camerer C., Talley E. (2007) Experimental Study of Law and Economics. In: Polinsky A.M., Shavell S. (eds.) Handbook of Law and Economics, vol. 2, Amsterdam; Boston, MA: North-Holland, pp. 1619–1650.

Chatziathanasiou K. (2019) Verfassungsstabilität: eine von Artikel 146 Grundgesetz ausgehende juristische und (experimental-)ökonomische Untersuchung, Tübingen: Mohr Siebeck.

Chilton A., Versteeg M. (2017) Rights without Resources: The Impact of Constitutional Social Rights on Social Spending. The Journal of Law and Economics, vol. 60, no. 4, pp. 713–748.

Chilton A.S., Versteeg M. (2015) The Failure of Constitutional Torture Prohibitions. The Journal of Legal Studies, vol. 44, no. 2, pp. 417–452.

Chilton A.S., Versteeg M. (2016) Do Constitutional Rights Make a Difference? American Journal of Political Science, vol. 60, no. 3, pp. 575–589.

Chilton A.S., Versteeg M. (2018) Courts’ Limited Ability to Protect Constitutional Rights. The University of Chicago Law Review, vol. 85, no. 2, pp. 293–336.

Cingranelli D.L., Richards D.L. (1999) Measuring the Level, Pattern, and Sequence of Government Respect for Physical Integrity Rights. International Studies Quarterly, vol. 43, no. 2, pp. 407–417.

Cingranelli D.L., Richards D.L. (2010) The Cingranelli and Richards (CIRI) Human Rights Data Project. Human Rights Quarterly, vol. 32, no. 2, pp. 401–424.

Cross F.B. (1999) The Relevance of Law in Human Rights Protection. International Review of Law and Economics, vol. 19, no. 1, pp. 87–98.

Davenport C.A. (1996) “Constitutional Promises” and Repressive Reality: A Cross-National Time-Series Investigation of Why Political and Civil Liberties are Suppressed. The Journal of Politics, vol. 58, no. 3, pp. 627–654.

Davis J.A. (1985) The Logic of Causal Order, Beverly Hills, CA: Sage Publications.

Diamond L. (1992) Economic Development and Democracy Reconsidered. In: Marks G., Diamond L. (eds.) Reexamining Democracy: Essays in Honor of Seymour Martin Lipset, Newbury Park, CA: Sage Publications, pp. 93–139.

Dixon R., Holden R. (2012) Constitutional Amendment Rules. In: Ginsburg T. (ed.) Comparative Constitutional Design, Cambridge: Cambridge University Press, pp. 195–218.

Dworkin R. (1996) Freedom’s Law: The Moral Reading of the American Constitution, Cambridge, MA: Harvard University Press.

Elkins Z., Ginsburg T., Melton J. (2009) The Endurance of National Constitutions, Cambridge; New York: Cambridge University Press.

Elkins Z., Ginsburg T., Melton J. (2012) Comments on Law and Versteeg’s The Declining Influence of the United States Constitution. New York University Law Review, vol. 87, no. 6, pp. 2088–2101.

Elkins Z., Ginsburg T., Simmons B.A. (2013) Getting to Rights: Treaty Ratification, Constitutional Convergence, and Human Rights Practice. Harvard International Law Journal, vol. 54, no. 1, pp. 61–96.

Ely J.H. (1980) Democracy and Distrust: A Theory of Judicial Review, Cambridge, MA: Harvard University Press.

Engel C. (2013) Legal Experiments: Mission Impossible? The Hague: Eleven International Publishing.

Epstein D.L. et al. (2006) Democratic Transitions. American Journal of Political Science, vol. 50, no. 3, pp. 551–569.

Epstein L., King G. (2002) The Rules of Inference. University of Chicago Law Review, vol. 69, no. 1, pp. 1–133.

Falk A., Heckman J.J. (2009) Lab Experiments Are a Major Source of Knowledge in the Social Sciences. Science, vol. 326, no. 5952, pp. 535–538.

Feld L.P., Voigt S. (2003) Economic Growth and Judicial Independence: Cross-Country Evidence Using a New Set of Indicators. European Journal of Political Economy, vol. 19, no. 3, pp. 497–527.

Fox J., Flores D. (2009) Religions, Constitutions, and the State: A Cross-National Study. The Journal of Politics, vol. 71, no. 4, pp. 1499–1513.

Ginsburg T., Chernykh S., Elkins Z. (2008) Commitment and Diffusion: How and Why National Constitutions Incorporate International Law. University of Illinois Law Review, no. 1, pp. 201–238.

Ginsburg T., Elkins Z., Melton J. (2012) Do Executive Term Limits Cause Constitutional Crises? In: Ginsburg T. (ed.) Comparative Constitutional Design, Cambridge: Cambridge University Press, pp. 350–379.

Ginsburg T., Huq A.Z. (2018) How to Save a Constitutional Democracy, Chicago; London: The University of Chicago Press.

Ginsburg T., Melton J. (2015) Does the Constitutional Amendment Rule Matter at All? Amendment Cultures and the Challenges of Measuring Amendment Difficulty. International Journal of Constitutional Law, vol. 13, no. 3, pp. 686–713.

Ginsburg T., Versteeg M. (2014) Why Do Countries Adopt Constitutional Review? The Journal of Law, Economics and Organization, vol. 30, no. 3, pp. 587–622.

Goderis B., Versteeg M. (2014) The Diffusion of Constitutional Rights. International Review of Law and Economics, vol. 39, pp. 1–19.

Goderis B., Versteeg M. (2012) Human Rights Violations after 9/11 and the Role of Constitutional Constraints. The Journal of Legal Studies, vol. 41, no. 1, pp. 131–164.

Goldstein R.J. (1992) The Limitations of Using Quantitative Data in Studying Human Rights Abuses. In: Jabine T.B., Claude R.P. (eds.) Human Rights and Statistics: Getting the Record Straight, Philadelphia, PA: University of Pennsylvania Press, pp. 35–61.

Goodman R., Jinks D. (2003) Measuring the Effects of Human Rights Treaties. European Journal of International Law, vol. 14, no. 1, pp. 171–183.

Hall R.E., Jones C.I. (1999) Why Do Some Countries Produce So Much More Output per Worker than Others? The Quarterly Journal of Economics, vol. 114, no. 1, pp. 83–116.

Hathaway O.A. (2001) Do Human Rights Treaties Make a Difference? The Yale Law Journal, vol. 111, no. 8, pp. 1935–2042.

Hayo B., Voigt S. (2007) Explaining De Facto Judicial Independence. International Review of Law and Economics, vol. 27, no. 3, pp. 269–290.

Hayo B., Voigt S. (2016) Explaining Constitutional Change: The Case of Judicial Independence. International Review of Law and Economics, vol. 48, pp. 1–13.

Hein M. (2019) Impeding Constitutional Amendments: Why Are Entrenchment Clauses Codified in Contemporary Constitutions? Acta Politica, vol. 54, no. 2, pp. 196–224.

Hirschl R. (2014) Comparative Matters: The Renaissance of Comparative Constitutional Law, Oxford: Oxford University Press.

Innes J.E. (1992) Human Rights Reporting as a Policy Tool: An Examination of the State Department Country Reports. In: Jabine T.B., Claude R.P. (eds.) Human Rights and Statistics: Getting the Record Straight, Philadelphia, PA: University of Pennsylvania Press, pp. 235–257.

Issacharoff S. (2011) Constitutional Courts and Democratic Hedging. Georgetown Law Journal, vol. 99, no. 4, pp. 961–1012.

Issacharoff S. (2015) Fragile Democracies: Contested Power in the Era of Constitutional Courts, New York: Cambridge University Press.

Issacharoff S., Morrison T. (2020) Constitution by Convention. California Law Review, vol. 108, no. 6, pp. 1913–1954.

Jackson V.C. (2012) Comment on Law and Versteeg. New York University Law Review, vol. 87, no. 6, pp. 2102–2117.

Keith L.C. (2002) Constitutional Provisions for Individual Human Rights (1977–1996): Are They More than Mere “Window Dressing?” Political Research Quarterly, vol. 55, no. 1, pp. 111–143.

Keith L.C., Tate C.N., Poe S.C. (2009) Is the Law a Mere Parchment Barrier to Human Rights Abuse? The Journal of Politics, vol. 71, no. 2, pp. 644–660.

Kramer L.D. (2004) The People Themselves: Popular Constitutionalism and Judicial Review, New York: Oxford University Press.

Kyritsis D. (2006) Representation and Waldron’s Objection to Judicial Review. Oxford Journal of Legal Studies, vol. 26, no. 4, pp. 733–751.

La Porta R., Lopez-de-Silanes F., Shleifer A., Vishny R. (1999) The Quality of Government. The Journal of Law, Economics and Organization, vol. 15, no. 1, pp. 222–279.

Law D.S. (2010) Constitutions. In: Cane P., Kritzer H.M. (eds.) The Oxford Handbook of Empirical Legal Research, Oxford; New York: Oxford University Press, pp. 376–398.

Law D.S., Chang W.-C. (2011) The Limits of Global Judicial Dialogue. Washington Law Review, vol. 86, no. 3, pp. 523–578.

Law D.S., Versteeg M. (2011) The Evolution and Ideology of Global Constitutionalism. California Law Review, vol. 99, no. 5, pp. 1163–1258.

Law D.S., Versteeg M. (2012) The Declining Influence of the United States Constitution. New York University Law Review, vol. 87, no. 3, pp. 762–858.

Liptak A. (2012) “We the People” Loses Appeal with People around the World. The New York Times, 6 February. Available at: https://nyti.ms/3vj1Lwv (accessed 30.03.2023).

Londregan J.B., Poole K.T. (1996) Does High Income Promote Democracy? World Politics, vol. 49, no. 1, pp. 1–30.

Lopez G.A., Stohl M. (1992) Problems of Concept and Measurement in the Study of Human Rights. In: Jabine T.B., Claude R.P. (eds.) Human Rights and Statistics: Getting the Record Straight, Philadelphia, PA: University of Pennsylvania Press, pp. 216–234.

Mak E. (2011) Why Do Dutch and UK Judges Cite Foreign Law? The Cambridge Law Journal, vol. 70, no. 2, pp. 420–450.

Mak E. (2013) Globalisation of the National Judiciary and the Dutch Constitution. Utrecht Law Review, vol. 9, no. 2, pp. 36–51.

Marshall M.G., Jaggers K. (2009) Polity IV Project: Political Regime Characteristics and Transitions, 1800–2007, College Park, MD: Center for International Development and Conflict Management.

McCrudden C. (2000) A Common Law of Human Rights?: Transnational Judicial Conversations on Constitutional Rights. Oxford Journal of Legal Studies, vol. 20, no. 4, pp. 499–532.

Melton J. (2014) Do Constitutional Rights Matter? The Relationship between De Jure and De Facto Human Rights Protection. Working Paper, London: University College London.

Melton J., Elkins Z., Ginsburg T., Leetaru K. (2013) On the Interpretability of Law: Lessons from the Decoding of National Constitutions. British Journal of Political Science, vol. 43, no. 2, pp. 399–423.

Melton J., Ginsburg T. (2014) Does De Jure Judicial Independence Really Matter? A Reevaluation of Explanations for Judicial Independence. Journal of Law and Courts, vol. 2, no. 2, pp. 187–217.

Meuwese A., Snel M. (2013) “Constitutional Dialogue”: An Overview. Utrecht Law Review, vol. 9, no. 2, pp. 123–140.

Neumayer E. (2005) Do International Human Rights Treaties Improve Respect for Human Rights? Journal of Conflict Resolution, vol. 49, no. 6, pp. 925–953.

Nielsen R.A., Simmons B.A. (2015) Rewards for Ratification: Payoffs for Participating in the International Human Rights Regime? International Studies Quarterly, vol. 59, no. 2, pp. 197–208.

Perry M.J. (2009) Constitutional Rights, Moral Controversy, and the Supreme Court, Cambridge; New York: Cambridge University Press.

Persson T., Tabellini G. (2003) The Economic Effects of Constitutions, Cambridge, MA: MIT Press.

Persson T., Tabellini G. (2006) Democracy and Development: The Devil in the Details. American Economic Review, vol. 96, no. 2, pp. 319–324.

Petersen N. (2019) Deutsches und Europäisches Verfassungsrecht II: Grundrechte und Grundfreiheiten: Ein Studienbuch, München: C.H.Beck.

Pritchard K. (1986) Comparative Human Rights: An Integrative Explanation. Politikon: South African Journal of Political Studies, vol. 13, no. 2, pp. 24–37.

Przeworski A., Alvarez M.E., Cheibub J.A., Limongi F. (2000) Democracy and Development: Political Institutions and Well-Being in the World, 1950–1990, Cambridge: Cambridge University Press.

Rehnquist W.H. (1975) Notion of a Living Constitution. Texas Law Review, vol. 54, no. 4, pp. 693–706.

Ríos-Figueroa J., Staton J.K. (2014) An Evaluation of Cross-National Measures of Judicial Independence. The Journal of Law, Economics, & Organization, vol. 30, no. 1, pp. 104–137.

Rosenbaum P.R., Rubin D.B. (1983) The Central Role of the Propensity Score in Observational Studies for Causal Effects. Biometrika, vol. 70, no. 1, pp. 41–55.

Rosenberg A. (2015) Philosophy of Social Science, 5th ed., Boulder, CO: Westview Press.

Roux T. (2017) Comparative Constitutional Studies: Two Fields or One? Annual Review of Law and Social Science, vol. 13, pp. 123–139.

Roy B. (2004) An Empirical Survey of Foreign Jurisprudence and International Instruments in Charter Litigation. University of Toronto Faculty of Law Review, vol. 62, no. 2, pp. 99–148.

Samaha A.M. (2010) Low Stakes and Constitutional Interpretation. University of Pennsylvania Journal of Constitutional Law, vol. 13, no. 2, pp. 305–336.

Scalia A. (1989) Originalism: The Lesser Evil. University of Cincinnati Law Review, vol. 57, no. 3, pp. 849–866.

Schmidt K.M. (2009) The Role of Experiments for the Development of Economic Theories. Perspektiven der Wirtschaftspolitik, vol. 10, pp. 14–30.

Shadish W.R., Cook T.D., Campbell D.T. (2002) Experimental and Quasi-Experimental Designs for Generalized Causal Inference, Boston, MA; New York: Houghton Mifflin Company.

Siems M.M. (2008) Statistische Rechtsvergleichung. Rabels Zeitschrift für ausländisches und internationales Privatrecht, vol. 72, no. 2, pp. 354–390.

Simmons B.A. (2009) Mobilizing for Human Rights: International Law in Domestic Politics, Cambridge; New York: Cambridge University Press.

Slaughter A.-M. (1994) A Typology of Transjudicial Communication. University of Richmond Law Review, vol. 29, no. 1, pp. 99–138.

Spamann H. (2015) Empirical Comparative Law. Annual Review of Law and Social Science, vol. 11, pp. 131–153.

Tushnet M. (1999) Taking the Constitution away from the Courts, Princeton, NJ: Princeton University Press.

Versteeg M., Zackin E. (2016) Constitutions Unentrenched: Toward an Alternative Theory of Constitutional Design. American Political Science Review, vol. 110, no. 4, pp. 657–674.

Voigt S. (1997) Positive Constitutional Economics: A Survey. Public Choice, vol. 90, no. 1/4, pp. 11–53.

Voigt S. (2011) Empirical Constitutional Economics: Onward and Upward? Journal of Economic Behavior & Organization, vol. 80, no. 2, pp. 319–330.

Voigt S. (2011) Positive Constitutional Economics II – A Survey of Recent Developments. Public Choice, vol. 146, no. 1, pp. 205–256.

Von Bogdandy A. (2016) Comparative Constitutional Law as a Social Science? A Hegelian Reaction to Ran Hirschl’s Comparative Matters. Verfassung und Recht in Übersee, vol. 49, no. 3, pp. 278–290.

Waldron J. (1993) A Right-Based Critique of Constitutional Rights. Oxford Journal of Legal Studies, vol. 13, no. 1, pp. 18–51.

Waldron J. (1999) Law and Disagreement, Oxford: Clarendon Press; New York: Oxford University Press.

Waldron J. (2006) The Core of the Case against Judicial Review. The Yale Law Journal, vol. 115, no. 6, pp. 1346–1406.

Webley L. (2010) Qualitative Approaches to Empirical Legal Research. In: Cane P., Kritzer H.M. (eds.) The Oxford Handbook of Empirical Legal Research, Oxford; New York: Oxford University Press, pp. 927–952.