Abstract
Platform Recommender Systems (PRSs) are the algorithmic systems employed by online platforms to recommend content to users. These systems have been recently targeted by policy-makers in Europe, mainly in the Digital Services Act (DSA). While much is discussed on the merits and limitations of the DSA, the very first world regulation of PRSs has been implemented by the People’s Republic of China since March 1st 2022. The article elaborates a critical comparative analysis of the governance of PRSs between the Chinese and European regulations. By contextualizing the highly diverse media environments, the article bridges the gaps between legal, technical and social sciences disciplines to elaborate insights that aim to contribute to the development of the governance of PRS. The article is divided as follows; firstly, an introduction to the governance of platforms RSs is done. Then, a contextualization of European and the Chinese legal and media environment is provided. Secondly, a legal comparative analysis is developed by analyzing two main areas: algorithmic accountability and self-determination. Thirdly, a discussion on the challenges of PRS governance is elaborated and, eventually, conclusions are drawn. From the comparison we have identified fundamental challenges and opportunities for the development of PRSs governance: (1) the methodological validity of social media research and the possibility to run on-platform experiments for more sounding policies; (2) the inherent reductionism of profiling and the need to tackle the implicit “engagement optimization” paradigm; (3) the systemic vulnerability of users and the need to improve detection, prevention and legal codification of algorithmic and design manipulation; (4) the complex entanglement of PRS governance with interface design, content moderation and content visibility moderation; finally, (5) the promising role of users to provide a second-order accountability as well as strenghten individual self-determination through forms of participatory governance.
-
Author contributions: While both authors contributed to each paragraph of this essay, and the methodology, literature and findings have been thoroughly discussed by both authors, for the purposes of the Italian national scientific habilitation, the work should be attributed for paragraphs 1, 2.1, 4 and 5 to Urbano Reviglio and for paragraphs 1.2, 2.2 and 3 to Giulio Santoni.
References
Acquisti, A., L. Brandimarte, and G. Loewenstein. 2015. “Privacy and Human Behavior in the Age of Information.” Science 347 (6221): 509–14. https://doi.org/10.1126/science.aaa1465.Search in Google Scholar
Bengani, P., Stray, J., and Thorburn, L. 2022. What’s Right and What’s Wrong with Optimizing for Engagement. Also available at: https://medium.com/understanding-recommenders/whats-right-and-what-s-wrong-with-optimizing-for-engagement-5abaac021851 Search in Google Scholar
Capurro, R. 2006. “Towards an Ontological Foundation of Information Ethics.” Ethics and Information Technology 8: 175–86. https://doi.org/10.1007/s10676-006-9108-0.Search in Google Scholar
Cheng, D. 2016. Cyber Dragon: Inside China’s Information Warfare and Cyber Operations. Westport: Praeger.10.5040/9798400636431Search in Google Scholar
Cheong, P. H., and J. Gong. 2010. “Cyber Vigilantism, Transmedia Collective Intelligence, and Civic Participation.” Chinese Journal of Communication 3 (4): 471–87, https://doi.org/10.1080/17544750.2010.516580.Search in Google Scholar
Chin, Y. C., and K. Li. 2022. A Comparative Analysis of Cyber Sovereignty Policies in China and the EU. Policy & Internet. Also available at: https://ssrn.com/abstract=3900752.10.2139/ssrn.3900752Search in Google Scholar
Creemers, R. 2022. “China’s Emerging Data Protection Framework.” Journal of Cybersecurity 1–12. Also available at: https://doi.org/10.1093/cybsec/tyac011.Search in Google Scholar
Creemers, R. 2023. Is China’s Tech ‘Crackdown’ or ‘Rectification’ Over? Also available at: https://digichina.stanford.edu/work/is-chinas-tech-crackdown-or-rectification-over/.Search in Google Scholar
Creemers, R., M. Bodhurta, M. Forough, R. Ghiasy, and S. van der Lugt. 2021. The Digital Silk Road: Perspectives from Affected Countries. Also available at: https://leidenasiacentre.nl/wp-content/uploads/2021/08/Digital-Silk-Road-Perspectives-From-Affected-Countries.pdf.Search in Google Scholar
Creemers, R. 2017. “Cyber China: Upgrading Propaganda, Public Opinion Work and Social Management for the Twenty-First Century.” Journal of Contemporary China 26 (103): 85–100. https://doi.org/10.1080/10670564.2016.1206281.Search in Google Scholar
Dignum, V. 2019. Responsible Artificial Intelligence: How to Develop and Use AI in a Responsible Way, 59. Cham: Springer.10.1007/978-3-030-30371-6Search in Google Scholar
Douek, E. 2023. “Content Moderation as Systems Thinking.” Harvard Law Review 136: 528–606.Search in Google Scholar
Djeffal, C., E. Magrani, and C. Hitrova. 2022. “Recommender Systems and Autonomy: A Role for Regulation of Design, Rights, and Transparency.” Indian Journal of Law and Technology 17: 1–52.10.55496/JGDN9214Search in Google Scholar
Dutkiewicz, L. 2021. “From the DSA to Media Data Space: The Possible Solutions for the Access to Platforms’ Data to Tackle Disinformation.” European Law Blog. Also available at: https://europeanlawblog.eu/2021/10/19/from-the-dsa-to-media-data-space-the-possible-solutions-for-the-access-to-platforms-data-to-tackle-disinformation/#comments.10.21428/9885764c.67363679Search in Google Scholar
Floridi, L. 2016. “Tolerant Paternalism: Pro-ethical Design as a Resolution of the Dilemma of Toleration.” Science and Engineering Ethics 22 (6): 1669–88. https://doi.org/10.1007/s11948-015-9733-2.Search in Google Scholar
Floridi, L. 2021. Translating Principles into Practices of Digital Ethics: Five Risks of being Unethical. Ethics, Governance, and Policies in Artificial Intelligence, 81–90. Berlin: Springer.10.1007/978-3-030-81907-1_6Search in Google Scholar
Frosio, G. F. 2017. “Why Keep a Dog and Bark Yourself? from Intermediary Liability to Responsibility.” Oxford International Journal of Law and Information Technology 25: 1–33.10.1093/ijlit/eax021Search in Google Scholar
Gillespie, T. 2022. “Do Not Recommend? Reduction as a Form of Content Moderation.” Social Media+ Society 8 (3): 20563051221117552. https://doi.org/10.1177/20563051221117552.Search in Google Scholar
Greenleaf, G. 2020. China Issues a Comprehensive Draft Data Privacy Law Professor of Law in Privacy Laws & Business.Search in Google Scholar
Grochowski, M., A. Jabłonowska, F. Lagioia, and G. Sartor. 2021. “Algorithmic Transparency and Explainability for EU Consumer Protection: Unwrapping the Regulatory Premises.” Critical Analysis of Law 8 (1): 43–63.10.33137/cal.v8i1.36279Search in Google Scholar
GPAI. 2021. Responsible AI for Social Media Governance: A Proposed Collaborative Method for Studying the Effects of Social Media Recommender Systems on Users. Report. The Global Partnership on AI.Search in Google Scholar
Helberger, N. 2019. “On the Democratic Role of News Recommenders.” Digital Journalism 7 (8): 993–1012.Search in Google Scholar
Helberger, N., M. Van Drunen, S. Vrijenhoek, and J. Möller. 2021. “Regulation of News Recommenders in the Digital Services Act: Empowering David against the Very Large Online Goliath.” Internet Policy Review 26. Also available at: https://doi.org/10.1080/21670811.2019.1623700.Search in Google Scholar
Helberger, N., M. Sax, J. Strycharz, and H. W. Micklitz. 2022. “Choice Architectures in the Digital Economy: Towards a New Understanding of Digital Vulnerability.” Journal of Consumer Policy 45 (2): 175–200. https://doi.org/10.1007/s10603-021-09500-5.Search in Google Scholar
Hildebrandt, M. 2022. “The Issue of Proxies and Choice Architectures. Why EU Law Matters for Recommender Systems.” Frontiers in Artificial Intelligence 73. https://doi.org/10.3389/frai.2022.789076.Search in Google Scholar
Hine, E., and L. Floridi. 2022. Artificial Intelligence with American Values and Chinese Characteristics: A Comparative Analysis of American and Chinese Governmental AI Policies. Available at SSRN.10.2139/ssrn.4006332Search in Google Scholar
Hintz, A., L. Dencik, J. Redden, E. Treré, J. Brand, and H. Warne. 2022. “Civic Participation in the Datafied Society: Towards Democratic Auditing?” Data Justice Lab. Also available at: https://datajusticelab.org/wp-content/uploads/2022/08/CivicParticipation_DataJusticeLab_Report2022.pdf.10.4135/9781529770131Search in Google Scholar
King, G., J. Pan, and M. Roberts. 2017. “How the Chinese Government Fabricates Social Media Posts for Strategic Distraction, Not Engaged Argument.” American Political Science Review 111 (3): 484–501. https://doi.org/10.1017/s0003055417000144.Search in Google Scholar
Knijnenburg, B. P., S. Sivakumar, and D. Wilkinson. 2016. “Recommender Systems for Self-actualization.” In Proceedings of the 10th ACM Conference on Recommender Systems, 11–4. ISO 690.10.1145/2959100.2959189Search in Google Scholar
Kolton, M. 2017. “Interpreting China’s Pursuit of Cyber Sovereignty and Its Views on Cyber Deterrence.” The Cyber Defense Review 2: 119–54.Search in Google Scholar
Laux, J., S. Wachter, and B. Mittelstadt. 2021. “Taming the Few: Platform Regulation, Independent Audits, and the Risks of Capture Created by the DMA and DSA.” Computer Law & Security Report 43. https://doi.org/10.1016/j.clsr.2021.105613.Search in Google Scholar
Leerssen, P. 2021. “Platform Research Access in Article 31 of the Digital Services Act: Sword without a Shield?” VerfBlog. https://doi.org/10.17176/20210907-214355-0.Search in Google Scholar
Leerssen, P. 2022. “Algorithm Centrism in the DSA’s Regulation of Recommender Systems.” Verfassungsblog: On Matters Constitutional. https://doi.org/10.17176/20220330-011148-0.Search in Google Scholar
Leersen, P. 2023. “An End to Shadow Banning? Transparency Rights in the Digital Services Act between Content Moderation and Curation.” Computer Law & Security Report. Also available at: https://doi.org/10.17176/20210907-214355-0.Search in Google Scholar
Lessig, L. 2006. Code 2.0. New York: Basic Books.Search in Google Scholar
Mattei, U., L. Guanghua, and E. Ariano. 2020. “The Chinese Advantage in Emergency Law.” Global Jurist 21 (1): 1–58. https://doi.org/10.1515/gj-2020-0032.Search in Google Scholar
Miao, W., M. Jiang, and Y. Pang. 2021. “Historicizing Internet Regulation in China, A Meta Analysis of Chinese Internet Policies.” International Journal of Communication 15: 2003–26.Search in Google Scholar
Mitova, E., S. Blassnig, E. Strikovic, A. Urman, A. Hannak, C. H. de Vreese, and F. Esser. 2022. “News Recommender Systems: A Programmatic Research Review.” Annals of the International Communication Association: 1–30. https://doi.org/10.1080/23808985.2022.2142149.Search in Google Scholar
Moriconi, C. 2019. “Recent Evolution of the Personal Privacy Legal Protection in People’s Republic of China.” Nordic Journal of Law and Social Research. Also available at: https://doi.org/10.7146/nnjlsr.v1i9.122161.Search in Google Scholar
Napoli, P. M. 2019. Social Media and the Public Interest: Media Regulation in the Disinformation Age. New York: Columbia University Press.10.7312/napo18454Search in Google Scholar
OECD. 2020. Innovative Citizen Participation and New Democratic Institutions: Catching the Deliberative Wave.Search in Google Scholar
Ovadya, A. 2021. Towards Platform Democracy: Policymaking Beyond Corporate CEOs and Partisan Pressure. Paper. Also available at https://www.belfercenter.org/publication/towards-platform-democracy-policymaking-beyond-corporate-ceos-and-partisan-pressure.Search in Google Scholar
Parcu, P. L., E. Brogi, S. Verza, D. Da Costa Leite Borges, R. Carlini, M. Trevisan, and N. Domazetovikj. 2022. Study on media plurality and diversity online. Publications Office of the European Union.Search in Google Scholar
Pernot-Leplay, E. 2020. “China’s Approach on Data Privacy Law, A Third Approach between the U.S and the E.U.?” Penn State Journal of Law and International Affairs 8 (1): 50–117.Search in Google Scholar
Peukert, A. 2021. Five Reasons to Be Skeptical about the DSA. Also available at: https://verfassungsblog.de/power-dsa-dma-04/.Search in Google Scholar
Peukert, C., S. Bechtold, M. Batikas, and T. Kretschmer. 2021. Regulatory Spillovers and Data Governance: Evidence from the GDPR, forthcoming in Marketing Science. Available at SSRN: https://ssrn.com/abstract=3560392 or https://doi.org/10.2139/ssrn.3560392.Search in Google Scholar
Pollicino, O. 2021. Judicial Protection of Fundamental Rights on the Internet (Hart).10.5040/9781509912728Search in Google Scholar
Rieder, B., and J. Hofmann. 2020. “Towards Platform Observability.” Internet Policy Review 9 (4): 1–28. https://doi.org/10.14763/2020.4.1535.Search in Google Scholar
Reijula, S., and R. Hertwig. 2022. “Self-nudging and the citizen choice architect.” Behavioural Public Policy 6 (1): 119–49. https://doi.org/10.1017/bpp.2020.5.Search in Google Scholar
Reisch, L. A., and C. R. Sunstein. 2016. “Do Europeans like nudges?” Judgment and Decision Making 11 (4): 310–25. https://doi.org/10.1017/s1930297500003740.Search in Google Scholar
Schwemer, S. F. 2021. “Recommender Systems in the EU: From Responsibility to Regulation?” In FAccTRec Workshop, Vol. 21.10.5771/2747-5174-2021-2-60Search in Google Scholar
Sheehan, M. 2022. What China’s Algorithm Registry Reveals about AI Governance. Also available at: https://carnegieendowment.org/2022/12/09/what-china-s-algorithm-registry-reveals-about-ai-governance-pub-88606.Search in Google Scholar
Stray, J. 2023. Editorial Values for News Recommenders. News Quality in the Digital Age (forthcoming).10.4324/9781003257998-13Search in Google Scholar
Shtub, T., and M. Gal. 2022. “The Competitive Effects of China’s Data Regime.” Journal of Competition Law and Economics 18 (4): 936–70.10.1093/joclec/nhac007Search in Google Scholar
Susser, D., B. Roessler, and H. Nissenbaum. 2019. “Online Manipulation: Hidden Influences in a Digital World.” Georgetown Law Technology Review 4: 1.10.2139/ssrn.3306006Search in Google Scholar
Taddeo, M., and L. Floridi. 2017. “The Moral Responsibilities of Online Service Providers.” In The Responsibilities of Online Service Providers, 13–42. Cham: Springer.10.1007/978-3-319-47852-4_2Search in Google Scholar
Timoteo, M. 2022. “E-Commerce and Law: A Post Modern Legal Scenario: Ideas from the Chinese Observatory.” In Major Legal Trends in the Digital Economy, edited by G. Finocchiaro. Bologna: il Mulino.Search in Google Scholar
Toner, H., R. Creemers, and P. Triolo. 2021. “Experts Examine China’s Pioneering Draft Algorithm Regulations.” DigiChina.Search in Google Scholar
Thorburn, L., J. Stray, and P. Bengani. 2022a. What Will “Amplification” Mean in Court? Tech Policy Press. Also available at: https://techpolicy.press/what-will-amplification-mean-in-court/.Search in Google Scholar
Thorburn, L., P. Bengani, and J. Stray. 2022b. What Does it Mean to Give Someone What they Want? the Nature of Preferences in Recommender Systems. Also available at: https://medium.com/understanding-recommenders/what-does-it-mean-to-give-someone-what-they-want-the-nature-of-preferences-in-recommender-systems-82b5a1559157#:∼:text=Giving%20people%20what%20they%20need,they%20want%2C%20in%20some%20way.Search in Google Scholar
Turillazzi, A., F. Casolari, M. Taddeo, and L. Floridi. 2022. “The Digital Services Act: An Analysis of its Ethical, Legal, and Social Implications.” Legal, and Social Implications 15. Also available at: https://doi.org/10.1080/17579961.2023.2184136.Search in Google Scholar
Urman, A., and M. Makhortykh. 2023. “How transparent are transparency reports? Comparative analysis of transparency reporting across online platforms.” Telecommunications Policy 47 (3): 102477. https://doi.org/10.1016/j.telpol.2022.102477.Search in Google Scholar
Van den Bogaert, L., D. Geerts, and J. Harambam. 2022. “Putting a Human Face on the Algorithm: Co-designing Recommender Personae to Democratize News Recommender Systems.” Digital Journalism: 1–21. https://doi.org/10.1080/21670811.2022.2097101.Search in Google Scholar
Van Hoecke, M. 2015. “Methodology of Comparative Legal Research.” Law and Method: 6–7. https://doi.org/10.5553/rem/.000010.Search in Google Scholar
Vogus, C., and E. Llansò. 2021. Making Transparency Meaningful: A Framework for Policy-Makers. Report of the Center for Democracy and Technology.Search in Google Scholar
Wachter, S., B. Mittelstadt, and L. Floridi. 2017. “Why a Right to Explanation of Automated Decision-Making Does Not Exist in the General Data Protection Regulation.” International Data Privacy Law 7: 76. https://doi.org/10.1093/idpl/ipx005.Search in Google Scholar
Wang, S. (王思北). 2019. “《网络信息内容生态治理规定》明确不得开展人肉搜索、流量造假等违法活动 The “Regulation on Network Content Ecological Governance” Clearly Shall Not Carry Out Human Flesh Search (renrou sousuo), Traffic Falsification and Other Illegal Activities.” Also available at: http://www.gov.cn/xinwen/2019-12/21/content_5462826.htm.Search in Google Scholar
Xie, Y. (谢英豪). 2022. 未成年人保护视域下网络游戏监管政策探析, In 娱乐法内参 (Entertainment Law Observation).Search in Google Scholar
Yang, F., and Y. Yao. 2022. “A New Regulatory Framework for Algorithm-Powered Recommendation Services in China.” Nature Machine Intelligence 4 (10): 802–3. https://doi.org/10.1038/s42256-022-00546-9.Search in Google Scholar
Yang, J. 2022. (杨建军),《互联网信息服务算法推荐管理规定》系列专家解读(一) (A First Explanation on the IISARM). Also available at: https://www.12377.cn/bmgz/2022/b1371971_web.html.Search in Google Scholar
Zuboff, S. 2015. “Big other: Surveillance Capitalism and The Prospects of an Information Civilization.” Journal of Information Technology 30 (1): 75–89. https://doi.org/10.1057/jit.2015.5.Search in Google Scholar
© 2023 Walter de Gruyter GmbH, Berlin/Boston
Articles in the same Issue
- Frontmatter
- Research Articles
- From ‘What’ and ‘Why’ to ‘How’: An Imperative Driven Approach to Mechanics of AI Regulation
- What Liability with the Internet of Things? Insights from the European Case-Law of the PIP Affair
- Governing Platform Recommender Systems in Europe: Insights from China
- Norms versus Interpretations: Human Rights Universality Revisited
- Peace through Justice, Truth, Reparation and Non-Repetition: Normative and Judicial Developments of the Special Legal Framework of Transitional Justice in Colombia
Articles in the same Issue
- Frontmatter
- Research Articles
- From ‘What’ and ‘Why’ to ‘How’: An Imperative Driven Approach to Mechanics of AI Regulation
- What Liability with the Internet of Things? Insights from the European Case-Law of the PIP Affair
- Governing Platform Recommender Systems in Europe: Insights from China
- Norms versus Interpretations: Human Rights Universality Revisited
- Peace through Justice, Truth, Reparation and Non-Repetition: Normative and Judicial Developments of the Special Legal Framework of Transitional Justice in Colombia