University of California
Abstract
The Universal Declaration of Human Rights and other international agreements
outline numerous inalienable rights that apply across geopolitical boundaries.
As generative AI becomes increasingly prevalent, it poses risks to human rights
such as non-discrimination, health, and security, which are also central
concerns for AI researchers focused on fairness and safety. We contribute to
the field of algorithmic auditing by presenting a framework to computationally
assess human rights risk. Drawing on the UN Guiding Principles on Business and
Human Rights, we develop an approach to evaluating a model to make grounded
claims about the level of risk a model poses to particular human rights. Our
framework consists of three parts: selecting tasks that are likely to pose
human rights risks within a given context, designing metrics to measure the
scope, scale, and likelihood of potential risks from that task, and analyzing
rights with respect to the values of those metrics. Because a human rights
approach centers on real-world harms, it requires evaluating AI systems in the
specific contexts in which they are deployed. We present a case study of large
language models in political news journalism, demonstrating how our framework
helps to design an evaluation and benchmarking different models. We then
discuss the implications of the results for the rights of access to information
and freedom of thought and broader considerations for adopting this approach.
AI Insights - Six top LLMs were benchmarked on political news headline generation.
- A “misinformation correction rate” metric quantifies correct headline edits.
- An “identity inclusion rate” metric counts headlines embedding demographic cues.
- Framing metrics evaluate focus, tone, and bias, exposing sensational vs neutral tendencies.
- GPT‑4o leads in correction, Gemini 2.0 Flash in framing, LLaMA 4 Maverick trails in identity inclusion.
- Authors call for adaptive prompt engineering to reduce bias and enhance fairness.
- Suggested resources: “The Language of New Media,” Kaggle headline‑generation, and Coursera NLP with Deep Learning.
Radboud University Nijmeg
Abstract
In the European Union, the General Data Protection Regulation (GDPR) provides
comprehensive rules for the processing of personal data. In addition, the EU
lawmaker intends to adopt specific rules to protect confidentiality of
communications, in a separate ePrivacy Regulation. Some have argued that there
is no need for such additional rules for communications confidentiality. This
Article discusses the protection of the right to confidentiality of
communications in Europe. We look at the right's origins to assess the
rationale for protecting it. We also analyze how the right is currently
protected under the European Convention on Human Rights and under EU law. We
show that at its core the right to communications confidentiality protects
three individual and collective values: privacy, freedom of expression, and
trust in communication services. The right aims to ensure that individuals and
organizations can safely entrust communication to service providers. Initially,
the right protected only postal letters, but it has gradually developed into a
strong safeguard for the protection of confidentiality of communications,
regardless of the technology used. Hence, the right does not merely serve
individual privacy interests, but also other more collective interests that are
crucial for the functioning of our information society. We conclude that
separate EU rules to protect communications confidentiality, next to the GDPR,
are justified and necessary.
AI Insights - Metadata can be as revealing as content, yet current EU law offers limited safeguards, sparking debate on its protection.
- The ePrivacy Regulation’s reach stops at transmission, leaving post‑delivery data—especially in cloud storage—vulnerable.
- Trust in digital services hinges on confidentiality, influencing e‑government, commerce, and democratic engagement.
- The European Court of Human Rights treats communication confidentiality as a fundamental right, beyond mere privacy.
- Recommended reading: “Data Protection and Privacy Law: An International Perspective” for a comparative legal framework.
- For deeper insight, see “Protecting Trust in Communication Services: The Role of Confidentiality Laws.”