Participatory Moral AI Is Not Neutral: The Invisible Hand of Developers
Researchers warn that AI moral preference systems embed hidden developer biases through feature selection, voter sampling, and question framing.
- Participatory moral AI systems embed developer biases through undocumented feature selection, voter sampling, and question framing.
- These choices occur before public input and are often invisible to end users.
- The paper argues for transparency in the moral preference elicitation pipeline to prevent hidden value judgments.
- Moral AI policies trained on aggregated votes may scale developer priorities across society without clear accountability.
A new paper from arXiv argues that participatory moral AI systems are not neutral despite their democratic appearance. The research highlights how developers influence outcomes through three undocumented choices: which features to include in moral dilemmas, which participants are sampled for voting, and how questions are framed. These decisions, made before any public input is collected, effectively embed developer priorities into AI policies that scale across society.
The authors emphasize that these choices are often opaque, leaving end users unaware of the underlying value judgments shaping AI behavior. The paper calls for greater transparency in the moral preference elicitation pipeline, suggesting that without documentation, these systems risk reinforcing developer biases under the guise of democratic consensus.
Developers must document and justify their choices in moral AI pipelines to avoid embedding hidden biases.
AI systems making moral decisions may reflect developer values rather than public consensus.
- moral preference elicitation
- A method where AI systems are trained on aggregated human moral judgments to guide decision making.
Cloud-Based Artificial Intelligence Classification of Common Intracranial Tumors on Magnetic Resonance Imaging - Cureus
Improving the matrix multiplication exponent with modern optimization and AlphaEvolve
AutoSR: Automatic Symbolic Regression by Searching Research States
Towards Computational Provenance: Carrying Causal-State Evidence in Generated Text
Proteus: Incremental Memory Activation for Long-Context Sequence Modeling
AI vs AI: Can artificial intelligence contain the fake news epidemic that it has helped unleash? - Genetic Literacy Project
Researchers explore whether AI can detect and mitigate fake news, a problem partly fueled by AI itself.
AI and the New Age of Bioweapons - Foreign Affairs
A Foreign Affairs analysis warns that AI could dramatically lower the barrier to creating bioweapons, accelerating proliferation risks.
Artificial Intelligence: Organizations Across the Americas Urge the IACHR to Address the Environmental and Social Impacts of Rapidly Expanding Data Centers - elciudadano.com
Organizations across the Americas have formally requested the Inter-American Commission on Human Rights (IACHR) to investigate the environmental and social consequences of rapidly expanding data centers, driven by artificial intelligence development.
Suburban man allegedly used AI to create child sexual abuse material: Prosecutors - NBC 5 Chicago
A suburban man is accused of using AI to create child sexual abuse material, according to prosecutors.
Appeals court flags AI-generated fake cases in San Antonio ISD lawsuit - KSAT
A federal appeals court in Texas flagged AI-generated fake cases in a lawsuit involving San Antonio ISD, raising concerns about the reliability of AI in legal filings.
BusinessAnthropic’s annualized revenue surges to $65B
Anthropic’s annualized revenue has skyrocketed to $65 billion, adding $18 billion in just two months.