This article has been reviewed according to Science X's editorial process and policies. Editors have highlighted the following attributes while ensuring the content's credibility: In 2024, a collaborative Penn venture introduced a more objective way for people to examine how different outlets cover the same events and ultimately decide how they perceive and use information shared in the media. The Media Bias Detector, conceived in Penn's Computational Social Science (CSS) Lab, a joint venture of Penn Engineering, the Annenberg School for Communication and the Wharton School, uses artificial intelligence to analyze news articles for characteristics including topic, tone, political lean, and the facts and people included in coverage.
Now, the team is taking the project a step further. In a new paper published in Science Advances, a research team led by Duncan Watts, Stevens University professor in computer and information science (CIS), Penn Integrates Knowledge professor and director of the CSS Lab, introduces the scientific framework behind the Media Bias Detector and releases a data set containing more than 140,000 articles published during the 2024 U.S. presidential election year. Rather than asking whether a news outlet is simply "biased," the framework breaks news coverage into measurable components, allowing researchers to study how editorial choices shape what readers see, and what they don't.
"The initial launch of the Media Bias Detector was focused on the public-facing side of the project, while this paper describes the underlying scientific framework that powers the dashboard," says Samar Haider, a Ph.D. student in CIS and the study's lead researcher. "We present a rigorous evaluation of our data annotation pipeline, [showcasing] illustrative findings from the underlying data that cannot yet be visualized on the dashboard." "The dashboard was pretty full-featured relative to what else is out there in the media bias space," adds Watts. "But the data set underlying it is much richer than any dashboard can adequately capture.
This paper provides just a taste of what is possible with this new class of large-scale but still very granular news data." "The fundamental challenge with measuring bias is that, by definition, it requires one to know the 'true' value of the thing you're measuring," says Watts. "And, for most topics in the news, objective ground truth simply isn't available." Instead, the researchers look for what Watts calls the signatures of bias: systematic differences in the way publishers select and frame information. "Our overarching aim of the project is to provide the tools to help people understand how news publishers differ from each other without assigning normative labels to them," says Watts.
"By aggregating these signals, and comparing them across publishers, or even within publishers over time, our hope is that we can detect the signatures of bias without having to decide what a perfectly unbiased publisher would look like." Notably, this study found that a publisher's political lean can vary considerably depending on the topic, a level of nuance not captured by a single bias score. Samar Haider et al., The Media Bias Detector: A framework for annotating and analyzing the news, Science Advances (2026). DOI: 10.1126/sciadv.aea7456 MA in English, copy editor since 2021 with experience in higher education and health content.
Dedicated to trustworthy science news. Full profile → Bachelor's in mathematical biology, Master's in creative writing. Well-traveled with unique perspectives on science and language.
Extract — continue reading at the source.
