Political Ideology Influences Evidence Gathering Strategies

A recent study published in PLOS ONE investigates how political ideology and cognitive reflection influence the way individuals gather information. Conducted in August 2023, the research involved 583 adults from the United States who were presented with a scenario regarding cash bail reform. Participants evaluated the effectiveness of this policy by accessing an “evidence bank” containing ten pieces of information, categorized into statistical data and expert testimony. The study aimed to understand the standards of evidence individuals apply when seeking information, particularly in politically charged contexts.

Psypost

The study revealed that self-identified conservatives and individuals with lower cognitive reflection scores tended to rely on "categorical" evidence, focusing on singular data points, such as the number of cities where crime increased post-reform. In contrast, liberals and those with higher cognitive reflection skills preferred "fully associative" evidence, which involves gathering comprehensive statistical data to assess the policy's impact accurately. For example, the likelihood of relying on a single data point increased from approximately 4% among very liberal participants to over 37% among very conservative participants.

Psypost

Cognitive reflection, defined as the ability to engage in deeper analytical thinking, significantly influenced evidence-seeking behavior. Participants scoring higher on cognitive reflection tests were less likely to depend on categorical evidence and more inclined to analyze all available statistical data. Furthermore, when consulting expert sources, those with high cognitive reflection scores sought a mix of opinions from both their political in-group and opposing out-group, while those with lower scores tended to favor sources that aligned with their political beliefs.

Psypost

The findings suggest that political beliefs shape not only the type of evidence individuals seek but also their overall approach to information gathering. This has implications for public policy debates, where disagreements often persist despite the availability of factual data. Understanding these dynamics is crucial in an increasingly polarized media landscape, as it may affect how citizens form opinions on contentious issues.

Psypost

The study's methodology has been critiqued for using a fixed list of evidence options, which may not accurately reflect real-world information-seeking behavior. Additionally, the politically polarized nature of the cash bail reform topic could influence how participants gather evidence for less controversial subjects. The researchers acknowledged that their work does not assess how individuals interpret the evidence they collect, focusing solely on the types of information accessed.

Psypost

Future studies are anticipated to explore how these evidence-gathering patterns hold up in various contexts, particularly with the rise of artificial intelligence and chat-based search tools. Researchers aim to investigate how individuals weigh the credibility of sources against the data provided, further complicating the relationship between trust, reliability, and the information landscape.

Psypost

• “There are different ‘types of evidence seekers’ in the world,” — Florian Justwan, Associate Professor of Political Science

Psypost

• “Our work does not address how people process information,” — Florian Justwan, Associate Professor of Political Science

Psypost

• “Long term, we seek to understand general patterns between how people think about a source of information (e.g. trust, reliability, expertise) and the first-order information from that source,” — Florian Justwan, Associate Professor of Political Science

Psypost

This study highlights the intricate relationship between political ideology, cognitive reflection, and evidence gathering, shedding light on the factors that influence how individuals engage with information in the political domain.

Psypost