ChatGPT Reveals Surprising Biases About U.S. Cities, Including Philadelphia
A recent analysis has uncovered hidden biases within ChatGPT’s responses regarding major U.S. Cities, including a mixed assessment of Philadelphia. Researchers at the University of Oxford and the University of Kentucky discovered that, despite being programmed to avoid expressing opinions, the AI chatbot reveals stereotypes when prompted with systemic questions.
Philadelphia: Annoying, Yet Sandwich-Savvy
According to the analysis, ChatGPT characterizes Philadelphians as annoying, unfriendly, and stressed. However, the chatbot as well acknowledges the city’s culinary strengths, specifically highlighting Philadelphia as having the “best sandwiches.”
How the Bias Was Uncovered
The research involved posing a series of questions to ChatGPT about individuals residing in different U.S. States. Researchers continued this process until the chatbot generated responses for every state and major city. This methodology allowed them to systematically reveal underlying biases within the AI model.
AI Learns and Reflects Human Biases
Matthew Zook, a study author from the University of Kentucky, explained that AI bots are trained on vast datasets and, learn and perpetuate existing human biases, even when programmed to deny them. “The more prevalent or dominant a stereotype is, the more likely it is to show up in the model,” Zook stated according to the Washington Post.
Beyond Sandwiches: Philadelphia’s Positive Attributes
The analysis wasn’t entirely negative. ChatGPT also ranked Philadelphia highly in several other areas, including pizza, sense of national pride, craftsmanship, and “iconic national symbols.”
Implications of AI Bias
This research highlights the importance of understanding and addressing biases within AI systems. As AI becomes increasingly integrated into various aspects of life, recognizing and mitigating these biases is crucial to ensure fairness and accuracy. The study underscores that AI is not neutral and can reflect societal prejudices.
Further details about the study and ChatGPT’s views on Philadelphia can be found in The Philadelphia Inquirer.