• About Us
  • Get Insights to Your Inbox
Wednesday, May 28, 2025
Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in Author
Search Events
Filter by Categories
Action Learning
Artificial Intelligence in Business
Book Club
Books
BU Today
Business Challenges
Business Education
Business Functions
Business Policy & Markets
Corporate Strategy
Digital Business
Digital Business Institute
Diversity, Equity & Inclusion
Entrepreneurship & Innovation
Events
Expert Take
Feature
Finance & Accounting
Future of Business Education
Future of Work
Global Media
Harvard Business Review
Health, Biopharma, & Health-Tech
Human Resources Policy Institute
Innovation
Insights Live
Institute for Sustainable Energy
Journals
Language of Business
Leadership & Management
Local Media
Marketing
Media Mention
Multimedia
National Media
Newsletter Spotlight
Op-Ed
Operations
Opinion
Our Insights
Partners in Business Ethics
Podcast
Publications
Research Institutes
Risk
ScienceDirect
Silicon Valley Bank
Sloan Management Review
Social Impact
Special Series
Susilo Institute for Ethics in the Global Economy
Technology
The Brink
Thinkers50@BUQuestrom: Passion & Purpose
Videos
Insights@Questrom
  • Our Insights
    • All
    • Business Challenges
    • Business Education
    • Business Functions
    How Retailers Can Capitalize on the “Refund Effect”

    Could the GPT Store Turn ChatGPT into a Platform Powerhouse? 

    From Hollywood to the Hardware Store: The Real-World Impact of a 100% Tariff 

    From Hollywood to the Hardware Store: The Real-World Impact of a 100% Tariff 

    Bank Failures Show Us What Not to Do with Our Own Finances

    Bank Failures Show Us What Not to Do with Our Own Finances

    In a ‘work-from-anywhere’ world, where are people working?

    79,000 lost jobs. $13 billion in GDP gone. Study tallies potential hit to Mass. from Trump’s ‘economic attack.’

    The Hidden Risk of Getting Paid in Stock Options 

    Trump Administration Cancels Scores of Grants to Study Online Misinformation 

    Q&A on Trump’s Prescription Drug Pricing Executive Order 

    Q&A on Trump’s Prescription Drug Pricing Executive Order 

    Congratulations to Evan Apfelbaum, Patricia Cortes, Andrei Hagiu, Petro Lisowsky on Their Promotions to Full Professors!

    Congratulations to Evan Apfelbaum, Patricia Cortes, Andrei Hagiu, Petro Lisowsky on Their Promotions to Full Professors!

    I’m a business professor who asked dozens of former students how they define success. Here are their lessons for today’s grads

    I’m a business professor who asked dozens of former students how they define success. Here are their lessons for today’s grads

  • Videos & Podcast
    • All
    • Podcast
    • Videos
    S1:E1 CVS Paying the “Pink Tax” on Certain Products and the Evolution of the Electric Vehicle Industry

    Tariffs and Their Economic Impact

    S1:E1 CVS Paying the “Pink Tax” on Certain Products and the Evolution of the Electric Vehicle Industry

    Navigating Internet Privacy: Unpacking Cookies, Dark Patterns, and Future Data Protection Challenges (2)

    Beyond Prototypes: Rethinking Innovation in Complex Ecosystems with Prof. Douglas Hannah

    Beyond Prototypes: Rethinking Innovation in Complex Ecosystems with Prof. Douglas Hannah

    Is Business Broken? Season 2 out now! 

    Is Business Broken? Season 2 out now! 

    S1:E1 CVS Paying the “Pink Tax” on Certain Products and the Evolution of the Electric Vehicle Industry

    Redefining Retirement: Navigating Emotional and Social Transitions with Insightful Strategies

    Life After Cookies: Who Uses Google’s Privacy Sandbox? – Garrett Johnson

    Life After Cookies: Who Uses Google’s Privacy Sandbox? – Garrett Johnson

    S1:E1 CVS Paying the “Pink Tax” on Certain Products and the Evolution of the Electric Vehicle Industry

    Real Estate Ripples from a Landmark Settlement

    S1:E1 CVS Paying the “Pink Tax” on Certain Products and the Evolution of the Electric Vehicle Industry

    The Hidden Wisdom of Cultural Pushback

    S1:E1 CVS Paying the “Pink Tax” on Certain Products and the Evolution of the Electric Vehicle Industry

    Fusion Strategy: Navigating the Industrial Evolution

  • Insights Events
    • Events
    • Insights Live
    • Questrom Institute Events
  • In the Media
    • All
    • BU Today
    • Global Media
    • Local Media
    • National Media
    • Op-Ed
    • The Brink
    How Retailers Can Capitalize on the “Refund Effect”

    Could the GPT Store Turn ChatGPT into a Platform Powerhouse? 

    Bank Failures Show Us What Not to Do with Our Own Finances

    Bank Failures Show Us What Not to Do with Our Own Finances

    In a ‘work-from-anywhere’ world, where are people working?

    79,000 lost jobs. $13 billion in GDP gone. Study tallies potential hit to Mass. from Trump’s ‘economic attack.’

    The Hidden Risk of Getting Paid in Stock Options 

    Trump Administration Cancels Scores of Grants to Study Online Misinformation 

    Q&A on Trump’s Prescription Drug Pricing Executive Order 

    Q&A on Trump’s Prescription Drug Pricing Executive Order 

    Executive Insights: Ned Rimer, Faculty Director, Health Sector Management Program, Questrom School of Business, Boston University (video)

    Editorial: Research funding cuts will hurt the Mass. economy, not just universities

    Celtics, Bruins playoffs return to TD Garden: Police warn of scam tickets

    Trump’s immigration policies will cost Massachusetts billions, experts say

    Small businesses may take the brunt of tariffs, even when they’re based in the US 

    Walmart debuts ‘Grow with US’ program for small businesses 

    Executive Insights: Ned Rimer, Faculty Director, Health Sector Management Program, Questrom School of Business, Boston University (video)

    Research funding cuts could mean thousands fewer jobs in the Boston area

  • Publications
    • All
    • Books
    • Harvard Business Review
    • Journals
    • Sloan Management Review
    How Retailers Can Capitalize on the “Refund Effect”

    Could the GPT Store Turn ChatGPT into a Platform Powerhouse? 

    How Retailers Can Capitalize on the “Refund Effect”

    How to Monetize Volunteer-Driven Platforms 

    How Retailers Can Capitalize on the “Refund Effect”

    Leading Global Teams Effectively 

    How Retailers Can Capitalize on the “Refund Effect”

    Research: When Prototypes Don’t Yield Useful Insights 

    Transforming Products into Platforms: Unearthing New Avenues for Business Innovation

    Transforming Products into Platforms: Unearthing New Avenues for Business Innovation

    How Retailers Can Capitalize on the “Refund Effect”

    We’re Still Lonely at Work

    How Retailers Can Capitalize on the “Refund Effect”

    17 Team-Building Activities for In-Person, Remote, and Hybrid Teams

    3 Ways to Support Employees with Bipolar Disorder

    3 Ways to Support Employees with Bipolar Disorder

    Will That Marketplace Succeed?

    Will That Marketplace Succeed?

  • Questrom Book Club
Insights@Questrom
  • Our Insights
    • All
    • Business Challenges
    • Business Education
    • Business Functions
    How Retailers Can Capitalize on the “Refund Effect”

    Could the GPT Store Turn ChatGPT into a Platform Powerhouse? 

    From Hollywood to the Hardware Store: The Real-World Impact of a 100% Tariff 

    From Hollywood to the Hardware Store: The Real-World Impact of a 100% Tariff 

    Bank Failures Show Us What Not to Do with Our Own Finances

    Bank Failures Show Us What Not to Do with Our Own Finances

    In a ‘work-from-anywhere’ world, where are people working?

    79,000 lost jobs. $13 billion in GDP gone. Study tallies potential hit to Mass. from Trump’s ‘economic attack.’

    The Hidden Risk of Getting Paid in Stock Options 

    Trump Administration Cancels Scores of Grants to Study Online Misinformation 

    Q&A on Trump’s Prescription Drug Pricing Executive Order 

    Q&A on Trump’s Prescription Drug Pricing Executive Order 

    Congratulations to Evan Apfelbaum, Patricia Cortes, Andrei Hagiu, Petro Lisowsky on Their Promotions to Full Professors!

    Congratulations to Evan Apfelbaum, Patricia Cortes, Andrei Hagiu, Petro Lisowsky on Their Promotions to Full Professors!

    I’m a business professor who asked dozens of former students how they define success. Here are their lessons for today’s grads

    I’m a business professor who asked dozens of former students how they define success. Here are their lessons for today’s grads

  • Videos & Podcast
    • All
    • Podcast
    • Videos
    S1:E1 CVS Paying the “Pink Tax” on Certain Products and the Evolution of the Electric Vehicle Industry

    Tariffs and Their Economic Impact

    S1:E1 CVS Paying the “Pink Tax” on Certain Products and the Evolution of the Electric Vehicle Industry

    Navigating Internet Privacy: Unpacking Cookies, Dark Patterns, and Future Data Protection Challenges (2)

    Beyond Prototypes: Rethinking Innovation in Complex Ecosystems with Prof. Douglas Hannah

    Beyond Prototypes: Rethinking Innovation in Complex Ecosystems with Prof. Douglas Hannah

    Is Business Broken? Season 2 out now! 

    Is Business Broken? Season 2 out now! 

    S1:E1 CVS Paying the “Pink Tax” on Certain Products and the Evolution of the Electric Vehicle Industry

    Redefining Retirement: Navigating Emotional and Social Transitions with Insightful Strategies

    Life After Cookies: Who Uses Google’s Privacy Sandbox? – Garrett Johnson

    Life After Cookies: Who Uses Google’s Privacy Sandbox? – Garrett Johnson

    S1:E1 CVS Paying the “Pink Tax” on Certain Products and the Evolution of the Electric Vehicle Industry

    Real Estate Ripples from a Landmark Settlement

    S1:E1 CVS Paying the “Pink Tax” on Certain Products and the Evolution of the Electric Vehicle Industry

    The Hidden Wisdom of Cultural Pushback

    S1:E1 CVS Paying the “Pink Tax” on Certain Products and the Evolution of the Electric Vehicle Industry

    Fusion Strategy: Navigating the Industrial Evolution

  • Insights Events
    • Events
    • Insights Live
    • Questrom Institute Events
  • In the Media
    • All
    • BU Today
    • Global Media
    • Local Media
    • National Media
    • Op-Ed
    • The Brink
    How Retailers Can Capitalize on the “Refund Effect”

    Could the GPT Store Turn ChatGPT into a Platform Powerhouse? 

    Bank Failures Show Us What Not to Do with Our Own Finances

    Bank Failures Show Us What Not to Do with Our Own Finances

    In a ‘work-from-anywhere’ world, where are people working?

    79,000 lost jobs. $13 billion in GDP gone. Study tallies potential hit to Mass. from Trump’s ‘economic attack.’

    The Hidden Risk of Getting Paid in Stock Options 

    Trump Administration Cancels Scores of Grants to Study Online Misinformation 

    Q&A on Trump’s Prescription Drug Pricing Executive Order 

    Q&A on Trump’s Prescription Drug Pricing Executive Order 

    Executive Insights: Ned Rimer, Faculty Director, Health Sector Management Program, Questrom School of Business, Boston University (video)

    Editorial: Research funding cuts will hurt the Mass. economy, not just universities

    Celtics, Bruins playoffs return to TD Garden: Police warn of scam tickets

    Trump’s immigration policies will cost Massachusetts billions, experts say

    Small businesses may take the brunt of tariffs, even when they’re based in the US 

    Walmart debuts ‘Grow with US’ program for small businesses 

    Executive Insights: Ned Rimer, Faculty Director, Health Sector Management Program, Questrom School of Business, Boston University (video)

    Research funding cuts could mean thousands fewer jobs in the Boston area

  • Publications
    • All
    • Books
    • Harvard Business Review
    • Journals
    • Sloan Management Review
    How Retailers Can Capitalize on the “Refund Effect”

    Could the GPT Store Turn ChatGPT into a Platform Powerhouse? 

    How Retailers Can Capitalize on the “Refund Effect”

    How to Monetize Volunteer-Driven Platforms 

    How Retailers Can Capitalize on the “Refund Effect”

    Leading Global Teams Effectively 

    How Retailers Can Capitalize on the “Refund Effect”

    Research: When Prototypes Don’t Yield Useful Insights 

    Transforming Products into Platforms: Unearthing New Avenues for Business Innovation

    Transforming Products into Platforms: Unearthing New Avenues for Business Innovation

    How Retailers Can Capitalize on the “Refund Effect”

    We’re Still Lonely at Work

    How Retailers Can Capitalize on the “Refund Effect”

    17 Team-Building Activities for In-Person, Remote, and Hybrid Teams

    3 Ways to Support Employees with Bipolar Disorder

    3 Ways to Support Employees with Bipolar Disorder

    Will That Marketplace Succeed?

    Will That Marketplace Succeed?

  • Questrom Book Club
Insights@Questrom
Home Our Insights Business Challenges Business Policy & Markets

Algorithms help people see and correct their biases, study shows

Carey MorewedgebyCarey Morewedge
May 10, 2024
in Business Policy & Markets, Technology
26
0
Algorithms help people see and correct their biases, study shows
Share on FacebookShare on TwitterShare on LinkedIn

Algorithms could serve as mirrors for you to check your biases. 

Algorithms are a staple of modern life. People rely on algorithmic recommendations to wade through deep catalogs and find the best movies, routes, information, products, people and investments. Because people train algorithms on their decisions – for example, algorithms that make recommendations on e-commerce and social media sites – algorithms learn and codify human biases.

Algorithmic recommendations exhibit bias toward popular choices and information that evokes outrage, such as partisan news. At a societal level, algorithmic biases perpetuate and amplify structural racial bias in the judicial system, gender bias in the people companies hire, and wealth inequality in urban development.

Algorithmic bias can also be used to reduce human bias. Algorithms can reveal hidden structural biases in organizations. In a paper published in the Proceedings of the National Academy of Science, my colleagues and I found that algorithmic bias can help people better recognize and correct biases in themselves.

The bias in the mirror

In nine experiments, Begum Celikitutan, Romain Cadario and I had research participants rate Uber drivers or Airbnb listings on their driving skill, trustworthiness or the likelihood that they would rent the listing. We gave participants relevant details, like the number of trips they’d driven, a description of the property, or a star rating. We also included an irrelevant biasing piece of information: a photograph revealed the age, gender and attractiveness of drivers, or a name that implied that listing hosts were white or Black.

After participants made their ratings, we showed them one of two ratings summaries: one showing their own ratings, or one showing the ratings of an algorithm that was trained on their ratings. We told participants about the biasing feature that might have influenced these ratings; for example, that Airbnb guests are less likely to rent from hosts with distinctly African American names. We then asked them to judge how much influence the bias had on the ratings in the summaries.

https://youtu.be/N13oj-gmq1U

The author describes how algorithms can be useful as a mirror of people’s biases.

Whether participants assessed the biasing influence of race, age, gender or attractiveness, they saw more bias in ratings made by algorithms than themselves. This algorithmic mirror effect held whether participants judged the ratings of real algorithms or we showed participants their own ratings and deceptively told them that an algorithm made those ratings.

Participants saw more bias in the decisions of algorithms than in their own decisions, even when we gave participants a cash bonus if their bias judgments matched the judgments made by a different participant who saw the same decisions. The algorithmic mirror effect held even if participants were in the marginalized category – for example, by identifying as a woman or as Black.

Research participants were as able to see biases in algorithms trained on their own decisions as they were able to see biases in the decisions of other people. Also, participants were more likely to see the influence of racial bias in the decisions of algorithms than in their own decisions, but they were equally likely to see the influence of defensible features, like star ratings, on the decisions of algorithms and on their own decisions.

Bias blind spot

People see more of their biases in algorithms because the algorithms remove people’s bias blind spots. It is easier to see biases in others’ decisions than in your own because you use different evidence to evaluate them.

When examining your decisions for bias, you search for evidence of conscious bias – whether you thought about race, gender, age, status or other unwarranted features when deciding. You overlook and excuse bias in your decisions because you lack access to the associative machinery that drives your intuitive judgments, where bias often plays out. You might think, “I didn’t think of their race or gender when I hired them. I hired them on merit alone.”

https://youtu.be/f2GgTFZFvQk
The bias blind spot explained.

When examining others’ decisions for bias, you lack access to the processes they used to make the decisions. So you examine their decisions for bias, where bias is evident and harder to excuse. You might see, for example, that they only hired white men.

Algorithms remove the bias blind spot because you see algorithms more like you see other people than yourself. The decision-making processes of algorithms are a black box, similar to how other people’s thoughts are inaccessible to you.

Participants in our study who were most likely to demonstrate the bias blind spot were most likely to see more bias in the decisions of algorithms than in their own decisions.

People also externalize bias in algorithms. Seeing bias in algorithms is less threatening than seeing bias in yourself, even when algorithms are trained on your choices. People put the blame on algorithms. Algorithms are trained on human decisions, yet people call the reflected bias “algorithmic bias.”

Corrective lens

Our experiments show that people are also more likely to correct their biases when they are reflected in algorithms. In a final experiment, we gave participants a chance to correct the ratings they evaluated. We showed each participant their own ratings, which we attributed either to the participant or to an algorithm trained on their decisions.

Participants were more likely to correct the ratings when they were attributed to an algorithm because they believed the ratings were more biased. As a result, the final corrected ratings were less biased when they were attributed to an algorithm.

Algorithmic biases that have pernicious effects have been well documented. Our findings show that algorithmic bias can be leveraged for good. The first step to correct bias is to recognize its influence and direction. As mirrors revealing our biases, algorithms may improve our decision-making.

This article is republished from The Conversation under a Creative Commons license. Read the original article.

Tags: AlgorithmsCarey MorewedgeThe Conversation
Carey Morewedge

Carey Morewedge

Carey K. Morewedge is a Professor of Marketing. He researches how high-level cognitive processes such as memory, attention, and mental imagery influence consequential human judgments and decisions. His research is distinctive in elucidating how these basic processes influence judgments of utility—the value or pleasure that experiences provide—often more than the physical properties or market value of experiences. Judgments of utility are consequential as they determine which experiences people choose, how much of experiences they choose to have, and how much money, time, and effort they will spend to acquire or avoid them.

Related Insights

Bureaucrats get a bad rap, but they deserve more credit − a sociologist of work explains why
Business Challenges

Bureaucrats get a bad rap, but they deserve more credit − a sociologist of work explains why

April 28, 2025
Sports Gambling
Business Functions

Tesla sales dip in Massachusetts 

April 15, 2025
Twenty years of Addgene 
Media Mention

Are the Internet and AI affecting our memory? What the science says 

February 5, 2025
What are pharmacy benefit managers? A health economist explains how lack of competition drives up drug prices for everyone
Health, Biopharma, & Health-Tech

What are pharmacy benefit managers? A health economist explains how lack of competition drives up drug prices for everyone

December 19, 2024
Americans leave a huge chunk of change at airport security checkpoints − here’s what it means for the debate over getting rid of pennies
Business Policy & Markets

Americans leave a huge chunk of change at airport security checkpoints − here’s what it means for the debate over getting rid of pennies

May 20, 2024
The Right Amount of Cards, Cash and ID to Carry in Your Wallet
Media Mention

Savor Your Best Calls. And Then Move On. 

May 6, 2024

Upcoming Events

June 2025
Jun 07 2025

Mayor WU, BU Questrom Team Up to Host Civic Summit 2025

Boston University Questrom School of Business
No event found!

Get Our Insights Newsletter

Get Insights straight to your inbox by signing up now.

    Popular Insights

    • Massachusetts Economy at Risk from Trump Administration Policies  

      Massachusetts Economy at Risk from Trump Administration Policies  

      18 shares
      Share 7 Tweet 5
    • I’m a business professor who asked dozens of former students how they define success. Here are their lessons for today’s grads

      10 shares
      Share 4 Tweet 3
    • Poets&Quants Names Two Questrom Students 2025 Best & Brightest MBAs

      7 shares
      Share 3 Tweet 2
    • Compounding pharmacies must stop making versions of Ozempic and Wegovy as shortage ends 

      8 shares
      Share 3 Tweet 2
    • How much profit do fireworks stands make?

      307 shares
      Share 123 Tweet 77

    Boston University Questrom School of Business
    595 Commonwealth Avenue
    Boston, MA 02215

    Follow Us

    Newsletter

    © 2023 Trustees of Boston University

    • About Us
    • Digital Business Institute
    • Human Resource Policy Institute
    • Susilo Institute for Ethics in the Global Economy

    Welcome Back!

    Sign In with Linked In
    OR

    Login to your account below

    Forgotten Password?

    Retrieve your password

    Please enter your username or email address to reset your password.

    Log In

    Add New Playlist

    Generic selectors
    Exact matches only
    Search in title
    Search in content
    Post Type Selectors
    Search in posts
    Search in Author
    Search Events
    Filter by Categories
    Action Learning
    Artificial Intelligence in Business
    Book Club
    Books
    BU Today
    Business Challenges
    Business Education
    Business Functions
    Business Policy & Markets
    Corporate Strategy
    Digital Business
    Digital Business Institute
    Diversity, Equity & Inclusion
    Entrepreneurship & Innovation
    Events
    Expert Take
    Feature
    Finance & Accounting
    Future of Business Education
    Future of Work
    Global Media
    Harvard Business Review
    Health, Biopharma, & Health-Tech
    Human Resources Policy Institute
    Innovation
    Insights Live
    Institute for Sustainable Energy
    Journals
    Language of Business
    Leadership & Management
    Local Media
    Marketing
    Media Mention
    Multimedia
    National Media
    Newsletter Spotlight
    Op-Ed
    Operations
    Opinion
    Our Insights
    Partners in Business Ethics
    Podcast
    Publications
    Research Institutes
    Risk
    ScienceDirect
    Silicon Valley Bank
    Sloan Management Review
    Social Impact
    Special Series
    Susilo Institute for Ethics in the Global Economy
    Technology
    The Brink
    Thinkers50@BUQuestrom: Passion & Purpose
    Videos
    • Business Challenges
      • Business Policy & Markets
      • Digital Business
      • Diversity, Equity & Inclusion
      • Entrepreneurship & Innovation
      • Future of Work
      • Health, Biopharma, & Health-Tech
      • Risk
      • Social Impact
    • Business Functions
      • Corporate Strategy
      • Finance & Accounting
      • Innovation
      • Leadership & Management
      • Marketing
      • Operations
      • Technology
    • Publications
      • Journals
      • Harvard Business Review
      • Sloan Management Review
    • Insights Events
      • All Events
      • Insights Live
      • Questrom Institute Events
    • Videos & Podcast
      • Videos
      • Insights@Questrom Podcast
      • Podcast
    • Voices in the Media
    • Our Experts

    © 2023 Trustees of Boston University

    -
    00:00
    00:00

    Queue

    Update Required Flash plugin
    -
    00:00
    00:00