Blog
Bias in Hiring

Just as Humans Are What We Eat, AI Is What It’s Fed

Bias in data is not just an abstract concept—it’s a real-world problem that affects everything from the design of safety equipment to how we hire and promote employees.

September 25, 2024

Bias in data is not just an abstract concept—it’s a real-world problem that affects everything from the design of safety equipment to how we hire and promote employees. We often think of data as objective and infallible, but the reality is far more nuanced. When data reflects historical inequalities and biases, AI systems built on that data can perpetuate and even amplify these issues. As someone who’s passionate about using technology responsibly, I believe it’s crucial to understand how biases sneak into large data sets, their implications, and how we can design AI systems to be more equitable.

Everyday Examples of Bias in Data

1. The Seat Belt Example: Data Skewed Towards Men

Take seat belt designs, for instance. It’s a safety feature that should protect everyone equally, right? Unfortunately, most crash-test dummies used to test seat belts are modeled after the average male physique. This has led to a higher risk of injury for women, especially those who are pregnant, as the design doesn’t account for the different body structures and biomechanics. This oversight isn’t just a minor flaw; it’s a life-threatening bias built into a system designed to save lives.

2. Neurodiversity in Women: A Hidden Bias

Another overlooked area is the diagnosis and support of neurodiverse conditions in women. For years, ADHD and autism research focused predominantly on male symptoms, leaving many women undiagnosed or misdiagnosed. The data used to define these conditions was skewed towards male behavioral patterns, leading to a significant gap in understanding how these conditions manifest in women. This has had a profound impact on the support and resources available to neurodiverse women.

3. Racial Bias in Everyday Systems

Racial bias is another area where skewed data can have devastating effects. For example, facial recognition systems have been shown to misidentify people of color at much higher rates than white individuals. This discrepancy isn’t just inconvenient—it can have serious consequences when such systems are used for security or law enforcement purposes. The underlying data, which often lacks sufficient diversity, feeds into the AI, resulting in biased outcomes.

From Everyday Bias to Recruiting Bias

These biases aren’t confined to safety features or medical diagnoses—they also pervade the world of recruiting. AI systems designed to screen resumes or match candidates to job openings are only as good as the data they’re trained on. If the data reflects historical biases, like a preference for certain educational backgrounds or work experiences that favor men over women or majority over minority groups, the AI will likely replicate those biases.

For example, if an AI system is trained on historical hiring data from a company that has predominantly hired men, it may learn to favor male candidates, even if gender isn’t explicitly mentioned. Similarly, it might prefer candidates from a particular set of universities that may already skew towards certain populations, further narrowing the pool of high caliber talent and in-turn perpetuating hiring biases.

AI: An Amplifier of Human Bias or a Tool for Equity?

So, how do we address this? Just as humans are what we eat, AI is what it’s fed. The data we use to train AI systems must be carefully curated to ensure it’s representative and free from biases. This involves more than just removing biased data—it requires active efforts to include diverse perspectives and experiences.

  1. Diverse Data Sets: We need to ensure that the data used to train AI includes a wide range of experiences and backgrounds. This means actively seeking out data that reflects the diversity of the population, whether it’s in terms of gender, race, age, neurodiversity or more.
  2. Bias Audits: Regularly auditing AI systems for biases can help identify and mitigate potential issues. This should be an ongoing process, not a one-time check, as new biases can emerge as data and societal norms change.
  3. Transparency and Explainability: AI systems must be transparent and explainable, so users can understand how decisions are made and challenge them if necessary. This is particularly important in recruiting, where the stakes are high for both companies and candidates.
  4. Ethical AI Design: Companies need to adopt ethical AI design principles that prioritize fairness and inclusivity from the ground up. This means not only using diverse data but also involving diverse teams in the design and implementation of AI systems.

The Critical Nature of AI Done Right

AI has the potential to either perpetuate existing biases or help us overcome them. It’s all about how we build and use these systems. At Humanly, we’re committed to ethical AI and making sure our tools are designed to help, not harm. We believe that by focusing on transparency, inclusivity, and ongoing improvement, we can create AI that truly supports people.

Just as Humans are what we eat, we need to be equally mindful of the data we feed our AI systems. After all, the goal isn’t just to build smarter machines—it’s to build a fairer, more equitable world.

More Resources

View all
Sort
Automated Candidate Sourcing: Best Practices For Skipping Recruitment Drought and Deluge
We explore new playbooks for candidate sourcing predictability
August 8, 2024
Recruit Your Way to the Championship
How Humanly.io, Lisa Brummel, Arik Armstead, and Richaun Holmes Champion Diversity
November 30, 2023
7 Ways to Remove Bias From Your Screening Process
Legacy screening processes are rife with bias
November 30, 2023
Humanly Placed in Will Reed's Top 100 Workplace Culture Ranking
Humanly a top 100 culture award recipient
September 10, 2024
Humanly Placed in Will Reed's Top 100 Workplace Culture Ranking
Humanly a top 100 culture award recipient
September 10, 2024
Humanly Named Top AI Recruiting Software By Select Software Reviews
4.7/5 rating and a "must buy" for mid-sized teams already using an ATS
January 1, 2024
Humanly Named Top AI Recruiting Software By Select Software Reviews
4.7/5 rating and a "must buy" for mid-sized teams already using an ATS
January 1, 2024
Humanly Named Geekwire 2022 Best UX Design Of The Year
GeekWire Awards judges said they “We were impressed with their focus on diversity and this was apparent in several areas and features of the platform.”
October 11, 2022
Humanly Named Geekwire 2022 Best UX Design Of The Year
GeekWire Awards judges said they “We were impressed with their focus on diversity and this was apparent in several areas and features of the platform.”
October 11, 2022
Humanly Named 2022 HR Tech Awardee For Talent Acquisition
We welcome this large step for our quickly growing organization.
September 19, 2022
Humanly Named 2022 HR Tech Awardee For Talent Acquisition
We welcome this large step for our quickly growing organization.
September 19, 2022
Humanly Wins Multiple Placements In G2 Winter 2024 Reports
Our journey in shaking up talent acquisition just hit new heights, nailing spots in both Recruiting Automation and Chatbot sectors.
January 1, 2024
Humanly Wins Multiple Placements In G2 Winter 2024 Reports
Our journey in shaking up talent acquisition just hit new heights, nailing spots in both Recruiting Automation and Chatbot sectors.
January 1, 2024
TheKey
10x decrease in application time with TheKey
April 21, 2024
Moss Adams
5x hiring team productivity with Moss Adams
April 23, 2024
There are no other white papers at the moment
Mr Meaningful Work and Arkesh Mishra
Tim and Arkesh Mishra - Head of People @ Walmart U.S. Tech - explore how AI is reshaping the future of work, the importance of skills-based approaches in talent management, and the critical role of empathy and well-being in driving performance.
July 9, 2024
Mr Meaningful Work and Tim Sackett
In this episode Tim Sackett shares his view on the evolving landscape of recruitment and leadership in the age of AI. Delving into the importance of embracing AI and technology, focusing on data-driven decisions, and enhancing organizational talent.
June 25, 2024
Mr Meaningful Work and Guests Kick Off What's Humanly Possible
Join Mr. Meaningful Work, Tim O'Leary and the Humanly team as we kick off our podcast "What's Humanly Possible"
June 11, 2024
Mr Meaningful Work and the Queen of Hearts
In our second episode of "What's Humanly Possible" Tim - Mr. Meaningful Work - O'Leare meets with Chief Heart Officer at Vayner Media Claude Silver. The pair talk through the role of empathy in building high performing teams as well as the whole lifecycle of hiring and talent acquisition
June 11, 2024
Efficient, Equitable & Empathetic Candidate Conversations with Katrina Collier and Prem Kumar
Katrina Collier, author of The Robot-Proof Recruiter, and Prem Kumar, CEO of Humanly, dive deep into the evolving role of AI in recruitment
October 2, 2024
Efficient, Equitable & Empathetic Candidate Conversations with Katrina Collier and Prem Kumar
Katrina Collier, author of The Robot-Proof Recruiter, and Prem Kumar, CEO of Humanly, dive deep into the evolving role of AI in recruitment
October 2, 2024
Chisel Presents: Learnings From Building AI Products
Featuring Humanly CEO Prem Kumar
September 16, 2024
Chisel Presents: Learnings From Building AI Products
Featuring Humanly CEO Prem Kumar
September 16, 2024
The Role of AI in Modern Recruiting [Podcast]
Listen in as Prem explores the potential of AI to match candidates, manage high applicant volumes, and improve communication, and highlights the need for data protection and trust in AI systems.
August 15, 2024
The Role of AI in Modern Recruiting [Podcast]
Listen in as Prem explores the potential of AI to match candidates, manage high applicant volumes, and improve communication, and highlights the need for data protection and trust in AI systems.
August 15, 2024
AI in Hiring: From Microsoft to Humanly's Recruitment Solutions | Episode 14
AI in hiring podcast chats with Prem Kumar on Humanly's approach to high-volume hiring using conversational AI
August 6, 2024
AI in Hiring: From Microsoft to Humanly's Recruitment Solutions | Episode 14
AI in hiring podcast chats with Prem Kumar on Humanly's approach to high-volume hiring using conversational AI
August 6, 2024
How Can Technology Optimize the Hiring Proceess? With Prem Kumar
In this Endevis "Talent Tide" podcast episode, Chris discusses the benefits of using AI in the hiring process with Humanly CEO Prem Kumar.
October 18, 2022
How Can Technology Optimize the Hiring Proceess? With Prem Kumar
In this Endevis "Talent Tide" podcast episode, Chris discusses the benefits of using AI in the hiring process with Humanly CEO Prem Kumar.
October 18, 2022
Prem Kumar, CEO of Humanly.io: $5.5 Million Raised to Build the Conversational Hiring Category
Category Visionaries — the show that explores GTM stories from tech’s most innovative B2B founders. In today’s episode, we’re speaking with Prem Kumar, CEO of Humanly, a recruiting tech platform that has raised $5.5 million in funding.
November 7, 2023
Prem Kumar, CEO of Humanly.io: $5.5 Million Raised to Build the Conversational Hiring Category
Category Visionaries — the show that explores GTM stories from tech’s most innovative B2B founders. In today’s episode, we’re speaking with Prem Kumar, CEO of Humanly, a recruiting tech platform that has raised $5.5 million in funding.
November 7, 2023
Transforming the Recruitment Process with Humanly's Prem Kumar
HR Tech Spotlight discusses Humanly.io with a focus on conversational AI for high-volume professional hiring.
September 6, 2022
Transforming the Recruitment Process with Humanly's Prem Kumar
HR Tech Spotlight discusses Humanly.io with a focus on conversational AI for high-volume professional hiring.
September 6, 2022
Firing Squad: Humanly's Prem Kumar
It's not often we get a Y Combinator company to pitch on Firing Squad, so let's start with 'you're welcome, listeners.' So, who's up? CEO Prem Kumar brings his A Game.
October 17, 2023
Firing Squad: Humanly's Prem Kumar
It's not often we get a Y Combinator company to pitch on Firing Squad, so let's start with 'you're welcome, listeners.' So, who's up? CEO Prem Kumar brings his A Game.
October 17, 2023
HR Tech Insights Featuring Markellos Diorinos, Prem Kumar And Rob Catalano
This interview is part of a new series called HR Tech Insights for the Workology Podcast, sponsored by UpSkill HR and Ace the HR Exam.
August 10, 2021
HR Tech Insights Featuring Markellos Diorinos, Prem Kumar And Rob Catalano
This interview is part of a new series called HR Tech Insights for the Workology Podcast, sponsored by UpSkill HR and Ace the HR Exam.
August 10, 2021
Deck Review: Humanly
Humanly's founders communicated a big opportunity on a level investors could easily understand
November 18, 2020
Deck Review: Humanly
Humanly's founders communicated a big opportunity on a level investors could easily understand
November 18, 2020
A Chat with Prem Kumar, CEO of the HR Tech Company Humanly.io
Favorite podcasts, AI-augmented recruiting, parenting app wishlists, and more.
October 14, 2020
A Chat with Prem Kumar, CEO of the HR Tech Company Humanly.io
Favorite podcasts, AI-augmented recruiting, parenting app wishlists, and more.
October 14, 2020
The New Age of Hiring: AI Is Changing the Game for Job Seekers
Automation, algorithms and machine learning are taking over recruitment and hiring. How do we compete with the rise of robots?
June 9, 2023
The New Age of Hiring: AI Is Changing the Game for Job Seekers
Automation, algorithms and machine learning are taking over recruitment and hiring. How do we compete with the rise of robots?
June 9, 2023
SAP.iO Foundry San Francisco Future of Work Cohort
Meet the startups joining the Spring 2021 Future of Work Program at the SAP.iO Foundry San Francisco
April 14, 2021
SAP.iO Foundry San Francisco Future of Work Cohort
Meet the startups joining the Spring 2021 Future of Work Program at the SAP.iO Foundry San Francisco
April 14, 2021
All the companies from Y Combinator’s W20 Demo Day, Part I: B2B Companies
Y Combinator’s Demo Day was a bit different this time around.
April 24, 2020
All the companies from Y Combinator’s W20 Demo Day, Part I: B2B Companies
Y Combinator’s Demo Day was a bit different this time around.
April 24, 2020
Product Manager To CEO | Using AI To Increase Equity When Hiring
Today’s job application experience often falls very short of that world. Candidates find themselves repeating the same steps without feedback, positive or negative, while key questions are left unanswered until late in the process.
January 29, 2024
Product Manager To CEO | Using AI To Increase Equity When Hiring
Today’s job application experience often falls very short of that world. Candidates find themselves repeating the same steps without feedback, positive or negative, while key questions are left unanswered until late in the process.
January 29, 2024
Recruiting automation startup Humanly lands $12M as it doubles down on AI
GeekWire’s in-depth startup coverage tells the stories of the Pacific Northwest entrepreneurial scene.
September 13, 2023
Recruiting automation startup Humanly lands $12M as it doubles down on AI
GeekWire’s in-depth startup coverage tells the stories of the Pacific Northwest entrepreneurial scene.
September 13, 2023
GeekWire Awards: How this startup CEO adapted to the pandemic, economic downturn and his own fatigue
Geekwire covers the founding story of Humanly and the challenges surmounted by CEO Prem Kumar
September 20, 2023
GeekWire Awards: How this startup CEO adapted to the pandemic, economic downturn and his own fatigue
Geekwire covers the founding story of Humanly and the challenges surmounted by CEO Prem Kumar
September 20, 2023
From Artificial Intelligence to Human Intelligence
A once in a generation opportunity to revolutionize HR with AI
March 20, 2024
From Artificial Intelligence to Human Intelligence
A once in a generation opportunity to revolutionize HR with AI
March 20, 2024
Humanly Shines Across the Board in G2’s Winter 2025 Reports!
We've notched wins across the boards in G2's winter reports for 2025! See what high performing TA teams are saying about us.
December 19, 2024
Humanly Shines Across the Board in G2’s Winter 2025 Reports!
We've notched wins across the boards in G2's winter reports for 2025! See what high performing TA teams are saying about us.
December 19, 2024
Humanly Acquires Teamable, Introducing an AI-First End-to-End Recruiting Powerhouse
Raising the Bar: Putting Candidates First, With Recruiting Teams in the Driving Seat
May 28, 2024
Humanly Acquires Teamable, Introducing an AI-First End-to-End Recruiting Powerhouse
Raising the Bar: Putting Candidates First, With Recruiting Teams in the Driving Seat
May 28, 2024
Empowering the Future of Hiring: Humanly Raises $12M Series A to Fuel Innovation and Growth
$12M to Innovate Hiring, Promising a Future Where AI Leads the Way.
November 29, 2023
Empowering the Future of Hiring: Humanly Raises $12M Series A to Fuel Innovation and Growth
$12M to Innovate Hiring, Promising a Future Where AI Leads the Way.
November 29, 2023
Ask the Question: What’s Beyond What You Already Think and Know About Hiring?
The future of recruiting is build on transparent relationships
November 29, 2023
Ask the Question: What’s Beyond What You Already Think and Know About Hiring?
The future of recruiting is build on transparent relationships
November 29, 2023
Building An Ethical AI Framework For Recruitment With Talent Collective
We join talent acquisition leaders to talk through how to implement ethical AI frameworks in recruiting, balancing efficiency, fairness, and the human touch
November 26, 2024
Building An Ethical AI Framework For Recruitment With Talent Collective
We join talent acquisition leaders to talk through how to implement ethical AI frameworks in recruiting, balancing efficiency, fairness, and the human touch
November 26, 2024
Humanly AI Product Showcase at SourceCon 2024
In this talk, we’ll explore how to streamline sourcing and outreach using ethical AI while enhancing the candidate experience.
November 26, 2024
Humanly AI Product Showcase at SourceCon 2024
In this talk, we’ll explore how to streamline sourcing and outreach using ethical AI while enhancing the candidate experience.
November 26, 2024
What's AI Sourcing?
Discover how Humanly's AI-powered sourcing tools can revolutionize your candidate sourcing process, making it faster, smarter, and more efficient.
September 10, 2024
What's AI Sourcing?
Discover how Humanly's AI-powered sourcing tools can revolutionize your candidate sourcing process, making it faster, smarter, and more efficient.
September 10, 2024
What's AI Referrals?
Employee referrals can be your secret weapon, even in times when hiring is competitive.
September 10, 2024
What's AI Referrals?
Employee referrals can be your secret weapon, even in times when hiring is competitive.
September 10, 2024
Transforming Hiring with AI
Join Humanly CEO Prem Kumar in conversation with recruiting innovator Anthony Rotoli, CEO of InterviewAI
September 4, 2024
Transforming Hiring with AI
Join Humanly CEO Prem Kumar in conversation with recruiting innovator Anthony Rotoli, CEO of InterviewAI
September 4, 2024
Ethical AI Governance and Best Practices for AI-Powered Recruiting
How leading HR teams are navigating AI governance to ensure ethical practice and compliance in a rapidly-evolving landscape.
August 29, 2024
Ethical AI Governance and Best Practices for AI-Powered Recruiting
How leading HR teams are navigating AI governance to ensure ethical practice and compliance in a rapidly-evolving landscape.
August 29, 2024
SHRM - Ethical HR to Talent Trends, AI in HR
Explore the future of ethical AI in HR with SHRM and Humanly.
March 1, 2024
SHRM - Ethical HR to Talent Trends, AI in HR
Explore the future of ethical AI in HR with SHRM and Humanly.
March 1, 2024
Empowering Skills-First Hiring using AI
iMocha, Bryq, and Humanly explore merging soft skills and technical expertise to build future-ready teams
April 23, 2024
Empowering Skills-First Hiring using AI
iMocha, Bryq, and Humanly explore merging soft skills and technical expertise to build future-ready teams
April 23, 2024
Ensuring Responsible AI: Humanly's Governance and Safety Measures
How Humanly Implements Industry-Leading AI Governance and Guardrails
September 16, 2024
Building Trust with Ethical AI in Recruitment: Humanly's Approach
Empowering People, Amplifying Potential with Responsible AI Solutions
September 16, 2024
Navigating Candidate Overload and Drought: Sourcing Tactics For Recruiters
Traditional candidate sourcing faces numerous limitations. See how we're solving sourcing with AI that keeps smarter human conversation at the center of hiring.
July 19, 2024
What Does Equitable AI For Hiring Look Like
The risks and what you can do about them
April 24, 2024

Book a demo with us

Humanly is trusted by Fortune 500's and quickly-growing startups alike.