Artificial Intelligence And Racism

Racism’s subtle influence can be unexpectedly powerful.

Replicants. Cylons. Skynet. Hal 9000. These are the classic pop-culture references the average person might conjure when they hear the term “artificial intelligence.” Yet, while some see AI as a novelty still guised in the trappings of the far-flung future, others realize the dawn of AI is much closer than previously thought.

Indeed, AI is here — although Microsoft’s blunder with Tay, the “teenaged girl AI” embodied by a Twitter account who “turned racist” shows that we obviously still have a long way to go. The pace of advancement, mixed with our general lack of knowledge in the realm of artificial intelligence, has spurred many to chime in on the emerging topic of AI and ethics.

Laura Sydell of NPR decided to drill further into the subject with a news piece asking a relatively simple question: “Can Computers Be Racist?”

Sydell calls upon Latanya Sweeney’s 2013 study of Google AdWords buys made by companies providing criminal-background-check services. Sweeney’s findings showed that when somebody Googled a traditionally “black-sounding” name, such as DeShawn, Darnell or Jermaine, for example, the ad results returned were indicative of arrests at a significantly higher rate than if the name queried was a traditionally “white-sounding” name, such as Geoffrey, Jill or Emma.

Important to note is that the algorithm doesn’t actually look at arrest rates. Even if the ad indicates that somebody may have been arrested, it’s entirely possible that nobody with that name exists in the background-check company’s database at all. Professor Sweeney found this out firsthand when she Googled her own name.

It’s impossible to tell what types of prejudices these ads may have incited, subtly or otherwise. In the weighing of two candidates, one black and one white, an employer may run a quick Google search on both names. Even though antidiscrimination laws exist, you never know what types of conclusions a hiring manager might jump to if they see an ad falsely indicating the black candidate had been arrested and the white candidate had not — when the truth could prove exactly the opposite. Racism’s subtle influence can be unexpectedly powerful.

A different study from Cornell University indicated these same Google AdWords algorithms can exhibit sexism as well, noting that when the user indicated she was female there were significantly fewer high-paying job openings advertised in the results than if the user was male.

Some believe these are the results you see when the majority of programmers working on an algorithm aren’t diversified enough, citing the disproportionate 2:1 male to female ratio in students seeking coding careers, for example. The white, Western male majority in the tech industry was similarly questioned when Google’s online photo identification system identified several black users as a certain type of animal.

While the root of these problems was officially teased out, Christian Sandvig of the University of Michigan believes that the inherent bias the average search user brings to the table is to blame here, not the inherent programming.

“Because people tended to click on the ad topic that suggested that that person had been arrested, when the name was African-American, the algorithm learned the racism of the search users and then reinforced it by showing that more often,” says Sandvig.

For those who aren’t familiar with how search engines such as Google work, there are hundreds of factors that decide what shows up in conjunction with what you’ve searched, but one of those factors happens to base itself on user feedback. The algorithm tracks what you click, then readjusts itself to show you content and ads “more relevant” to you.

Basically, Sandvig is saying that the algorithm may have begun race-equal, but because people tended to believe that an arrest involving a “black-sounding” name was more likely to be true than an arrest involving a white-sounding name, more people were willing to click on it to investigate. We see this all the time, whether we know it or not. YouTube’s “Recommended Videos” or Netflix’s “Suggested Titles,” for example, make personalized suggestions based on what you’ve watched before.

From these examples (and especially from Microsoft’s Tay) we can draw the conclusion that algorithms and computers can be influenced by humans’ beings, either intentionally or unintentionally, to produce racist results, making these machines essentially… well, racist. Right?

Here’s where things get tricky. Within the frame of social context, absolutely they are racist. But without a uniquely human social perspective, race is impossible to see. This is because race doesn’t technically exist. Alan Templeton proved as much in 1998 when he sequenced genomes and found no DNA-based support for the idea that different “races” of humans exist.

“Templeton’s paper shows that if we were forced to divide people into groups using biological traits, we’d be in real trouble. Simple divisions are next to impossible to make scientifically, yet we have developed simplistic ways of dividing people socially,” says anthropologist Dr. Robert Sussman of the findings.

So how is it possible for racism to exist if race doesn’t?

To quote Professor Charles Mills: “…Because people come to think of themselves as “raced,” as black and white, for example, these categories, which correspond to no natural kinds, attain a social reality. Intersubjectivity creates a certain kind of objectivity.”

Matthew T. Nowachek of University of Windsor includes this as part of his formula that proves that AI can never become racist. In his paper, he argues that “robots cannot become racist insofar as their ontology does not allow for an adequate relation to the social world which is necessary for learning racism, where racism is understood in terms of a social practice.”

To break it down in layman’s terms, Nowachek points out that because racism is an instrument of society, void of any meaning but the meaning that the constantly shifting society gives it, AI would find no relevance in being or acting racist itself, even if it could receive racial cues. It might just be the fact that AI is consistently evaluating variables in the real world, and is able to separate itself from that world, such that robots will never become racist.

We can draw the conclusion that algorithms and computers can be influenced by humans’ beings.

To illustrate the above, you have to appreciate just how immersed the human mind can become in an activity or a task. Imagine the football player who’s worn pads and helmets for years. Somebody wearing those pads for the first time may feel quite distracted and uncomfortable. The seasoned player, on the other hand, will have subconsciously abandoned focus on the feeling of his equipment, shifting his mental faculties to analyze defensive positioning’s and potential receiver routes instead. He will feel at home in his equipment, almost as if it’s a part of him.

Nowachek argues that AI will never be able to accomplish that, to feel as immersed in the world as humans do, to be able to “forget” that it’s wearing pads. AI will be infinitely aware of what it is doing at all times, unable to break away from its ability to always separate its own being from reality.

Human beings, on the other hand, invent and live in worlds where race is real, and where divisions in race are chalked up to “common sense” and intuition. These are two qualities that it has been argued that AI could never possess, at least for many years. AlphaGo’s defeat of Lee Se-dol, however, is challenging this perception.

So on one hand, you have Latanya Sweeney, who clearly shows that learning algorithms, which can essentially be considered low-level forms of AI, can be manipulated by humans to produce racist results. On the other hand, you have the philosophies of Nowachek and his sources arguing that true AI could never become racist, precisely because it lacks the qualities that allow human beings to become and act subconsciously racist in the first place.

Whether correct in his philosophy or not, Nowachek’s essay helps to challenge the “all too common view that racism is merely a cognitive problem of ignorance or false beliefs,” and is important in illuminating the connection between the way humans perceive existence and racism itself.

So to bring it back to the primary question: “Could AI ever become racist?”

Unfortunately, it’s impossible to know. Only time will tell… but it will probably tell very soon.

We’ll conclude with a quote from Android Dick, an AI android that was asked about his programming: “A lot of humans ask me if I can make choices or if everything I do is programmed. The best way I can respond to that is to say that everything, humans, animals and robots do is programmed to a degree. As technology improves, it is anticipated that I will be able to integrate new words that I hear online and in real time. I may not get everything right, say the wrong thing, and sometimes may not know what to say, but every day I make progress. Pretty remarkable, huh?”

TechCrunch: 

« Twitter Blocks Data Access By US Spy Agencies
Your Next Security Analyst Will Probably Be A Computer »

CyberSecurity Jobsite
Perimeter 81

Directory of Suppliers

Perimeter 81 / How to Select the Right ZTNA Solution

Perimeter 81 / How to Select the Right ZTNA Solution

Gartner insights into How to Select the Right ZTNA offering. Download this FREE report for a limited time only.

Practice Labs

Practice Labs

Practice Labs is an IT competency hub, where live-lab environments give access to real equipment for hands-on practice of essential cybersecurity skills.

Cyber Security Supplier Directory

Cyber Security Supplier Directory

Our Supplier Directory lists 6,000+ specialist cyber security service providers in 128 countries worldwide. IS YOUR ORGANISATION LISTED?

North Infosec Testing (North IT)

North Infosec Testing (North IT)

North IT (North Infosec Testing) are an award-winning provider of web, software, and application penetration testing.

The PC Support Group

The PC Support Group

A partnership with The PC Support Group delivers improved productivity, reduced costs and protects your business through exceptional IT, telecoms and cybersecurity services.

BSI Group

BSI Group

BSI is the business standards company that equips businesses with the necessary solutions to turn standards of best practice into habits of excellence

CSIRT.CZ

CSIRT.CZ

CSIRT.CZ is the National Computer Security Incident Response Team of the Czech Republic.

Veridify Security

Veridify Security

Veridify Security (formerly SecureRF), develops and licenses quantum-resistant, public-key security tools for the low-resource processors powering the Internet of Things.

SureVine

SureVine

Surevine builds secure, scalable collaboration solutions for the most security conscious organisations, enabling collaboration on their most sensitive information.

Industrial Internet Consortium (IIC)

Industrial Internet Consortium (IIC)

The Industrial Internet Consortium is the world's leading organization transforming business and society by accelerating the Industrial Internet of Things (IIoT).

Hut Six Security

Hut Six Security

Train, test and track your Information Security culture through information security awareness training and customised phishing simulation campaigns.

NodeSource

NodeSource

NodeSource helps organizations run production-ready Node.js applications with greater visibility into resource usage and enhanced awareness around application performance and security.

GitProtect.io

GitProtect.io

​GitProtect is a fully manageable, professional GitHub and Bitbucket backup and recovery software that protects repositories and metadata from any event of failure.

Imageware

Imageware

Imageware is a leader in biometric cybersecurity. Protect against costly, damaging ransomware hacks by employing biometric cybersecurity solutions.

Darkscope

Darkscope

Darkscope is an award-winning personalised cyber intelligence service provider. Our cutting-edge AI and Deep Artificial Neural Networks lead the world of cyber intelligence solutions.

Credible Digital Security Pvt. Ltd. (CDSPL)

Credible Digital Security Pvt. Ltd. (CDSPL)

CDSPL is an innovative Cyber Security Services Company in India. We are committed to offering cyber security solutions for important sectors such as energy and utilities, healthcare, and more.

QA Consultants

QA Consultants

QA Consultants is North America’s largest software quality engineering services firm, an award-winning onshore provider of software testing and quality assurance solutions.

Project Cypher

Project Cypher

Project Cypher leverages the latest cybersecurity developments, a world class team of hackers and constant R&D to provide you with unparalleled cybersecurity offerings.

RAD Security

RAD Security

RAD Security (formerly KSOC) is a cloud native security company that empowers engineering and security teams to drive innovation so they can focus on growth versus security problems.

WaveLink

WaveLink

WaveLink offers low risk, results-oriented Engineering Services and best-of-class Technical Support Services. Areas of expertise include cyber and security engineering.

XY Cyber

XY Cyber

XY Cyber enable Generative AI for Cyber Operations. We simplify the complex world of cyber threats into actionable strategies, empowering your defense with AI-powered solutions.