Microsoft Kinect Heats Race Debate: Does Face-Recognition Software Discriminate?

Microsoft's Kinect for Xbox 360 has reignited the debate about whether facial-recognition software may be racist. The U.S. has made many strides over the past century toward treating people with equality regardless of the color of their skin, but it seems that technology, surprisingly, has moved at a slower pace. The launch of Microsoft's (MSFT) long-anticipated motion-sensing video game, Kinect for Xbox 360, has fueled the debate over whether facial-recognition software discriminates against some races.

GameSpot noted in a review Wednesday that Kinect's facial recognition capabilities appear to fail to recognize players with dark skin. It's by no means the first time that facial-recognition software has faced allegations of being less than fair and equal fashion. Remember last year's brouhaha over claims that HP's (HPQ) Webcams failed to track people with dark skin?

"It's unfortunate to have these incidents in the creation of a product," says Patrick Flynn, a professor of computer science and engineering at the University of Nortre Dame and a biometrics research who has authored papers on face recognition technology. "There's nothing like the harsh light of publicity to point out a need for a remedy."

Here's what GameSpot had to say in its review of the Kinect:
While testing out the Kinect, two dark-skinned GameSpot employees experienced problems with the system's facial-recognition abilities. The system recognized one employee inconsistently, while it was never able to properly identify the other despite repeated calibration attempts. However, Kinect had no problems identifying a third dark-skinned GameSpot employee, recognizing his face after a single calibration. Lighter-skinned employees were also consistently picked up on the first try.
Diversity Training for Software

While Flynn, who specializes in biometrics for government applications, noted that he's unfamiliar with the development process behind Microsoft's Kinect and other commercial products using face-recognition software, he said the difficulty with face-recognition software in general is that it usually needs to be trained to adequately detect various people.

Similar to voice-recognition software, in which accuracy improves the more it's exposed to a person's voice, face-recognition software works better with increased exposure to a person's face. "As a rule, it's been difficult to have a sufficient number of dark-skin people to provide the data needed to train these systems," Flynn says.

For one thing, it's expensive to recruit subjects, so companies often turn to "locals," such as their own employees and families, instead, he says. But "the demographic balance in the high-tech industry is not very representative of the country as a whole," Flynn says, pointing to a San Jose Mercury News article on diversity at Silicon Valley tech companies.

Another way to obtain facial data is to use databases assembled by other organizations, he says. "Some of these database are also lacking in demographic balance," he adds. "In some cases this is unavoidable on a practical level."

Why is it so expensive to build a diverse database pool? Researchers ideally need people to commit to having their photos taken numerous times over the course of days, weeks and preferably years, says Damon Woodard, an assistant professor at Clemson University and director of its biometrics and pattern recognition lab. And folks who are willing to be part of a data pool typically expect some form of compensation, he adds.

This data is critical when the face-recognition software is in the development stage. The greater the diversity of the people in the data pool, the better the chances it will work with the market it's designed to address. And diversity in the training process is especially important because most of these systems can't generalize. For example, it's proven extremely difficult to develop systems with flexible enough learning capabilities that they recognize eye shapes of people from Europe and not just of people from Northern Europe, Flynn says.

Further Investigation

Microsoft, for its part, is investigating the problems cited in the GameSpot report, according to an email statement. "We are investigating GameSpot's problems with the facial recognition feature of Kinect for Xbox 360. Kinect will work with people of all shapes and ethnicities," the company says.

When the HP Webcam issue arose late last year, Consumer Reports issued its own report finding that the problem had to do with inadequate lighting: One solution was to shine more light onto the face of users with dark skin.

And in the case of Microsoft's Kinect, Consumer Reports also found no problems in its tests. In a blog post late Thursday, it said:
The Kinect recognized both players at adequate light levels and failed to recognize both players at levels that were too low. At no time did it recognize one player and not the other...

....To sum up, the Kinect recognition issues affect automatic logins to the Xbox it's attached to if it's being used in poorly lit environments. But even without facial recognition, players can still log in to their personal avatars using simple hand-gestures or with standard Xbox controllers.
Regardless of whether the test from Consumer Reports or GameSpot proves to be more accurate, experts Woodard and Flynn both say they'd like to see more diversity in the data pool used to develop face-recognition software.

Increase your money and finance knowledge from home

How to Avoid Financial Scams

Avoid getting duped by financial scams.

View Course »

Introduction to Retirement Funds

Target date funds help you maintain a long term portfolio.

View Course »

Add a Comment

*0 / 3000 Character Maximum


Filter by:

This bogus claim of racism is unmitigated Commiecrat nonsense, and yet another attempt by the Demunists to shake down a corporation.

November 08 2010 at 8:32 AM Report abuse +1 rate up rate down Reply

There is a very simple solution for this problem. Allow for a utility that removes cyan from the facial recognition software for people of a darker ascent. Obviosly, the only thing racist about this what-so-ever is the fact that their focus groups did not contain anyone of darker nationalities. Either that, or the overall economic impact on the company for having this flaw is less damaging than spending the dollars necessary to fix the overall problem. Lets be honest corporations are all about trying to conserve economic share, the quicker the product hits the shelves the quicker the company can capitalize on it. Updates on programs happen all the time. Why shoould this be any different

November 08 2010 at 8:19 AM Report abuse +1 rate up rate down Reply

Yes, now your computer is racist. Next will be racist cars.

November 08 2010 at 6:50 AM Report abuse +1 rate up rate down Reply

This will be good news to the boys in the hood.

November 08 2010 at 3:45 AM Report abuse +1 rate up rate down Reply

Amazing, simply amazing. Rather than just saying that technology has it's work cut out for it; let's just call the folks developing it racists. Typical.

November 07 2010 at 10:54 PM Report abuse +5 rate up rate down Reply

Solar energy is racist, it is from the sun. Everyone knows the sun is pro-light.

November 07 2010 at 5:58 PM Report abuse +4 rate up rate down Reply

Good God does everything have to be racist? You don't like the president- you must be racist, it could not possibly have anything to do with the fact that you're a republican, the Kinect can't recgonize dark skinned faces-couldn't possibly have anything to do with the contrast issues. For God sake-I'm the LEAST racist person you will ever meet but this is becoming ridiculous!

November 07 2010 at 4:56 PM Report abuse +6 rate up rate down Reply

ya, cameras have a hard time recognizing objects that are not in high contrast... big surprise--- and not racist, just logical.

November 07 2010 at 4:09 PM Report abuse +3 rate up rate down Reply

It senses if you are a Mexican illegal alien then it tases you and calls ICE.

November 07 2010 at 12:52 PM Report abuse +4 rate up rate down Reply

Oh for crying out loud. It's called "still crawling on our knees" as far as technology is concerned. It's not directly done or purposely done. It's just part of what comes with the facial-recognition tech right now. Good Lord. I guess because this text is black and not white that it means white people are being discriminated when it comes to the use of colors of fonts? What-ever. Really.

November 07 2010 at 9:15 AM Report abuse +3 rate up rate down Reply