It appears not even computers are immune from getting their proverbial 15 minutes of fame.

In this case, the IBM (IBM) supercomputer Watson will get its chance to grab the spotlight later this month. That's when it goes head-to-head with Jeopardy's two record-holders, Ken Jennings and Brad Rutter, in a classic man-against-machine contest. But beyond its near-human-like ability to sift through realms of information, parcel out the relevant parts and determine the likelihood of an answer being correct, Watson's brush with fame may help IBM attract more customers to the growing area of business analytics software.

Watson, with its 90 IBM Power 750 servers laced together, intones its answers with a robotic voice coming from a black rectangular box with a flashing globe stationed between the two Jeopardy rivals and its cluster of computers (the size of eight refrigerators) stationed behind its rivals. Watson is no mere wannabe: It won its practice round of the TV game show last month.




IBM engineers designed Watson to show how computer systems can analyze and process natural language, and reach predictions or answers. And much like humans, Watson relies heavily on context.

For example, take the word January. Most folks would assume that word's topic involves a month of the year. But how about the word Ramadan? People would also need to consider the context in which it's used to realize it also involves a month of the year.

Learning From Its Mistakes

"While we can get computers to follow complex reasoning tasks, it's very difficult to get them to do that over natural language," says David Ferrucci, principal investigator of Watson DeepQA technology for IBM Research. "And yet, that's where all the knowledge is, because all human knowledge is sort of naturally and prolifically created by humans to communicate with other humans."

He says Watson's servers can handle processing 500 gigabytes of information a second, the equivalent of 1 million books, with its shared computer memory. And according to Ferrucci, Watson's software is wired for more than handling natural language. Its machine learning allows the computer to become smarter as it tries to answer questions -- and to learn as it gets them right or wrong.

"It wasn't just any one algorithm that popped up and created change, but rather, I think you're seeing a combination of things happen," Ferrucci says. "Computers have access to so much language. And when you have access to lots and lots of language, you start to learn that these five paragraphs, for example, really say the same thing. To me that's important because my computer starts to learn semi-automatically, or completely automatically."

Training With Off-the-Shelf Info

Watson also has the capacity for knowledge representation and reasoning, which is essentially learning by context and employing language flexibility, like the intellectual flexibility needed in the January and Ramadan example. And, of course, it's also packed with deep analytics software for data-mining.

All this allows Watson's cluster of computers and stack of interlinking software to run a number of computations simultaneously, drawing on the bandwidth of some, or all, of the computers.

Prepping Watson to play Jeopardy required an additional layer of work. It began by pumping the machine up with off-the-shelf, as-is information from encyclopedias, dictionaries, plays and books.

"Watson had to be self-contained, so it couldn't be connected to anything else that wasn't right there in that room," Ferrucci says. He adds that the challenge for Watson was managing its own information, so it knew what it needed and what it didn't need. The trade-off was the more information Watson needed to compute, the more power it required.

"With Jeopardy, you can't anticipate all the questions that might be asked because the domain is very broad," Ferrucci says, noting it's also difficult to determine how the questions will be asked. "There is no simple template where everything fits in nicely, and you can query some database."

Watson is hard-wired into the electronic Jeopardy boards that send it text or information to ask the question, rather than having it rely on voice-recognition software to capture the question, Ferrucci says. Once the computer decides it wants to answer a question, Watson's hardware lets it push the Jeopardy button to answer.

Here's where Jeopardy players Jennings and Rutter will have the slight advantage in actually listening to the question being asked: They can anticipate the answer and buzz in immediately, Ferrucci says. Although Watson can't listen to the question and become trigger-happy with anticipation in pushing the button, its machine learning should make it more consistent in getting right answers.

The Supercomputer as Super Ad


Watson's participation in the Jeopardy challenge is expected to boost IBM's software and services business, analysts say. The company posted revenues of $29 billion in the fourth quarter, of which software brought in $7 billion and global technology services roughly a third. And business analytics revenue across Big Blue's software and services operations rose 19% over the previous year.

"Watson will help promote IBM's business intelligence, data analytics and data-warehousing software sales. It's all the software you want to use as a business solution," says Louis Miscioscia, an analyst with Collins Stewart.

He says Watson's expected high-profile performance next week will provide business executives with a demonstration of how its technology can query data and provide answers to complicated questions.

Having a computer handle natural language is a technology with broader implications, Ferrucci says. "It's getting access and learning how to reason over all these other kinds of content that are linked to knowledge. . . . That's why we got into this."

For example, Ferrucci says, Watson will serve as a way to tout IBM's analytics portfolio -- to show how unstructured information can be mined and cross-correlated in a big way. He also notes that Watson's work will be a boon for IBM's information management and artificial intelligence, demonstrating how data presented in natural language can be retrieved within seconds.

Heading to the Server Farm?

Ferrucci declines to speculate on any future revenue Watson may generate from IBM, other than to note that Watson won't make money from Jeopardy. The impact on information management will come more from how Watson solves Jeopardy questions.

And what's in store for Watson after Jeopardy? The server farm?

"We hope to continue to use Watson for research and to help with the adaption of health care and other industries," Ferrucci says. "We're not going to put him out to stud."


Increase your money and finance knowledge from home

Understanding Credit Scores

Credit scores matter -- learn how to improve your score.

View Course »

Finding Stock Ideas

Learn to do your research and find investments.

View Course »

Add a Comment

*0 / 3000 Character Maximum

16 Comments

Filter by:
ajschrod

My problem with the format is that "timing" is important for experts playing Jeopardy, while a machine responds instantly automatically. I watched Ken Jennings during his entire run, and he seemed to sense how much time he had AFTER clicking in--that is to say he didn't worry about right or wrong, but consistantly pressed his button first, THEN thought of an answer. Remarkable, but the computor don't have to use any strategy at all!

February 08 2011 at 10:11 PM Report abuse +3 rate up rate down Reply
Owie

I'd root for anything that might put Ken Jennings in his proper place. I don't think I have ever seen a more smug, self-serving individual on television. The fact that he trashed "Jeopardy" (after he won $1M, of course) after his reign only goes to show what a low-rent person he must be. I saw him on "Who Wants to be a Millionaire" a while back and when the answer was the name Jonathan Rhys-Davies (an actor), he (the purpored "expert" on this episode) answered, "Oh, you know, that effeminate English actor." Uh...Miss Jennings....take a good, hard look in the mirror.

February 08 2011 at 8:28 PM Report abuse -1 rate up rate down Reply
2 replies to Owie's comment
ajschrod

Finding fault with what Ken said means you don't agree with it? The stodgy routine Jeopardy had fallen into with Alex Trebek being the emcee over all those years was ripe for criticism, and only someone with Ken's long stay would get to see it! Did you notice the subtle changes in Jeopardy recently? Yes, he was rather effeminate, but much less blatently gay than others I've seen, and bringing that up at all makes me suspicious of your attitude here.

February 08 2011 at 10:19 PM Report abuse +2 rate up rate down Reply
lstucky

Ah shut the Hell up, you jealous tool. He put Jeopardy back in the spotlight, you homophobe.

February 09 2011 at 4:41 AM Report abuse +1 rate up rate down Reply
Tom

Alrighty then...I have just one Jeopardy answer, as a male, that I would like Watson (being a masculine name I would assume that his gender is male) to give an answer for. That is: Women

February 08 2011 at 1:28 PM Report abuse rate up rate down Reply
stsue0705

When is this going to happen?

February 08 2011 at 1:28 PM Report abuse rate up rate down Reply
1 reply to stsue0705's comment
Marilyn Suzanne

Over three days...Feb.14,15 and 16

February 08 2011 at 7:01 PM Report abuse rate up rate down Reply
number10dream

In 1997 I went to Philadelphia to see Gary Kasparov play chess against IBM's deep blue. I found it fascinating and exciting. I will always believe that the match was not fair - the computer played a markedly different game after the first few rounds. The parameters were changed - in my mind Kasparov was cheated of a victory.

I will be watching this Jeopardy match with eager anticipation.

I have followed some of the work of Ray Kurzweil for a number of years. I have a copy of his book - "The singularity is Near " (I haven't finished it yet).

I firmly believe that there is strong reason to believe that within the next few decades humans will create a machine intelligence that has the capacity to challenge human intelligence. I believe that current research will lead to "artificial intelligence" that will be able to challenge human intelligence.

We are living in interesting times.

February 08 2011 at 12:09 PM Report abuse +4 rate up rate down Reply
3 replies to number10dream's comment
Iselin007

If Watson is so smart it can figure out how to get deceased Wall Streeters out of hell right?

February 08 2011 at 11:32 AM Report abuse rate up rate down Reply
Iselin007

Laid off and low paid workers can add their income with their middle finger they don't need IBM.

February 08 2011 at 11:30 AM Report abuse -2 rate up rate down Reply
Iselin007

Companies rather have accountants cook their books than a super computer.

February 08 2011 at 11:28 AM Report abuse +1 rate up rate down Reply
niraj

Cant wait to watch this alter this month!!!

February 08 2011 at 10:34 AM Report abuse rate up rate down Reply
1 reply to niraj's comment
traji

mee too. I am definately curious about "watson"

February 08 2011 at 1:18 PM Report abuse +1 rate up rate down Reply