There's a new kind of game on the Internet. When you play it, you do more than simply rack up points or have fun. As you play, you help computers develop new skills.
Computer scientist Luis von Ahn created the games as a way to solve problems that are difficult for computers, even though the problems may seem simple to us. Computers, for example, have a hard time identifying a cat in a photo, while we can spot a cat at a glance.
The idea is to invent online games that people enjoy playing. Then, as people play, they provide data that researchers can use to improve computers. The players don't know that they're helping out. They're just having fun.
"The potential is huge," says computer scientist Manuel Blum, one of von Ahn's colleagues at Carnegie Mellon University in Pittsburgh. "These 'games with a purpose' make use of humans in a wonderful way."
By harnessing the brainpower of thousands of people playing games on the Internet, computers may learn how to identify pictures, translate Web pages into forms that blind people can use, develop common sense, understand foreign languages, and more. Seeing things
Our brains are wired to collect and process lots of information about what we see, von Ahn says.
Computers, on the other hand, simply "see" a grid of dark and light dots, called pixels. It's not obvious to a machine that a certain blob is a cat. Likewise a computer doesn't know that a tiger, a cartoon feline, and a kitty curled up on a couch all belong in the same category: cat.
"If you give me an image of some common animal, I can tell if you if it's a cat or a dog," von Ahn says. "Computers can't do that yet."
Because computers can't make such distinctions, search engines have a hard time finding images on the Internet. And getting people to label each image doesn't work well. There are billions of images, and the job is pretty boring.
The ESP Game (see www.espgame.org), invented by von Ahn and his coworkers, provides a quick, fun way to label images.
When you play the ESP Game, you get randomly paired with another player. Both of you see the same image on the screen, but you can't communicate in any way. You type in a word that describes the image. As soon as your partner types in exactly the same word, you both earn some points and another image appears. You can keep typing in new words until you again get a match, or you can pass and go on to the next image. Each round lasts 180 seconds and includes up to 15 images.
The first time I played the ESP Game, my Internet partner and I had a score that was better than the scores earned by only 40 percent of people who had played before us. We did better on the next round, though. And the next. It was hard to stop.
Although I should have been working, I played without feeling guilty. I knew I was doing something useful. Every match became a label for an image.
After each round of the ESP Game, you and your partner can find out where you stand.
So far, von Ahn's game program has collected more than 20 million descriptions. And the game appears to do its intended job.
"The labels given by the ESP Game are as accurate as ones generated by someone paid to label images," von Ahn says. Players also come up with about the same number of words for an image as paid professionals do, he adds.
Google has now developed Google Image Labeler (see images.google.com/imagelabeler), its own version of the ESP Game. Where's Waldo?
The labels provided by the ESP Game tell you what's in an image. But the game doesn't tell you where in an image a certain object might be.
To help solve this problem, von Ahn and his coworkers invented the two-player game Peekaboom (www.peekaboom.org).
One player sees an image--say, a cat playing with a dog--along with a word related to the picture. The other player sees a blank screen. By clicking on the image, the first player reveals a small piece of the image. The goal is to get the second player to guess the word in as few clicks as possible. After the second player correctly guesses the word or passes, the two players trade places. Each round lasts 4 minutes.
With each correct guess, the computer collects data about where things are within a picture. "That's exactly the type of information needed to train computers to see," von Ahn says.
Another image-labeling game, called Phetch (www.peekaboom.org/phetch), goes even farther. Instead of entering a single word, the first player writes a description of an image. Given that description, three other players then race to pick the right image out of a million or more possibilities. The program collects the descriptions that lead to quick results.
Programmed with such descriptions, computers might eventually be able to describe images to people who can't see. Software already exists that can read aloud words on computer screens, but these "screen readers" can't yet explain pictures. Having fun
As useful as these games are, they won't work unless people play them. That means the games must be fun. And figuring out what's going to be fun is easier said than done.
Like game manufacturers, von Ahn tests his games on people. On the basis of how long people play, what they say about the games, and which ones they choose to play again, von Ahn makes changes until he comes up with something that works.
"Nobody knows what makes games fun," von Ahn says, just like there aren't any rules for what makes a movie popular. "There's no formula," he says. "It's still an art."
Still, von Ahn has noticed some patterns. Randomness and unpredictability help, he says.
Players like to be able to get strategy tips that improve performance, Blum adds. Large point bonuses can't hurt. People like games that are competitive too. Displaying lists of top scores helps keep people playing.
Do you have thoughts about what makes a game great? Send them in, and we'll share them with the researchers. Your ideas could become part of a future formula for fun.
Most people would have no trouble identifying the kitten and two puppies in this photo--a task that a computer can't yet accomplish.
The ESP Game has collected more than 20 million labels for images since it debuted in late 2003.
In Peekaboom, one player tries to guess a word as another player reveals more and more of an image.
The game Phetch is an online treasure hunt that matches descriptions with images.
