Letters posted here are associated with the following article:

17
Letters
Monday, October 13, 2008 12:00 AM

German chatbot almost passes the Turing Test

"Elbot" fools 25 percent of judges.

The letters thread is now closed.

View:
Monday, October 13, 2008 01:24 PM

Almost ...

If the author's conversation attempt is any guide (and extensive experience working with chatterbots tells me it is) then one simply must question the sobriety of the 12 judges that mistook the bot for human. I mean ... seriously! They'd have had to be either completely drunk, in the throes of an ADD event or limited to holding discussions with high school freshman ... with ADD. There's (obviously) still a loooong way to go before chatterbots have any chance of passing the Turing Test in public.

Monday, October 13, 2008 01:26 PM

alternative headline: Elbot qualified to be Vice-President !!

That's my time... remember to tip your waitstaff.

Monday, October 13, 2008 01:53 PM

Sorry Elbot!

But you're just not as cool as the Giant Killer Robots Controlled By Monkeys!

http://www.sciam.com/article.cfm?id=monkeys-see-monkey-do-wit&ec=ypi

(Well, hopefully that will be the next stage of their development!)

Monday, October 13, 2008 02:18 PM

Any blogger can fake being something like a human being

Well a stonerbot at any rate. 95% of Facebook could be marginally smart cockroaches or a digital thermostat.

Monday, October 13, 2008 02:21 PM

Sounds like Eliza....

I know the so-called interview in the article is a spoof, but its echo response reminds me of that very, very old program "Eliza" which offered an alternative to live human-to-human talking therapy.

Eliza basically took the human's every comment and turned it into a question, e.g.,

Human: "I feel sad"

Eliza: "Why do you feel sad"

etc.etc.et cetera

I would love to have a chance at a conversation with Elbot.

Monday, October 13, 2008 02:54 PM

Alaskan gov. palin almost passes the Turing Test

http://www.wordreplacer.com/cache/g081013234430495813

Monday, October 13, 2008 04:28 PM

Looked like CRAP to me!

That transcript wouldn't have fooled me. Were the judges humans or computers?

I find the subject of AI experimentation to be fascinating, tho.

The thing that bugs me about this contest is that the Turing Test refers to a very specific form of intelligence, and one which is not likely to be an important or useful form.

Yes, it'd be cool for a computer to be able to talk like a person, but is that really a valuable use for a computer? Some people have no friends and could perhaps buy a simulation, but most everyday human-human conversation is about as stimulating as drying sponges in the first place.

AI probably has the most value in applications like electronic "sense-data" interpretation, high-level modeling of complex systems, and telecommunications switching.

Vast processing power and tracking of millions of different variables without error is well-applied to those kinds of problems.

One thing I enjoyed about Neuromancer and/or Mona Lisa Overdrive was that there were several totally "mundane" AIs that people used constantly without ever thinking about. "Continuity" was a favorite.* It was an AI that tracked everyone's location and activity (while in public) so you could ask it something like, "Where's Marco been the past 2 weeks?" and get an answer like: "Marco Politsias Bahwumy traveled to Rome on September 29. He stayed in room 1254 of the Winston Hotel. He ate breakfast in the hotel buffet with Albert Anders Vozhninkin at 10am October 1st...etc, etc, etc."

I suspect our first "true" AIs will be nothing at all like us in character, and will perform functions that a human never could. It may not even occur to us that they are intelligences for a little while after their birth.

------

* Continuity was a true "intelligence" in that it undertook actions of its own volition and constantly adjusted its own code. One of its hobbies was writing a complete history of human activity in hypertext, and it was near completion, but it couldn't finish because people kept taking actions. A human in one of the books puzzles over it for a moment, but "Continuity was an AI, and AIs did things like that."

Monday, October 13, 2008 05:19 PM

I'll bite...

And I'm afraid that assuming that the reports are true that 25% of the judges couldn't tell that Elbot wasn't human after 5 minutes then it doesn't reinforce my confidence in the advancement of humankind as a species. It only took me about 3 lines to know for certain that it wasn't a person. Maybe if I was specifically told that the text was coming from a person and I just had to chat with that person for a few minutes for a test, then I might take more than a few lines, but Elbot isn't any better than chat bots were 15 years ago.

Monday, October 13, 2008 05:30 PM

can anyone get in on these conversations?

Because I think the possibility to create accidental poetry here is tremendous. Given the right questions and responses from the human, who knows what crazy shit the bot will come up with. Could be Vladimir and Estragon all over again.

Seriously, if you have a link to a page where just anyone can interact with the Elbot -- or a bot much like it -- please share.

Also, a question: would the most ethical thing be to attribute the final product to the bot's makers?

Monday, October 13, 2008 05:55 PM

Not much of a test

If this transcript is typical of Elbot's conversations, then the three judges who were fooled must be complete morons. Or maybe the members of the human control group were instructed to chat in non-sequiturs, in which case this isn't much of a test. Either way, this is a highly unconvincing, poor application of the Turing test.

And as to some of the other commenters who referred to the "smartness" of the chat, comparing it to 15-year-olds on MySpace, it's not about smartness, it's about naturalness. It's relatively straightforward, given some input, to get a computer to spit out very "smart"-sounding output; the trick is making it sound natural. Conversely, however dumb some teenagers might sound while chatting, they certainly always sound natural.

Monday, October 13, 2008 06:25 PM

Anti-Turing

Is there a mirror-opposite of the Turing test for humans? I have several old friends who I would swear are human beings (having known them since high school days, some 35 years ago), but get them talking about politics and they become indistinguishable from any GOP robot. There is no way that they would pass the Turing test.

(BTW, regarding Elbot's chat, I'm sure that, like Pat Buchanan's speeches, it sounds better in the original German.)

Monday, October 13, 2008 06:39 PM

You can try it out on elbot.com

It sucks.

Monday, October 13, 2008 08:58 PM

This is a joke, right? and not funny.

This isn't a chatbot at all, and certainly didn't win any contest. The sample conversation was a total joke and not funny. Looks like a boring not funny person invented it. I tried the actual 'chatbot' itself and it failed miserably on any input. Please look at 'Eliza' which is 20-30 years old and actually attempts to mimic minimal understanding of its input.

Most Active Letters Threads

370

A key British official reminds us of the forgotten anthrax attack

A vast array of establishment and expert sources do not believe this episode was really resolved.
205

Is Obama's civil liberties record understandable?

Was it unreasonable to expect him to adhere to his commitments regarding the Constitution?
104

How dare you criticize wasteful defense spending!

So you think it's only terrorist-appeasing lefties who are down on Pentagon profligacy? Think again
86

The crazy, irrational beliefs of Muslims

Tom Friedman explains the real problem: stupid Muslims think the U.S. is about war and aggression.
51

Police to talk to Woods

Early morning crash raises questions, and revives tabloid speculation

View all »

Letters Help

Currently in Salon