2011 TheWinogradSchemaChallenge

(Levesque et al., 2011) ⇒ Hector J Levesque, Ernest Davis, and Leora Morgenstern. (2011). “The Winograd Schema Challenge..” In: AAAI Spring Symposium: Logical Formalizations of Commonsense Reasoning.

Subject Headings: Winograd Schema Challenge, Winograd Schema.

Notes

In this paper, we present an alternative to the Turing Test that has some conceptual and practical advantages. A Winograd schema is a pair of sentences that differ only in one or two words and that contain a referential ambiguity that is resolved in opposite directions in the two sentences. We have compiled a collection of Winograd schemas, designed so that the correct answer is obvious to the human reader, but can - not easily be found using selectional restrictions or statistical techniques over text corpora. A contestant in the Winograd Schema Challenge is presented with a collection of one sentence from each pair, and required to achieve human-level accuracy in choosing the correct disambiguation.

The well-known Turing Test was first proposed by Alan Turing (1950) as a practical way to defuse what seemed to him to be a pointless argument about whether or not machines could think. In a nutshell, he proposes that instead of asking such a vague question and then getting caught up in a debate about what it means to really be thinking, we should focus on observable behaviour and ask whether a machine would be capable of producing behaviour that we would say required thought in people. The sort of behaviour he had in mind was participating in a natural conversation in English over a teletype in what he calls the Imitation Game. The idea, roughly, is that if an interrogator were unable to tell after a long, free-flowing and unrestricted conversation with a machine whether she was dealing with a person or a machine, then we should be prepared to say that the machine was thinking. Requiring more of the machine, such that as that it look a certain way, or be biological, or have a certain causal history, is just arbitrary chauvinism.

…

;

	Author	volume	Date Value	title	type	journal	titleUrl	doi	note	year
2011 TheWinogradSchemaChallenge	Hector J Levesque Ernest Davis Leora Morgenstern			The Winograd Schema Challenge.