Generative Lexicon Theory: Integrating Theoretical and Distributional Methods

 

What: Summer Course at ESSLLI 2017

When and Where: July 17-21, 2017: University of Toulouse, Toulouse, France

Who: James Pustejovsky and Elisabetta Ježek

Material: Slides and Articles from the Course

---

 

In this course we present an introduction to the current model of Generative Lexicon Theory (GL). The overall aim is to acquaint the student with the basic assumptions and components of the theory and motivate theoretical decisions through evidence-based analysis over large linguistic datasets. We show how the theory models the interaction between lexical information and other components of grammar, in particular how it mediates various problems in the mapping from lexical semantic representations to syntactic forms and, to a lesser extent, to pragmatic interpretation. From a computational perspective, we highlight the applicability of GL to natural language processing tasks such as word sense disambiguation, event participant identification, compound interpretation, and metonymy resolution.

GL theory was conceived from the outset as an infrastructure for a lexically-based semantic theory of language, founded on a rich compositional procedure integrating mechanisms for modulation of word meaning in context. It has won widespread acceptance among linguists and computer scientists of different theoretical backgrounds, and established itself as a productive and typologically adequate paradigm for linguistic research in a wide number of areas, such as event semantics, theory of argument structure, lexical and computational semantics, and Natural Language Processing.

The original full statement of the theory was presented in Pustejovsky (1995), but there have been significant developments since then, including the elaboration of a general theory of semantic selection and semantic typing (Asher and Pustejovsky 2006, Pustejovsky 2011), which have enhanced the explanatory power of the theory and extended its coverage of linguistic phenomena. Moreover, since 2000 the theory has drawn increasingly on the findings of corpus linguistics and distributional semantic analysis and procedures (Pustejovsky and Jezek, 2008, Pustejovsky and Rumshisky, 2008, Jezek and Quochi, 2010, Jezek and Vieu, 2014). This has created a new dimension of evidence-based analysis and interpretation, giving rise to an integration of empirical analysis and theoretical modeling. For all these reasons, an introductory course, illustrating how GL principles can be put into practice in linguistic analysis, will benefit students and researchers interested in both theoretical linguistics and computational semantics.

The plan of the course is as follows. In the first lecture, we review the motivations behind GL and the notion of a distributed compositional model of language meaning. We sketch out the basic assumptions underlying GL theory and justify these assumptions in general terms. For lecture two, we examine the notion of qualia structure and its role in differentiating the semantic micro-structure of word meaning, as well as its role in providing additional strategies for semantic selection in composition. Lecture three first examines recent work on event structure in GL modeling the dynamics of change, and then
analyzes the contexts associated with event type shiftings as attested in the corpus. Lecture four focuses on argument distinctions and argument typing, examines default realization strategies for the different types of arguments, and introduces the notion of dynamic argument structure. Finally, in lecture five, we look in detail at GL’s compositional mechanisms of selection, coercion, and co-composition. We situate this last lecture in the context of data from large linguistic corpora, and investigate the computational consequences of the GL architecture for modeling compositionality and determining meaning in larger contexts.

There will be labs associated with the lectures, relating to corpus evidence and analytics for qualia relation extraction, compound interpretation, coercion, and event typing.

---

Outline

1. Introduction to GL
1.1. Basic Assumptions
1.2. Polysemy and Ambiguity in GL
1.3. Basic GL Concepts
1.4 GL Notational Language

2. Qualia Structure
2.1. Basic Assumptions
2.2. Qualia Roles
2.3. Conventionalized Attributes

• Lab on Qualia identification and extraction
• Lab on Qualia relation tagging in compounds

3. Argument Structure
3.1. Basic Assumptions
3.2. Argument Types
3.3. Adjuncts

• Lab on induction of Semantic types (from corpora using corpus analytics)
  and identification of types of arguments
• Lab on meaning variation due to semantic type shifting

4. Event Structure
4.1. Basic Assumptions
4.2. Event Types
4.3 Event Composition

• Lab on identification of event types
• Lab on event type shifting

5. Meaning composition
5.1. Basic Assumptions
5.2. Co-composition
5.2. Coercion
5.3. Subselection

• Lab or assignment on coercion
• Lab on co-composition

---

Instructors

James Pustejovsky holds the TJX Feldberg Chair in Computer Science at Brandeis University, where he directs the Lab for Linguistics and Computation, and chairs both the Program in Language and Linguistics and the Computational Linguistics Graduate Program. He has conducted research in computational linguistics, AI, lexical semantics, temporal reasoning, and corpus linguistics and language annotation. He has written several books on computational semantics, computational linguistics, and corpus processing. He has authored numerous books, including Generative Lexicon, MIT, 1995;  Semantics and the Lexicon, Springer, 1993; The Problem of Polysemy, CUP, 1996 (with B. Boguraev); The Language of Time, OUP, 2005 (with I. Mani and R. Gaizauskas),  Interpreting Motion: Grounded Representations for Spatial Language, OUP, 2012 (with I. Mani), and Natural Language Annotation for Machine Learning, O’Reilly, 2012 (with A. Stubbs). Recent books include: Recent Advances in Generative Lexicon Theory, Springer, 2013; A Guide to Generative Lexicon Theory, OUP, Forthcoming (with Elisabetta Jezek).

Elisabetta Jezek is an Associate Professor at the University of Pavia, where she has taught Syntax and Semantics and Applied Linguistics since 2001. Her research interests and areas of expertise include lexical semantics, verb classification, theory of argument structure, event structure in syntax and semantics, lexicon/ontology interplay, word class systems, and computational lexicography. She has edited a number of major works in lexicography and published contributions focusing on the interplay between corpus analysis, research methodology, and linguistic theory. Her publications include: Classi di Verbi tra Semantica e Sintassi, ETS, 2003;  Lessico: Classi di Parole, Strutture, Combinazioni, Il Mulino, 2005 (2nd ed. 2011);  The Lexicon: An Introduction, OUP, 2016; and  A Guide to Generative Lexicon Theory, OUP, Forthcoming (with James Pustejovsky).

---

References