U CS 498: Expressive Grammar Formalisms for Natural Language
Lecture 1 Course overview Thu 08/23 Slides:
1 per page
6 per page
Lecture 2 Context-free grammars;
elementary syntax
Tue 08/28 Slides:
1 per page
6 per page
Reading:
Jurafsky & Martin,ch.12,
"Formal Grammars of English"

(You don't need to read
sections 12.8 and 12.9. We'll cover 12.7 later)
Homework 1
(due Tue Sep 4 in class)
Lecture 3 More on CFGs;
Penn Treebank;
Non-local dependencies
Thu 08/30 Slides:
1 per page
6 per page
Reading:
still Jurafsky & Martin,ch.12,
"Formal Grammars of English"

(You don't need to read
sections 12.8 and 12.9. We'll cover 12.7 later)
Homework 2
(also due Tue Sep 4 in class)
Lecture 4 Non-local dependencies continued
Homework 1 and 2
Tue 09/04 Slides:
1 per page
6 per page
Reading:
Marcus et al (1994)., The Penn Treebank:
Annotating Predicate Argument Structure.
In ARPA Human Language Technology Workshop.
See here or here .
Homework 3
(due Thu Sep 6 in class)
Lecture 5 Parsing algorithms, PCFGs Thu 09/06 Slides:
1 per page
6 per page
Reading:
Jurafsky & Martin,ch.13,
"Parsing with Context-Free Grammars"

(up to and including 13.2.4)
Homework 4
(due Tue Sep 11 in class)
Lecture 5 Parsing algorithms, PCFGs Thu 09/06 Slides:
1 per page
6 per page
Reading:
Jurafsky & Martin,ch.13,
"Parsing with Context-Free Grammars"

(up to and including 13.2.4)
Lecture 6 More on parsing algorithms, PCFGs Tue 09/11 Slides:
1 per page
6 per page
Lecture 7 Tree transformations, Lexicalized Models, Collins Parser Thu 09/13 Slides:
1 per page
6 per page
Reading:
1. Jurafsky & Martin,ch.14,
"Statistical Parsing"

2. Klein & Manning, "Accurate Unlexicalized Parsing"
Lecture 8 Recovering traces and null elements Thu 09/18 Slides:
1 per page
6 per page
Reading:
1. Mark Johnson A Simple Pattern-matching Algorithm for
Recovering Empty Nodes and their Antecedents, ACL 2002 (pdf)
2. Ryan Gabbard; Seth Kulick; Mitchell Marcus
Fully Parsing the Penn Treebank, HLT-NAACL 2006 (pdf)
Lecture 9 Parsing German Thu 09/20 Slides:
1 per page
6 per page
Reading:
1. Amit Dubey; Frank Keller
Probabilistic Parsing for German Using
Sister-Head Dependencies, ACL 2003 (pdf)
2. Kübler, Sandra; Erhard W. Hinrichs, Wolfgang Maier
Is it Really that Difficult to Parse German? EMNLP 2006 (pdf)
Homework 6
(due Thu Sep 27 in class)
Readings for the homework:
R. Levy and C. Manning.
Is it harder to parse Chinese,
or the Chinese Treebank?
ACL 2003.
and R. Tsarfaty.
"The Interplay of Syntax and Morphology
in Building Parsing Models for Modern Hebrew".

ESSLLI Student Session 2006
Lecture 10 Parsing German (continued),
Dependency grammars, dependency treebanks
Tue 09/25 Slides:
1 per page
6 per page

Lecture 11 Dependency parsing

Readings:
J. Nivre, Dependency Grammar and Dependency Parsing.
MSI report 05133. Växjö University.

You can get more information on dependency parsing
than we have time to cover in class
from the following ESSLLI course:
Introduction to Data Driven Dependency Parsing,
Ryan McDonald and Joakim Nivre, ESSLLI 2007.
Thu 09/27 Slides:
1 per page
6 per page
Homework 7
(due Oct 4 in class)
Readings for the homework:
R. McDonald. and J. Nivre
Characterizing the Errors of
Data-Driven Dependency Parsing Models

EMNLP-CoNLL 2007.
Lecture 12 Grammar formalisms; Introduction to Tree-Adjoining Grammar Tue 10/02 Slides:
1 per page
6 per page
Lecture 13 Tree-Adjoining Grammar, TAG extraction Thu 10/04 Slides:
1 per page
6 per page
Lecture 14 TAG parsing Tue 10/09 Slides:
1 per page
6 per page
Lecture 15 Introduction to Combinatory Categorial Grammar Thu 10/11 Slides:
1 per page
6 per page
Lecture 16 Extracting a CCG from the Penn Treebank Tue 10/16 Slides:
1 per page
6 per page
Lecture 17 Extracting a CCG from the Tiger Treebank Thu 10/18 Slides:
1 per page
6 per page
Lecture 18 Tue 10/23Slides:
1 per page
6 per page
Lecture 19 Semantic Role Labeling with CCG Thu 10/25Slides:
1 per page
6 per page
Lecture 20 Feature structures and unification Tue 10/30Slides:
1 per page
6 per page
Lecture 21 Lexical Functional Grammar Thu 11/01Slides:
1 per page
6 per page
Lecture 22Parsing with LFG Tue 11/06Slides:
1 per page
6 per page
Lecture 23Extracting LFGs from the Penn Treebank Tue 11/06Slides:
1 per page
6 per page
Lecture 24 (Meeting with Salim Roukos, IBM) Thu 11/08
Lecture 25Statistical models for unification-based grammars Tue 11/13Slides:
1 per page
6 per page
Lecture 26Statistical models for unification-based grammars Tue 11/13Slides:
1 per page
6 per page
Lecture 27Head-Driven Phrase-Structure Grammars Thu 11/15Slides:
1 per page
6 per page
Lecture 28Head-Driven Phrase-Structure grammars Tue 11/27Slides:
1 per page
6 per page
Lecture 29Review Thu 11/29Slides:
1 per page
6 per page