Parisian Master of Research in Computer Science
Master Parisien de Recherche en Informatique (MPRI)

Structures informatiques et logiques pour la modélisation linguistique / Computational and Logical Structures for Linguistic Modelling

Taught in 2021–2022 by Benoît Crabbé and Philippe de Groote. First semester course, on Tuesdays 12:45–15:45 in room 1004. Classes delivered in English if at least one student asks for it; in French otherwise.

Tentative Outline

We sketch here the planned contents for 2021–2022. These contents are structured around three important subdomains of linguistics, (morphology, syntax, and semantics), presenting on each occasion some of the related models and the corresponding algorithmic issues. The exact dates and content might change.

  1. September 14th, 2021 (slides)
    • General Introduction Language has structure. Language and inference. The importance of ambiguity. Language and the world.
    • Linguistics basics for computational linguistics. Statistical properties of words, constituent and dependency analyses, computing semantic denotations and computing semantic similarities.
    • Machine learning basics for computational linguistics. Coding discrete symbols as vectors (word embeddings), optimisation reminder.
  2. September 28th, 2021 (slides)
    • Modelling sequences Presentation of typical problems involving sequence modelling.
    • Generative models language models, hidden markov models, PCFG
    • Discriminative models conditional random fields
    • Algorithms Viterbi and approximative methods
    • Deep learning based methods
  3. October 5th, 2021 Modelling syntax (slides)
    • Phrase structure grammar
    • Tree adjoining Grammar
    • Dependency syntax
    • Categorial grammar
  4. October 19th, 2021 Parsing algorithms for natural language (slides)
    • CKY and Earley Introduction to weighted CKY and Earley
    • Shift Reduce and Eisner for Dependency syntax
    • CKY for tree adjoining grammar
  5. October 26th, 2021
    • Semantic Representations modal logics, higher-order logics
  6. November 2nd, 2021
    • Syntax/Semantics Interface compositionality, higher-order syntax, abstract categorial grammars
  7. November 9th, 2021
    • Montague Semantics model-theoretic semantics, intensionality
  8. November 16th, 2021 Discourse Analysis discourse representation theory, anaphora resolution, type-theoretic dynamic logic
  9. November 23rd, 2021
    • exam
Universités partenaires Université Paris-Diderot
Université Paris-Saclay
ENS Cachan École polytechnique Télécom ParisTech
Établissements associés Université Pierre-et-Marie-Curie CNRS INRIA CEA