Parisian Master of Research in Computer Science
Master Parisien de Recherche en Informatique (MPRI)

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

cours:c-2-27-1 [2019/06/18 17:10]
schmitz [Year 2019–2020]
cours:c-2-27-1 [2019/10/03 11:09] (current)
crabbe [Course Material]
Line 15: Line 15:
 === Schedule === === Schedule ===
  
-TBA+The class takes place on thursdays from 12.45 to 15.45. in room 1014
  
 === Language  === === Language  ===
Line 45: Line 45:
  
 ==== Tentative Outline ==== ==== Tentative Outline ====
-We sketch here the planned contents for 2018--2019.+We sketch here the planned contents for 2019--2020.
 These contents are structured around three important subdomains of These contents are structured around three important subdomains of
 linguistics, (<del>morphology</del>, syntax, and semantics), linguistics, (<del>morphology</del>, syntax, and semantics),
Line 52: Line 52:
 change. change.
  
-  - September 12th, 2018 +  - September 12th, 2019 
-    * **General Introduction**\\ the subdomains of linguistics, the issues of linguistic modelling, and the various computational approaches +    * **General Introduction** Language has structure. Language and inference. The importance of ambiguity. Language and the world.  
-    * Syntactic Modelling\\ constituent and dependency analyses +    * **Linguistics basics** for computational linguistics. Statistical properties of words, constituent and dependency analyses, computing semantic denotations and computing semantic similarities. 
-    * Context-free Parsing\\ parsing as intersection +    * **Machine learning** basics for computational linguistics. Coding discrete symbols as vectors (word embeddings), optimisation reminder.  
-  - September 26th2018 +  - September 19th2019 
-    * **Model-Theoretic Syntax**\\ monadic second-order logic and propositional dynamic logic on trees, automata characterisations +    * **Modelling sequences** Presentation of typical problems involving sequence modelling.  
-  - October 3rd2018 +    * **Generative models** language modelshidden markov models, PCFG 
-    * **Mildly Context-Sensitive Syntax**\\ tree-adjoining grammarswell-nested MCSLs +    * **Discriminative models** conditional random fields 
-  - October 10th2018 +    * **Algorithms** Viterbi and approximative methods 
-     * **Probabilistic Syntax**\\ probabilistic CFGs, learning, probabilistic parsing +    * **Deep learning based methods**  
-  - October 17th, 2018  +  September 26th2019 **Modelling syntax**  
-    * **Semantic Representations**\\ modal logics, higher-order logics +    * Phrase structure grammar 
-  - October 24th, 2018 +    * Tree adjoining Grammar 
-    * **Syntax/Semantics Interface**\\ compositionality, higher-order syntax, abstract categorial grammars +    * Dependency syntax 
-  - November 7th, 2018 +    * Categorial grammar  
-    * **Montague Semantics**\\ model-theoretic semantics, intensionality +  - October 3rd2019 **Parsing algorithms** for natural language 
-  - November 14th, 2018 +     * **CKY and Earley** Introduction to weighted CKY and Earley 
-    * **Discourse Analysis**\\ discourse representation theory, anaphora resolution, type-theoretic dynamic logic +     * **Shift Reduce and Eisner** for Dependency syntax 
-  - November 21st, 2018+     * **CKY for tree adjoining grammar**  
 +  - October 17th, 2019  
 +    * **Semantic Representations** modal logics, higher-order logics 
 +  - October 24th, 2019 
 +    * **Syntax/Semantics Interface** compositionality, higher-order syntax, abstract categorial grammars 
 +  - November 7th, 2019 
 +    * **Montague Semantics** model-theoretic semantics, intensionality 
 +  - November 14th, 2019  **Discourse Analysis** discourse representation theory, anaphora resolution, type-theoretic dynamic logic 
 +  - November 21st, 2019
     * exam     * exam
    
 ==== Course Material ==== ==== Course Material ====
 +== 2019--2020 ==
 +   * [[http://www.linguist.univ-paris-diderot.fr/~bcrabbe/mpri/cours1.pdf|Lecture 1]]
 +   * [[http://www.linguist.univ-paris-diderot.fr/~bcrabbe/mpri/cours2.pdf|Lecture 2]]
 +   * [[http://www.linguist.univ-paris-diderot.fr/~bcrabbe/mpri/cours3.pdf|Lecture 3]]
 +   * [[http://www.linguist.univ-paris-diderot.fr/~bcrabbe/mpri/cours4.pdf|Lecture 4]]
 +   * ** Readings ** choose two blocks out of 3:
 +   * __Distributional and Vector semantics__ : 
 +        - Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean (2013), Efficient Estimation of Word Representations in Vector Space, NIPS 2013 ([[http://papers.nips.cc/paper/5021-distributed-representations-of-words-and-phrases-and-their-compositionality.pdf|link]])
 +        -  Richard Socher, Alex Perelygin, Jean Y. Wu, Jason Chuang, Christopher D. Manning, Andrew Y. Ng and Christopher Potts (2013),  Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank, EMNLP 2013 ([[https://nlp.stanford.edu/~socherr/EMNLP2013_RNTN.pdf|link]])
 +   * __Mildly Context sensitive languages__ :
 +      - Aravind Joshi (1985), How much context sensitivity is required to provide reasonable structural descriptions ? ([[https://www.cs.sfu.ca/~anoop/courses/ReadingGroup-Summer-2006/joshi85.pdf|link]])
 +      - Alexander Clark (2015), An introduction to multiple context free grammars for linguists ([[http://citeseerx.ist.psu.edu/viewdoc/download;jsessionid=342B5D3259036320CBDED8BA9E7F4BCB?doi=10.1.1.714.8708&rep=rep1&type=pdf|link]])  
 +   * __Semantic parsing with distant supervision__ :
 +      - Luke S. Zettlemoyer and Michael Collins (2009), Learning to Map Sentences to Logical Form: Structured Classification with Probabilistic Categorial Grammars ([[https://homes.cs.washington.edu/~lsz/papers/zc-uai05.pdf|link]])
 +      - Jonathan Berant Andrew Chou Roy Frostig Percy Liang (2013)  Semantic Parsing on Freebase from Question-Answer Pairs, EMNLP 2013. ([[https://www.aclweb.org/anthology/D13-1160|link]])
  
 == 2018--2019 == == 2018--2019 ==
Line 136: Line 159:
    * [[http://www.loria.fr/~degroote/teaching.html|Slides]] from 2010 for the second part.    * [[http://www.loria.fr/~degroote/teaching.html|Slides]] from 2010 for the second part.
    * Exams from previous years: [[http://www.lsv.ens-cachan.fr/~schmitz/teach/2010_compling/exam_2010.pdf|2010]], [[http://www.lsv.ens-cachan.fr/~schmitz/teach/2010_compling/examen09A.pdf|2009]] (only the second part), [[http://www.lsv.ens-cachan.fr/~schmitz/teach/2010_compling/examen08.pdf|2008]], [[http://www.lsv.ens-cachan.fr/~schmitz/teach/2010_compling/examen07.pdf|2007]], [[http://www.lsv.ens-cachan.fr/~schmitz/teach/2010_compling/exam06.pdf|2006]], [[http://www.lsv.ens-cachan.fr/~schmitz/teach/2010_compling/exam06.pdf|2006]].    * Exams from previous years: [[http://www.lsv.ens-cachan.fr/~schmitz/teach/2010_compling/exam_2010.pdf|2010]], [[http://www.lsv.ens-cachan.fr/~schmitz/teach/2010_compling/examen09A.pdf|2009]] (only the second part), [[http://www.lsv.ens-cachan.fr/~schmitz/teach/2010_compling/examen08.pdf|2008]], [[http://www.lsv.ens-cachan.fr/~schmitz/teach/2010_compling/examen07.pdf|2007]], [[http://www.lsv.ens-cachan.fr/~schmitz/teach/2010_compling/exam06.pdf|2006]], [[http://www.lsv.ens-cachan.fr/~schmitz/teach/2010_compling/exam06.pdf|2006]].
- 
 ==== To Know More ==== ==== To Know More ====
  
 
Universités partenaires Université Paris-Diderot
Université Paris-Saclay
ENS Cachan École polytechnique Télécom ParisTech
ENS
Établissements associés Université Pierre-et-Marie-Curie CNRS INRIA CEA