Parisian Master of Research in Computer Science
Master Parisien de Recherche en Informatique (MPRI)

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

cours:c-2-27-1 [2019/09/12 18:16]
crabbe [Course Material]
cours:c-2-27-1 [2019/10/03 11:09] (current)
crabbe [Course Material]
Line 57: Line 57:
     * **Machine learning** basics for computational linguistics. Coding discrete symbols as vectors (word embeddings), optimisation reminder.      * **Machine learning** basics for computational linguistics. Coding discrete symbols as vectors (word embeddings), optimisation reminder. 
   - September 19th, 2019   - September 19th, 2019
-    * **Modelling sequences** Presentation of typical problems involving sequence modelling. Traditional algorithms for sequence labelling and introduction to deep learning based methods +    * **Modelling sequences** Presentation of typical problems involving sequence modelling.  
-  - October 3rd, 2019 +    * **Generative models** language models, hidden markov models, PCFG 
-    * **Modelling syntax** phrase structure grammar, categorial grammar, dependency syntax +    * **Discriminative models** conditional random fields 
-  - October 10th, 2019 +    * **Algorithms** Viterbi and approximative methods 
-     * **Parsing algorithms** for natural language +    * **Deep learning based methods**  
-     * **Grammar and syntax** some properties of natural language grammars  +  - September 26th, 2019 **Modelling syntax**  
-     * **CKY and Earley** Introduction to CKY and Earley for PCFG.+    * Phrase structure grammar 
 +    * Tree adjoining Grammar 
 +    * Dependency syntax 
 +    * Categorial grammar  
 +  - October 3rd, 2019 **Parsing algorithms** for natural language 
 +     * **CKY and Earley** Introduction to weighted CKY and Earley
      * **Shift Reduce and Eisner** for Dependency syntax      * **Shift Reduce and Eisner** for Dependency syntax
-     * **Deep learning** and parsing +     * **CKY for tree adjoining grammar** 
   - October 17th, 2019    - October 17th, 2019 
     * **Semantic Representations** modal logics, higher-order logics     * **Semantic Representations** modal logics, higher-order logics
Line 78: Line 83:
 ==== Course Material ==== ==== Course Material ====
 == 2019--2020 == == 2019--2020 ==
-   * [[http://www.linguist.univ-paris-diderot.fr/~bcrabbe/mpri/cours1.pdf|Session 1]]+   * [[http://www.linguist.univ-paris-diderot.fr/~bcrabbe/mpri/cours1.pdf|Lecture 1]] 
 +   * [[http://www.linguist.univ-paris-diderot.fr/~bcrabbe/mpri/cours2.pdf|Lecture 2]] 
 +   * [[http://www.linguist.univ-paris-diderot.fr/~bcrabbe/mpri/cours3.pdf|Lecture 3]] 
 +   * [[http://www.linguist.univ-paris-diderot.fr/~bcrabbe/mpri/cours4.pdf|Lecture 4]] 
 +   * ** Readings ** choose two blocks out of 3: 
 +   * __Distributional and Vector semantics__ :  
 +        - Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean (2013), Efficient Estimation of Word Representations in Vector Space, NIPS 2013 ([[http://papers.nips.cc/paper/5021-distributed-representations-of-words-and-phrases-and-their-compositionality.pdf|link]]) 
 +        -  Richard Socher, Alex Perelygin, Jean Y. Wu, Jason Chuang, Christopher D. Manning, Andrew Y. Ng and Christopher Potts (2013),  Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank, EMNLP 2013 ([[https://nlp.stanford.edu/~socherr/EMNLP2013_RNTN.pdf|link]]) 
 +   * __Mildly Context sensitive languages__ : 
 +      - Aravind Joshi (1985), How much context sensitivity is required to provide reasonable structural descriptions ? ([[https://www.cs.sfu.ca/~anoop/courses/ReadingGroup-Summer-2006/joshi85.pdf|link]]) 
 +      - Alexander Clark (2015), An introduction to multiple context free grammars for linguists ([[http://citeseerx.ist.psu.edu/viewdoc/download;jsessionid=342B5D3259036320CBDED8BA9E7F4BCB?doi=10.1.1.714.8708&rep=rep1&type=pdf|link]])   
 +   * __Semantic parsing with distant supervision__ : 
 +      - Luke S. Zettlemoyer and Michael Collins (2009), Learning to Map Sentences to Logical Form: Structured Classification with Probabilistic Categorial Grammars ([[https://homes.cs.washington.edu/~lsz/papers/zc-uai05.pdf|link]]) 
 +      - Jonathan Berant Andrew Chou Roy Frostig Percy Liang (2013)  Semantic Parsing on Freebase from Question-Answer Pairs, EMNLP 2013. ([[https://www.aclweb.org/anthology/D13-1160|link]])
  
 == 2018--2019 == == 2018--2019 ==
 
Universités partenaires Université Paris-Diderot
Université Paris-Saclay
ENS Cachan École polytechnique Télécom ParisTech
ENS
Établissements associés Université Pierre-et-Marie-Curie CNRS INRIA CEA