About the Course:

Profossro: Saeedeh Momtazi

Mentors: 1. Maryam Mousavian 2. Zahra Abbasiyan 3. Mohsen Fazaeli

Hold by: MCI (Mobile Telecommunication Company of Iran)

References

1. Speech and Language Processing Book by Daniel Jurafsky and James H. Martin
2. Foundations of statistical natural language processing

• I highly recommend Daniel Jurafsky's youtube play list:

https://www.youtube.com/playlist?list=PLLssT5z_DsK8HbD2sPcUIDfQ7zmBarMYv

Certificate

Official Certificate Issued by MCI company

Link to this certificate

Table of Content

1. Week 1

   1. Course introduciton
   2. linguistics knowledge
   3. NLP challenges
   4. Zipf's law
   5. Probabilistic language modeling: Motivation and Estimaiton
   6. Google Coalb
   7. Unigram and bigram language models

2. Week 2

   1. Smoothing
   2. LM Evaluation
   3. Introduction to Neural Processing
      1. Neural Networks
      2. Feedforward Networks
   4. Neural LM

3. Week 3

   1. Word Representation
      1. Sparse vs Dense representation
      2. Static Word embedding
         1. Matrix Factorization
         2. Word2vec
         3. Glove

4. Week 4

   1. Text preprocessing
   2. Spell correction
   3. Persian NLP

5. Week 5

   1. Sequence processing
      1. HMM
      2. RNN
         1. LSTM
         2. GRU
   2. Seq2Seq
   3. Attention
   4. Transformers

6. Week 6

   1. Properties of Human Conversation
   2. Type of chatbots
   3. Rule-based chatbots
   4. Corpus-based Chatbots
      1. Retrieval-based Models
         1. Vector-space model
         2. Neural text matching
      2. Generation-based models
         1. Seq2seq models
         2. Transformers

7. Week 7

   1. Contextualized Text Representaion
      1. ELMO
      2. BERT
      3. BERT family(Roberta, Albert, XLnet, Distillbert, ...)
      4. GPT
      5. Persian models
   2. Contextualized Text Representaion for corpus-based Chatbots

8. Week 8

   1. Frame-based dialogue systems
      1. Control Structure
      2. Intent Detection
      3. Slot Filling
      4. State tracking
   2. Evaluation of Chatbots
   3. Summary

Further Reading:

1. How language models has been evolved:

NLP Models Timeline 0

NLP Models Timeline

33 important NLP tasks

A great Information Theory course

Another great Information Theory course