Note: this Schedule is tentative
Schedule
Monday, June 24
9:00–11:00
Lectures
Topic 1: Word representations
  • Lexical embeddings
  • TF-IDF
Topic 2:

  • Neural architectures for text processing
  • Loss functions and backpropagation
  • Dropout and other regularization methods
11:30–13:00
Tutorials
Sentence classification with word embeddings.
14:30–16:00
Invited Talk
Review talk
16:00 - 22:00
Project Session
Team building. Projects setting.
Tuesday, June 25
9:00–11:00
Lectures
Topic 1
  • ConvNets
Topic 2
  • RNNs (LSTM,GRU)
  • Sequence-to-sequence encoder/decoder models
  • Sequence-to-sequence with attention
  • Contextualized embeddings: ELMo; BERT
11:30–13:00
Tutorials
Sequence tagging for entity recognition.
14:30–16:00
Invited Talk
Review talk
16:00 - 22:00
Project Session
Working on projects
Wednesday, June 26
9:00–11:00
Lectures
Topic 1
  • Attention-based architectures: transformers
Topic 2
  • Memory-based models
11:30–13:00
Tutorials
Chit-chat bot trained on Twitter/Open subtitles.
14:30–16:00
Invited Talk
Review talk
16:00 - 22:00
Project Session
Working on projects
Thuesday, June 27
9:00–11:00
Lectures
Topic 1
  • Attention-based architectures: transformers
Topic 2
  • Memory-based models
    11:30–13:00
    Tutorials
    Working on projects
    14:30–16:00
    Invited Talk
    Review talk
    16:00 - 22:00
    Project Session
    Working on projects
    Friday, June 28
    9:00–11:00
    Lectures
    Advanced Topics: Dialogue Generation and Conversational Agents
    • Multi-skilled agents
    • Hierarchical models (HRED, VHRED, etc.)
    • External knowledge integration
      11:30–13:00
      Tutorials
      Working on projects
      14:30–16:00
      Invited Talk
      Review talk
      16:00 - 22:00
      Project Session
      Prepare posters
      Saturday, June 29
      9:00–13:00
      Closing reception
      Short oral presentations
      Poster session
        15:00–21:00
        Social event
        Computational resources
        A teaching lab with 30 GPU workstations will be available at UMass Lowell for use by the participants
        Additional remote virtual GPU machines will be provided by the MIPT lab
        Participants will also be able to use colaboratory
        Sample Topics for Participants Projects
        Participants will select from a number of projects for which initial code base will be made available. Sample topics include:
        Engaging chit-chat model to keep interlocutor engaged in the conversation using Reddit
        Infotainment chat model using Wizard of Wikipedia dataset
        Multi-task goal-oriented chat model using MultiWOZ dataset (A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modelling)
        Contact
        Made on
        Tilda