🕸️
Deep Learning
  • 💫Deep Learning Notes
  • 💼Practical Tools
  • 💎Concepts of Neural Networks
    • 🌱Introduction
    • 🔎The Problem in General
    • 👷‍♀️ Implementation Notes
    • 📚Common Concepts
    • 💥Activation Functions
    • 🎈Practical Aspects
    • 👩‍🔧 NN Regularization
    • ✨Optimization Algorithms
    • 🎨Softmax Regression
    • 🏃‍♀️ Introduction to Tensorflow
    • 👩‍💻 Python Code Snippets
  • 🙋‍♀️ Hello World of Deep Learning with Neural Networks
    • 🌱Introduction
    • 🌐CNNs In Browser
  • 🚪Introduction to Computer Vision
    • 🌱Introduction
  • 🚩Concepts of Convolutional Neural Networks
    • 🌱Introduction
    • 📌Common Concepts
    • 🌟Advanced Concepts
    • 👀Visualization
    • 👵Classic Networks
    • ✨Other Approaches
    • 🕸️Common Applications
  • 👩‍💻 Works and Notes on CNNs
    • 🌱Introduction
  • 💄Popular Strategies of Deep Learning
    • 🌱Introduction
    • 🚙Transfer Learning
    • 📚Other Strategies
  • 🤡Image Augmentation
    • 🌱Introduction
  • 🤸‍♀️ Notes on Applied Machine Learning
    • 🌱Introduction
    • 👩‍🔧 Notes on Structuring Machine Learning Projects
    • 👩‍🏫 Implementation Guidelines
  • 🕵️‍♀️ Basics of Object Detection
    • 🌱Introduction
    • ⭕Region-Based CNNs
    • 🤳SSD and YOLO
    • 🤖TensorFlow Object Detection API
    • 🐞Model Debugging
  • ➰Sequence Models In Deep Learning
    • 🌱Introduction
    • 📚General Concepts
    • 🔄Recurrent Neural Networks
    • 🌌Vanishing Gradients with RNNs
    • 🌚Word Representation
    • 💬Mixed Info On NLP
  • 💬NLP
    • 🌱Introduction
  • 💬Applied NLP
    • 🙌🏻 Handling texts
    • 🧩Regex
  • 👀Quick Visual Info
  • 📚PDFs that I found and recommend
Powered by GitBook
On this page
  • 🤸‍♀️ Applications
  • 🔠 Neural Machine Translation
  • 🕵️‍♀️ Neural Machine Translation with Attention
  • 🔊 Speech Recognition

Was this helpful?

Export as PDF
  1. Sequence Models In Deep Learning

Mixed Info On NLP

Mixed Info On Natural Language Processing

🤸‍♀️ Applications

🔠 Neural Machine Translation

  • A machine translation model is similar to a language model except it has an encoder network placed before.

  • It is sometimes referred as a conditional language model.

🕵️‍♀️ Neural Machine Translation with Attention

  • If you had to translate a book's paragraph from French to English, you would not read the whole paragraph, then close the book and translate 😅

  • Even during the translation process, you would read/re-read and focus on the parts of the French paragraph corresponding to the parts of the English you are writing down 🤔

  • The attention mechanism tells a Neural Machine Translation model where it should pay attention to at any step 👩‍🏫

🔊 Speech Recognition

  • Converting an audio (x-input) to text (y-output)

    • By measuring air pressure 🙄

  • Sequence-to-Sequence model

TODO: Add details

PreviousWord RepresentationNextNLP

Last updated 4 years ago

Was this helpful?

➰
💬