Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Concept

Long short-term memory

Related lectures (31)

Language Modelling and Recurrent Neural Networks

Explores language modelling, RNNs, n-gram models, LSTMs, and bidirectional RNNs.

Recurrent Neural Networks: LSTMs & GRUs

Explores LSTM and GRU variants in recurrent neural networks, addressing challenges and advantages.

Recurrent Neural Networks: Training and Challenges

Discusses recurrent neural networks, their training challenges, and solutions like LSTMs and GRUs.

Deep Learning: Recurrent Neural Networks

Explores Recurrent Neural Networks for behavioral data, covering Deep Knowledge Tracing, LSTM, GRU networks, hyperparameter tuning, and time series prediction tasks.

Seq2Seq Models: Attention vs. No Attention

Explores Seq2Seq models with and without attention mechanisms, covering encoder-decoder architecture, context vectors, decoding processes, and different types of attention mechanisms.

Sequence to Sequence Models: Overview and Applications

Covers sequence to sequence models, their architecture, applications, and the role of attention mechanisms in improving performance.

Recurrent Neural Networks: Neural Language Models

Explores fixed-context neural language models, RNNs, vanishing gradients, and sequence labeling in NLP.

Ball-and-socket joint pose estimation

Focuses on ball-and-socket joint pose estimation using a magnetic field in an anthropomorphic design with artificial muscles and tendons.

Contextual Representations: ELMO and BERT Overview

Covers contextual representations in NLP, focusing on ELMO and BERT architectures and their applications in various tasks.

Binary Sentiment Classifier Training

Covers the training of a binary sentiment classifier using an RNN.

Contextual Representations: ELMo & BERT

Explores the development of contextualized embeddings in NLP, focusing on ELMo and BERT's advancements and impact on NLP tasks.

Theoretical Properties of RNNs

Explores the theoretical properties and practical power of Recurrent Neural Networks, including their relationship to state machines and Turing completeness.

Policy Gradient Evaluation: Example (1-step horizon)

Explores policy gradient evaluation with a 1-step horizon, update rules, comparisons with Perceptron and biology, and generalization techniques.

Batch Normalization: Why It Works

Explores the aim and process of batch normalization in deep neural networks, emphasizing its importance in stabilizing mean input and solving the vanishing gradient problem.

Deep Learning: Backward Propagation and Vanishing Gradient

Delves into backward propagation in deep learning, addressing the vanishing gradient challenge and the need for effective hidden units.

Attention and Cognitive Load

Explores attention, arousal, cognitive load, and learning strategies.

Advanced Student Modeling

Explores advanced student modeling techniques, neural networks, LSTM networks, and Deep Knowledge Tracing.

From average to online learning

Covers the transition from a Monte Carlo approximation of the average to deriving batch and online update rules.

How to change the policy with a gradient method

Explains optimizing total reward by changing the policy with gradient methods.

Vanishing Gradient Problem: Deep Learning

Discusses the vanishing gradient problem in deep neural networks and its solutions.