Recurrent Neural Networks Tutorial, Part 3 – Backpropagation Through Time and Vanishing Gradients
WildML – Artificial Intelligence, Deep Learning, and NLP
by Denny Britz
4y ago
This the third part of the Recurrent Neural Network Tutorial. In the previous part of the tutorial we implemented a RNN from scratch, but didn’t go into detail on how Backpropagation Through Time (BPTT) algorithms calculates the gradients. In this part we’ll give a brief overview of BPTT and explain how it differs from traditional backpropagation. We ..read more
Visit website
Recurrent Neural Networks Tutorial, Part 2 – Implementing a RNN with Python, Numpy and Theano
WildML – Artificial Intelligence, Deep Learning, and NLP
by Denny Britz
4y ago
This the second part of the Recurrent Neural Network Tutorial. The first part is here. Code to follow along is on Github. In this part we will implement a full Recurrent Neural Network from scratch using Python and optimize our implementation using Theano, a library to perform operations on a GPU. The full code is ..read more
Visit website
Recurrent Neural Networks Tutorial, Part 1 – Introduction to RNNs
WildML – Artificial Intelligence, Deep Learning, and NLP
by Denny Britz
4y ago
Recurrent Neural Networks (RNNs) are popular models that have shown great promise in many NLP tasks. But despite their recent popularity I’ve only found a limited number of resources that throughly explain how RNNs work, and how to implement them. That’s what this tutorial is about. It’s a multi-part series in which I’m planning to cover the ..read more
Visit website
Speeding up your Neural Network with Theano and the GPU
WildML – Artificial Intelligence, Deep Learning, and NLP
by Denny Britz
4y ago
Get the code: The full code is available as an Jupyter/iPython Notebook on Github! In a previous blog post we build a simple Neural Network from scratch. Let’s build on top of this and speed up our code using the Theano library. With Theano we can make our code not only faster, but also more concise ..read more
Visit website

Follow WildML – Artificial Intelligence, Deep Learning, and NLP on FeedSpot

Continue with Google
Continue with Apple
OR