Attention Mechanism

IndexedSlices in Tensorflow
Run in Google Colab View source on GitHub Download notebook In this post, we will discuss about IndexedSlices class of Tensorflow. We will try to answer the following questions in this blog:
Apr 1, 2021 5 min read Blog, Tensorflow, Deep Learning, Attention Mechanism
Tensorflow 2 code for Attention Mechanisms chapter of Dive into Deep Learning (D2L) book
View source on GitHub Download code (.zip) This code has been merged with D2L book. See PR: 1756, 1768 This post contains Tensorflow 2 code for Attention Mechanisms chapter of Dive into Deep Learning (D2L) book.
Mar 10, 2021 1 min read Blog, Tensorflow, Attention Mechanism, Transformer