1

I am trying to create a heat map the same as the image below using attention in TensorFlow r1.4.

attention_heatmap

I am using tf.contrib.seq2seq.BahdanauAttention and tf.contrib.seq2seq.AttentionWrapper for implementation of attention mechanism. I have seen a workaround here (Visualizing attention activation in Tensorflow) but I think it will not work with my current setup as that workaround uses old version of TensorFlow.

EDIT

I might be close to finding the solution by debugging the model with tfdbg but I don't know what Tensors should I look for.

Any help would be greatly appreciated.

nix
  • 95
  • 2
  • 11
  • don't know if you ever refered this post https://stackoverflow.com/questions/40601552/visualizing-attention-activation-in-tensorflow – Peter Li May 01 '18 at 04:03

0 Answers0