About Attention

[qinya]

What should I do if I follow the attention layer behind the CRF layer?

[ningshixian]

What do you specifically mean?

[qinya]

I want to connect CRF behind LSTM+Attention and do NER. I tried but failed. I added CRF when calculating loss.

[ningshixian]

you can do it like this,

output = Bidirectional(LSTM())
output = AttentionDecoder()(output)
output = TimeDistributed(Dense(num_class))(output)
output = crf(output)