Model: "Sequential RNN with attention" SNLI-based models

[pasky]

For the SNLI task, models

• http://arxiv.org/abs/1509.06664
• http://arxiv.org/abs/1512.08849
• http://arxiv.org/abs/1601.06733

are doing well. The basic idea is that we have two RNNs for the two sentences, but the second one is initialized by the output of the first one. Plus there is one-direction attention.

The models seem to be pretty incremental tweaks of each other, so it would be probably easiest to implement this as a single model with configurable features. Not sure how to coerce Keras to perform the initialization of the second RNN, though, might require Keras modifications.