problems with function _project_features

[lcuyh]

Hi! Thank you for sharing your code! I have some questions about your coding. The shape of the input of the function _project_features is (N, L, D), and the output of this function is the same shape of the input. So, why you need to have this function? What the purpose of this function?

[yxding95]

hi, i have the same question, have you figured out? i found project_features was added to attention extracted from hidden state (see function _attention_layer) @lcuyh @yunjey

[zx3Leonoardo]

hi, I've got the same problem. Why would the author project the features of images before feeding them into attention layer?

[yxding95]

i think the project_features is transforming feature dim to the dim of hidden state, which was used in attention layer. The dim of VGG conv5_3 is the same with h_dim, but if we change another feature, maybe we have to use project feature