In encoder-decoder architectures, the outputs of the encoder blocks act as the queries towards the intermediate representa