transformerdecoder

CellStrat > Research/Blog > transformerdecoder
19
May
Transformers for NLP

#CellStratAILab #disrupt4.0 #WeCreateAISuperstars #WhereLearningNeverStops Last Saturday, our AI Lab Researcher Indrajit Singh presented an exhaustive webinar on Transformers, which are used in NLP. Introduction To combine the advantages from both CNNs and RNNs, [Vaswani et al., 2017] designed a novel architecture using the attention mechanism. This architecture, which is called as Transformer, achieves parallelization by […]

Posted in: Natural Language Processing,
Tags: AddNorm, deep learning, encoder-decoder, Multi-head attention, MXNet, natural language processing, NLP, position-wise FFN, positional encoding, Residual block, self-attention, seq2seq, Sequence-to-sequence, skip connection, tensorflow, transformer, transformerdecoder, transformerencoder,