Google AI Blog: Smart Compose: Using Neural Networks to Help Write Emails

Smart Compose RNN-LM model architecture. Subject and previous email message are encoded by averaging the word embeddings in each field. The averaged embeddings are then fed to the RNN-LM at each decoding step.