Early applications of the sequence-to-sequence paradigm used recurrent neural networks (RNNs) for both the encoder and decoder. A neural network then learns to map input tokens to output tokens. A popular method for combining NLU and NLG is training an ML model using sequence-to-sequence learning, where the inputs are the document words, and the outputs are the summary words.

Document writers can then view, edit, or ignore the suggested document summary.Īutomatically generated summaries would not be possible without the tremendous advances in ML for natural language understanding (NLU) and natural language generation (NLG) over the past five years, especially with the introduction of Transformer and Pegasus.Ībstractive text summarization, which combines the individually challenging tasks of long document language understanding and generation, has been a long-standing problem in NLU and NLG research. Building on grammar suggestions, Smart Compose, and autocorrect, we see this as another valuable step toward improving written communication in the workplace.Ī blue summary icon appears in the top left corner when a document summary suggestion is available. While all users can add summaries, auto-generated suggestions are currently only available to Google Workspace business customers. Readers can also use this section, along with the outline, to understand and navigate the document at a high level. However, the document writer maintains full control - accepting the suggestion as-is, making necessary edits to better capture the document summary or ignoring the suggestion altogether. Today we describe how this was enabled using a machine learning (ML) model that comprehends document text and, when confident, generates a 1-2 sentence natural language description of the document content.

To help with this, we recently announced that Google Docs now automatically generates suggestions to aid document writers in creating content summaries, when they are available. However, composing a document summary can be cognitively challenging and time-consuming, especially when a document writer is starting from scratch. When a new document is received, readers often wish it included a brief summary of the main points in order to effectively prioritize it. Posted by Mohammad Saleh, Software Engineer, Google Research, Brain Team and Anjuli Kannan, Software Engineer, Google Docsįor many of us, it can be challenging to keep up with the volume of documents that arrive in our inboxes every day: reports, reviews, briefs, policies and the list goes on.

Auto summary writer