IP Library › Granted Patent US 11,562,036
Granted Patent B2
US 11,562,036 · App. 16/740,236 · Granted Jan 24, 2023

Unified message search

Inventors: Vinh Quoc Ly (Millbrae, CA); Ahmet Onur Tekdas (Santa Clara, CA); Timo Mertens (Millbrae, CA); Okan Kolak (Sunnyvale, CA); Charles Randell Sievert (San Jose, CA); Christine Nguyen (Santa Clara, CA); Jin Lu (Redwood City, CA)
Assignee: GOOGLE LLC
G06F16/951G06F16/904G06Q10/00G06Q10/107H04M1/271H04M1/7243H04W4/14H04M2250/74
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,562,036
App. No.
16/740,236
Granted
Jan 24, 2023
Kind
B2
Abstract

The disclosed embodiments include computerized methods, systems, and devices, including computer programs encoded on a computer storage medium, for generating terms of a search query based on a user's spoken utterances, identifying multiple cross-platform messages based on the generated terms, and to generating, via a presentation device, a single interface that enables the user to interact with identified messages. Based on a spoken utterance, the disclosed embodiments may determine user-specified search terms and/or criteria, and based on the user-specified search terms and/or criteria, may obtain cross-platform message data that corresponds to the search query. The communications device may generate one or more interface elements that describe corresponding ones of the cross-platform messages, which may be presented within a unified graphical user interface or voice-user interface by a communications device.

Claims (44)

1. A method performed by one or more computing devices, the method comprising:

receiving, by the one or more computing devices, data indicating a request from a user for message data,

wherein the request from the user is a spoken request for message data; and

in response to receiving the spoken request:

obtaining, by the one or more computing devices, message data comprising a plurality of messages sent to the user within a predetermined time period prior to the spoken request,

generating, by the one or more computing devices, a summary of the plurality of messages,

wherein when the plurality of messages are obtained from different messaging applications: the summary divides the plurality of messages into groups with each group corresponding to one of the different messaging applications, and the summary in which the plurality of messages are divided into groups with each group corresponding to one of the different messaging applications is displayed at a single interface, and

providing, by the one or more computing devices, the summary for presentation in a response to the request from the user.

2. The method of claim 1 , comprising obtaining a transcription of the utterance of the user using a speech recognition module of the one or more computers;

wherein the message data is obtained based on the transcription of the utterance.

3. The method of claim 1 , wherein providing the summary for presentation comprises providing data causing the summary to be presented to the user using an audio interface.

4. The method of claim 1 , wherein the summary includes at least a portion of each of multiple messages from the plurality of messages.

5. The method of claim 1 , wherein the summary includes an indication of one or more senders of at least one message in the plurality of messages.

6. The method of claim 1 , wherein the request is a request for e-mail messages, and the summary is a summary of e-mail messages.

7. The method of claim 6 , wherein the e-mail messages are e-mail received within the predetermined time period prior to the request.

8. The method of claim 1 , wherein providing the summary for presentation comprises providing the summary for output by a display device.

9. The method of claim 1 , wherein providing the summary for presentation comprises providing a digest card that includes textual and graphical content characterizing multiple messages sent to the user.

10. The method of claim 1 , wherein obtaining the messages comprises obtaining a set of messages that is limited to messages received within a particular period of time, wherein the particular period of time is not specified in the request.

11. The method of claim 10 , wherein the particular period of time is a predetermined amount of time preceding the request.

12. The method of claim 10 , wherein the request identifies at least one of a specific sender, specific recipient, or specific messaging platform;

wherein obtaining the message data comprises identifying, as the plurality of messages, a plurality of messages associated with the specific sender, specific recipient, and/or specific messaging platform.

13. A system comprising:

one or more computing devices: and

one or more computer-readable media that store instructions that, when executed by the one or more computing devices, cause the one or more computing devices to perform operations comprising:

receiving, by the one or more computing devices, a spoken request from a user for message data,

wherein the request from the user is a spoken request for message data; and

in response to receiving the spoken request:

obtaining, by the one or more computing devices, message data comprising a plurality of messages sent to the user within a predetermined time period prior to the spoken request,

generating, by the one or more computing devices, a summary of the plurality of messages,

wherein when the plurality of messages are obtained from different messaging applications: the summary divides the plurality of messages into groups with each group corresponding to one of the different messaging applications, and the summary in which the plurality of messages are divided into groups with each group corresponding to one of the different messaging applications is displayed at a single interface, and

providing, by the one or more computing devices, the summary for presentation in a response to the request from the user.

14. The system of claim 13 , comprising obtaining a transcription of the utterance of the user using a speech recognition module of the one or more computers;

wherein the message data is obtained based on the transcription of the utterance.

15. The system of claim 13 , wherein providing the summary for presentation comprises providing data causing the summary to be presented to the user using an audio interface.

16. The system of claim 13 , wherein the summary includes at least a portion of each of multiple messages from the plurality of messages.

17. The system of claim 13 , wherein the summary includes an indication of one or more senders of at least one message in the plurality of messages.

18. One or more non-transitory computer-readable media that store instructions that, when executed by the one or more computing devices, cause the one or more computing devices to perform operations comprising:

receiving, by the one or more computing devices, a spoken request from a user for message data,

wherein the request from the user is a spoken request for message data; and

in response to receiving the spoken request:

obtaining, by the one or more computing devices, message data comprising a plurality of messages sent to the user within a predetermined time period prior to the spoken request,

generating, by the one or more computing devices, a summary of the plurality of messages,

wherein when the plurality of messages are obtained from different messaging applications: the summary divides the plurality of messages into groups with each group corresponding to one of the different messaging applications, and the summary in which the plurality of messages are divided into groups with each group corresponding to one of the different messaging applications is displayed at a single interface, and

providing, by the one or more computing devices, the summary for presentation in a response to the request from the user.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2020
From: LY, VINH QUOC; TEKDAS, AHMET ONUR; MERTENS, TIMO; KOLAK, OKAN; SIEVERT, CHARLES RANDELL; NGUYEN, CHRISTINE; LU, JIN
To: GOOGLE INC.
Reel/Frame 051483/0727 →
ENTITY CONVERSION Recorded Jan 10, 2020
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 051564/0034 →
Continuity (2)
Continuation 15156567 · May 17, 2016
Related Publication 20200151223A1 · May 14, 2020
Cited By (1)
US 12,287,836