IP Library › Granted Patent US 12,287,836
Granted Patent B2
US 12,287,836 · App. 18/623,864 · Granted Apr 29, 2025

Unified message search

Inventors: Vinh Quoc Ly (Sunnyvale, CA); Ahmet Onur Tekdas (Santa Clara, CA); Timo Mertens (Millbrae, CA); Okan Kolak (Sunnyvale, CA); Charles Randell Sievert (San Jose, CA); Christine Nguyen (Santa Clara, CA); Jin Lu (Redwood City, CA)
Assignee: GOOGLE LLC
G06F16/951G06F16/904G06Q10/00G06Q10/107H04M1/271H04M1/7243H04W4/14H04M2250/74
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,287,836
App. No.
18/623,864
Granted
Apr 29, 2025
Kind
B2
Abstract

The disclosed embodiments include computerized methods, systems, and devices, including computer programs encoded on a computer storage medium, for generating terms of a search query based on a user's spoken utterances, identifying multiple cross-platform messages based on the generated terms, and to generating, via a presentation device, a single interface that enables the user to interact with identified messages. Based on a spoken utterance, the disclosed embodiments may determine user-specified search terms and/or criteria, and based on the user-specified search terms and/or criteria, may obtain cross-platform message data that corresponds to the search query. The communications device may generate one or more interface elements that describe corresponding ones of the cross-platform messages, which may be presented within a unified graphical user interface or voice-user interface by a communications device.

Claims (41)

1. A method performed using one or more processors, the method comprising:

receiving, via a client device and from a user of the client device, a request to view messages; and

in response to receiving the request from the user:

processing the request to determine one or more user-specified search terms, wherein the one or more user-specified search terms include a keyword identifying an entity,

obtaining, based on the one or more user-specified search terms, cross-platform message data that includes a plurality of messages received from different messaging applications,

generating, based on the cross-platform message data, one or more interface elements for display at a unified interface of the client device, and

causing the one or more interface elements to be displayed at the unified interface of the client device,

wherein the one or more interface elements displayed at the unified interface include a merged interface element that merges a first subset of messages, out of the plurality of messages in the cross-platform message data, based on the keyword identifying the entity.

2. The method of claim 1 , wherein the entity is a sender of the messages to be viewed by the user, and the merged interface element includes an identifier of the sender.

3. The method of claim 1 , wherein the first subset of messages are acquired from at least two of the different messaging applications.

4. The method of claim 1 , wherein the cross-platform message data further includes temporal data indicative of a time at which each message, of the first subset of messages, is received or sent.

5. The method of claim 4 , wherein the merged interface element includes a most recent time among the times at which the first subset of messages are respectively received.

6. The method of claim 1 , wherein the entity is a location.

7. The method of claim 1 , wherein the one or more user-specified search terms include a word or phrase from a message subject or message body.

8. The method of claim 1 , wherein the plurality of messages are received by the client device within a predetermined time period prior to the request.

9. A system comprising one or more processors and memory storing instructions that when executed, cause the one or more processors to perform operations of:

receive, via a client device and from a user of the client device, a request to view messages; and

in response to receiving the request from the user:

process the request to determine one or more user-specified search terms, wherein the one or more user-specified search terms include a keyword identifying an entity,

obtain, based on the one or more user-specified search terms, cross-platform message data that includes a plurality of messages received from different messaging applications,

generate, based on the cross-platform message data, one or more interface elements for display at a unified interface of the client device, and

cause the one or more interface elements to be displayed at the unified interface of the client device,

wherein the one or more interface elements displayed at the unified interface include a merged interface element that merges a first subset of messages, out of the plurality of messages in the cross-platform message data, based on the keyword identifying the entity.

10. The system of claim 9 , wherein the entity is a sender of the messages to be viewed by the user, and the merged interface element includes an identifier of the sender.

11. The system of claim 9 , wherein the cross-platform message data further includes temporal data indicative of a time at which each message, of the first subset of messages, is received or sent.

12. The system of claim 11 , wherein the merged interface element includes a most recent time among the times at which the first subset of messages are respectively received.

13. The system of claim 9 , wherein the one or more user-specified search terms include a word or phrase from a message subject or message body.

14. The system of claim 9 , wherein the plurality of messages are received by the client device within a predetermined time period prior to the request.

15. A non-transitory storage medium storing instructions that, when executed, cause one or more processor to:

receive, via a client device and from a user of the client device, a request to view messages; and

in response to receiving the request from the user:

process the request to determine one or more user-specified search terms, wherein the one or more user-specified search terms include a keyword identifying an entity,

obtain, based on the one or more user-specified search terms, cross-platform message data that includes a plurality of messages received from different messaging applications,

generate, based on the cross-platform message data, one or more interface elements for display at a unified interface of the client device, and

cause the one or more interface elements to be displayed at the unified interface of the client device,

wherein the one or more interface elements displayed at the unified interface include a merged interface element that merges a first subset of messages, out of the plurality of messages in the cross-platform message data, based on the keyword identifying the entity.

16. The non-transitory storage medium of claim 15 , wherein the entity is a sender of the messages to be viewed by the user, and the merged interface element includes an identifier of the sender.

17. The non-transitory storage medium of claim 15 , wherein the cross-platform message data further includes temporal data indicative of a time at which each message, of the first subset of messages, is received or sent.

18. The non-transitory storage medium of claim 17 , wherein the merged interface element includes a most recent time among the times at which the first subset of messages are respectively received.

19. The non-transitory storage medium of claim 15 , wherein the one or more user-specified search terms include a word or phrase from a message subject or message body.

20. The non-transitory storage medium of claim 15 , wherein the plurality of messages are received by the client device within a predetermined time period prior to the request.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2024
From: LY, VINH QUOC; TEKDAS, AHMET ONUR; MERTENS, TIMO; KOLAK, OKAN; SIEVERT, CHARLES RANDELL; NGUYEN, CHRISTINE; LU, JIN
To: GOOGLE INC.
Reel/Frame 067375/0550 →
CHANGE OF NAME Recorded May 10, 2024
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 067382/0131 →
Continuity (4)
Continuation 18100486 · Jan 23, 2023
Continuation 16740236 · Jan 10, 2020
Continuation 15156567 · May 17, 2016
Related Publication 20240248938A1 · Jul 25, 2024
References Cited (92)
US 5493692A · Theimer et al. · 1996 [cited by applicant]
US 5608786A · Gordon · 1997 [cited by applicant]
US 6044260A · Eaton et al. · 2000 [cited by applicant]
US 6067350A · Gordon · 2000 [cited by applicant]
US 6208986B1 · Schneck · 2001 [cited by applicant]
US 6260039B1 · Schneck · 2001 [cited by applicant]
US 7130885B2 · Chandra et al. · 2006 [cited by applicant]
US 7225249B1 · Barry · 2007 [cited by examiner]
US 7296241B2 · Oshiro et al. · 2007 [cited by applicant]
US 7460874B1 · Hou et al. · 2008 [cited by applicant]
US 7657586B2 · Rodriguez · 2010 [cited by applicant]
US 7870200B2 · Slater et al. · 2011 [cited by applicant]
US 8107977B2 · Olague · 2012 [cited by applicant]
US 8165998B2 · Andres · 2012 [cited by applicant]
US 8170189B2 · Alperin · 2012 [cited by applicant]
US 8239461B2 · Jones et al. · 2012 [cited by applicant]
US 8423570B2 · Hirst · 2013 [cited by examiner]
US 8566403B2 · Pascal et al. · 2013 [cited by applicant]
US 8694476B2 · Rodriguez · 2014 [cited by applicant]
US 8725764B2 · Hirst · 2014 [cited by examiner]
US 8954406B2 · Rodriguez · 2015 [cited by applicant]
US 9215194B2 · Shaffer · 2015 [cited by applicant]
US 9438554B2 · Fleck · 2016 [cited by applicant]
US 9559997B1 · Everton · 2017 [cited by applicant]
US 9578060B1 · Brisebois et al. · 2017 [cited by applicant]
US 9838542B1 · Kirchhoff et al. · 2017 [cited by applicant]
US 9923848B2 · Seol et al. · 2018 [cited by applicant]
US 10096001B1 · Everton et al. · 2018 [cited by applicant]
US 10326723B2 · Everton · 2019 [cited by applicant]
US 10509531B2 · Sharifi et al. · 2019 [cited by applicant]
US 10795947B2 · Ly et al. · 2020 [cited by applicant]
US 10893009B2 · Everton · 2021 [cited by applicant]
US 11562036B2 · Ly et al. · 2023 [cited by applicant]
US 20040025663A1 · Harada et al. · 2004 [cited by applicant]
US 20050076109A1 · Mathew et al. · 2005 [cited by applicant]
US 20050108341A1 · Mathew et al. · 2005 [cited by applicant]
US 20050114456A1 · Mathew et al. · 2005 [cited by applicant]
US 20050114462A1 · Mathew et al. · 2005 [cited by applicant]
US 20050172033A1 · Mathew et al. · 2005 [cited by applicant]
US 20050223057A1 · Buchheit et al. · 2005 [cited by applicant]
US 20060031340A1 · Mathew et al. · 2006 [cited by applicant]
US 20060173753A1 · Padmanabhan · 2006 [cited by examiner]
US 20060195462A1 · Rogers · 2006 [cited by examiner]
US 20070011258A1 · Khoo · 2007 [cited by applicant]
US 20070174388A1 · Williams · 2007 [cited by applicant]
US 20080239955A1 · Chang et al. · 2008 [cited by applicant]
US 20090106366A1 · Virtanen et al. · 2009 [cited by applicant]
US 20090209286A1 · Bentley et al. · 2009 [cited by applicant]
US 20100159883A1 · Pascal et al. · 2010 [cited by applicant]
US 20110053565A1 · Johansson et al. · 2011 [cited by applicant]
US 20110078247A1 · Jackson et al. · 2011 [cited by applicant]
US 20110209196A1 · Kennedy · 2011 [cited by applicant]
US 20110264689A1 · Hirst · 2011 [cited by examiner]
US 20130185290A1 · Hirst · 2013 [cited by examiner]
US 20130238651A1 · Benedek et al. · 2013 [cited by applicant]
US 20130275164A1 · Gruber · 2013 [cited by examiner]
US 20140040748A1 · Lemay · 2014 [cited by examiner]
US 20140067401A1 · Sanjeeva et al. · 2014 [cited by applicant]
US 20140164507A1 · Tesch et al. · 2014 [cited by applicant]
US 20150057997A1 · Quast et al. · 2015 [cited by applicant]
US 20150186538A1 · Yan et al. · 2015 [cited by applicant]
US 20150193457A1 · Radhakrishnan · 2015 [cited by applicant]
US 20150312178A1 · Seol et al. · 2015 [cited by applicant]
US 20150312193A1 · Menna et al. · 2015 [cited by applicant]
US 20150350421A1 · Lau · 2015 [cited by applicant]
US 20160034977A1 · Bhaowal et al. · 2016 [cited by applicant]
US 20160357970A1 · Dow · 2016 [cited by applicant]
US 20170286429A1 · Lange et al. · 2017 [cited by applicant]
US 20170337274A1 · Ly · 2017 [cited by examiner]
US 20180239495A1 · Sharifi et al. · 2018 [cited by applicant]
US 20190155871A1 · Lane et al. · 2019 [cited by applicant]
US 20200007502A1 · Everton · 2020 [cited by applicant]
US 20200151223A1 · Ly et al. · 2020 [cited by applicant]
CN 101194277 · 2008 [cited by applicant]
CN 104246802A · 2014 [cited by examiner]
CN 104246802B · 2018 [cited by examiner]
EP 1647908 · 2006 [cited by applicant]
WO 2005045589 · 2005 [cited by applicant]
WO 2005098701 · 2005 [cited by applicant]
European Patent Office; Intention to Grant issued in Application No. 16828893.4; 69 pages; dated Jul. 11, 2023. [cited by applicant]
European Patent Office; Communication pursuant to Article 94(3) issued in Application No. 16828893.4, 10 pages, dated Aug. 11, 2022. [cited by applicant]
China National Intellectual Property Office: Third Office Action issued for Application No. 201680084954.2, 15 pages, dated Aug. 9, 2022. [cited by applicant]
China National Intellectual Property Office: Second Office Action issued for Application No. 201680084954.2, 6 pages, dated Apr. 19, 2022. [cited by applicant]
China Patent Office; Office Action issued in Application No. 201680084954.2; 7 pages; dated Aug. 3, 2021. [cited by applicant]
International Preliminary Report on Patentability issued in International Application No. PCT/US2016/069379; 7 pages; dated Nov. 29, 2018. [cited by applicant]
European Patent Office; Examination Report issued in Application No. EP16828893.4; 7 pages; dated Aug. 7, 2020 Aug. 7, 2020. [cited by applicant]
Intemational Search Report and Written Opinion in International Application No. PCT/US2016/069379; 13 pages; dated Mar. 20, 2017. [cited by applicant]
“How to Use Spotlight Search on Your iPhone or iPad,” How-To Geek [retrieved on May 20, 2016]. Retrieved from the Internet: URL<http://www.howtogeek.com/229060/how-to-use-spotlight-search-on-your-iphone-or-ipad/>; 4 pag… [cited by applicant]
El Khoury, “PSA: Google Now Can Read Your Last Five Text Messages Like An Answering Machine And Let You Reply To Them,” Android Police [retrieved on May 20, 2016]. Retrieved from the Internet: URL<http://www.androidpoli… [cited by applicant]
Miera, “The ultimate guide to Google Now cards,” Android Central [retrieved on May 20, 2016]. Retrieved from the Internet: URL<http://www. androidcentral.com/ultimate-guide-google-now-cards>; 38 pages; dated Sep. 5, 201… [cited by applicant]
Rittmeyer, “Android Tutorial: Adding Search to Your Apps,” Grokking Android Jul. 6, 2012. [cited by applicant]
European Patent Office; Communication Pursuant to Article 94(3) EPC issued in Application No. 16828893.4; 9 pages; dated May 17, 2021. [cited by applicant]