IP Library › Granted Patent US 12,235,921
Granted Patent B2
US 12,235,921 · App. 18/387,753 · Granted Feb 25, 2025

Contextual deep bookmarking

Inventors: Mugurel Ionut Andreica (Adliswil, CH); Gokhan H. Bakir (Bäch, CH); Tak Keung Cheng (Los Altos, CA); Marcin M. Nowak-Przygodzki (Bäch, CH)
Assignee: GOOGLE LLC
G06F16/9562G06F3/167G06F16/9566G10L15/22G10L15/26G06F40/134G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,235,921
App. No.
18/387,753
Granted
Feb 25, 2025
Kind
B2
Abstract

A computer-implemented method is described. The method includes a computing system receiving a first voice input from a user for generating a bookmark. Responsive to receiving the voice input, the computing system obtains a resource identifier associated with a resource page. The method includes the computing system storing the resource identifier as a bookmark in a bookmark index that is accessible in response to a request from a user device. The method further includes the computing system using the resource identifier, stored as the bookmark, to access the resource page. The computing system uses the resource identifier to access the resource page based on the request from the user device. The request is generated by the user device in response to the user device receiving a second voice input from the user.

Claims (53)

1. A method comprising:

receiving a voice input, from a user and at a computing device having at least one processor, while an aspect of dynamic content is being rendered for the user by the at least one processor;

extracting, by the at least one processor, based on pattern data associated with the dynamic content and based on the aspect of the dynamic content being rendered, element data associated with the aspect;

generating a bookmark associated with the dynamic content based on pattern data and based on the voice input,

wherein the bookmark comprises a static portion and a dynamic portion corresponding to the pattern data, and wherein the dynamic portion further corresponds to the element data associated with the aspect, and

wherein the voice input includes one or more first words indicating a user intent to create the bookmark associated with the dynamic content and includes one or more second words indicating a name used to identify the bookmark; and

storing, in association with the name used to identify the bookmark and by the at least one processor based on the generating of the bookmark, the bookmark in a bookmark index that is accessible by the at least one processor.

2. The method of claim 1 , further comprising:

receiving, at the computing device, a second voice input including the name used to identify the dynamic bookmark;

rendering, by the at least one processor, the aspect, wherein the aspect is rendered based on the receiving of the second voice input and based on the dynamic portion of the bookmark corresponding to the element data associated with the aspect.

3. The method of claim 1 , further comprising:

subsequent to storing the bookmark in the bookmark index:

identifying a second aspect of the dynamic content being rendered for the user by the at least one processor;

extracting, by the at least one processor, based on the pattern data associated with the dynamic content and based on the second aspect of the dynamic content being rendered, second element data associated with the second aspect; and

updating, by the at least one processor and based on the second element data associated with the second aspect, the dynamic portion of the bookmark in the bookmark index.

4. The method of claim 3 , further comprising:

subsequent to updating the dynamic portion of the bookmark in the bookmark index:

receiving, at the computing device, a second voice input including the name used to identify the dynamic bookmark;

rendering, by the at least one processor, the second aspect, wherein the second aspect is rendered based on the second voice input and based on the dynamic portion of the bookmark corresponding to the second element data associated with the second aspect.

5. The method of claim 3 , wherein the pattern data corresponds with a pattern, and the aspect of the dynamic content is capable of being rendered for the user at an initial instance in the pattern and the second aspect of the dynamic content is capable of being rendered for the user at a subsequent instance in the pattern.

6. The method of claim 1 , wherein the element data comprises context data, device assist data, a transcription, an application identifier, and/or a resource identifier.

7. The method of claim 6 , wherein the resource identifier is a deep link.

8. The method of claim 1 , wherein the pattern data corresponds with a particular application associated with the dynamic content.

9. The method of claim 1 , wherein the dynamic content comprises messages exchanged between the user and another user.

10. The method of claim 1 , wherein the dynamic content comprises a videogame.

11. The method of claim 10 , wherein the aspect is a particular level of the videogame and wherein the element data is a unique identifier corresponding to the particular level.

12. The method of claim 1 , further comprising:

in response to receiving the voice input, rendering, by the at least one processor, an acknowledgement of the first words, the acknowledgment of the first words indicating that the computing device will create the bookmark.

13. The method of claim 10 , further comprising:

in response to receiving the voice input, rendering, by the at least one processor, an acknowledgment of the second words, the acknowledgment of the second words indicating that the computing device will identify the bookmark in subsequently received voice inputs.

14. A system comprising:

one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:

receiving a voice input, from a user and at a computing device having at least one processor, while an aspect of dynamic content is being rendered for the user by the at least one processor;

extracting, by the at least one processor, based on pattern data associated with the dynamic content and based on the aspect of the dynamic content being rendered, element data associated with the aspect;

generating a bookmark associated with the dynamic content based on pattern data and based on the voice input,

wherein the bookmark comprises a static portion and a dynamic portion corresponding to the pattern data, and wherein the dynamic portion further corresponds to the element data associated with the aspect, and

wherein the voice input includes one or more first words indicating a user intent to create the bookmark associated with the dynamic content and includes one or more second words indicating a name used to identify the bookmark; and

storing, in association with the name used to identify the bookmark and by the at least one processor based on the generating of the bookmark, the bookmark in a bookmark index that is accessible by the at least one processor.

15. The system of claim 14 , the operations further comprising:

receiving, at the computing device, a second voice input including the name used to identify the dynamic bookmark;

rendering, by the at least one processor, the aspect, wherein the aspect is rendered based on the receiving of the second voice input and based on the dynamic portion of the bookmark corresponding to the element data associated with the aspect.

16. The system of claim 14 , the operations further comprising:

subsequent to storing the bookmark in the bookmark index:

identifying a second aspect of the dynamic content being rendered for the user by the at least one processor;

extracting, by the at least one processor, based on the pattern data associated with the dynamic content and based on the second aspect of the dynamic content being rendered, second element data associated with the second aspect; and

updating, by the at least one processor and based on the second element data associated with the second aspect, the dynamic portion of the bookmark in the bookmark index.

17. The system of claim 16 , the operations further comprising:

subsequent to updating the dynamic portion of the bookmark in the bookmark index:

receiving, at the computing device, a second voice input including the name used to identify the dynamic bookmark;

rendering, by the at least one processor, the second aspect, wherein the second aspect is rendered based on the second voice input and based on the dynamic portion of the bookmark corresponding to the second element data associated with the second aspect.

18. The system of claim 16 , wherein the pattern data corresponds with a pattern, and the aspect of the dynamic content is capable of being rendered for the user at an initial instance in the pattern and the second aspect of the dynamic content is capable of being rendered for the user at a subsequent instance in the pattern.

19. The system of claim 14 , wherein the element data comprises context data, device assist data, a transcription, an application identifier, and/or a resource identifier.

20. The system of claim 19 , wherein the resource identifier is a deep link.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2023
From: ANDREICA, MUGUREL IONUT; BAKIR, GOKHAN H.; CHENG, TAK KEUNG; NOWAK-PRZYGODZKI, MARCIN M.
To: GOOGLE INC.
Reel/Frame 065643/0989 →
CHANGE OF NAME Recorded Nov 22, 2023
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 065662/0289 →
Continuity (5)
Continuation 17891805 · Aug 19, 2022
Continuation 17073735 · Oct 19, 2020
Continuation 15836599 · Dec 8, 2017
Provisional Application 62486601 · Apr 18, 2017
Related Publication 20240070217A1 · Feb 29, 2024
References Cited (64)
US 6243445B1 · Begeja · 2001 [cited by examiner]
US 7313525B1 · Packingham et al. · 2007 [cited by applicant]
US 8731266B2 · Strand · 2014 [cited by applicant]
US 8869032B2 · Agarwal · 2014 [cited by examiner]
US 9195477B1 · Spencer · 2015 [cited by examiner]
US 10810278B2 · Andreica et al. · 2020 [cited by applicant]
US 11423113B2 · Andreica et al. · 2022 [cited by applicant]
US 20030088422A1 · Denenberg et al. · 2003 [cited by applicant]
US 20030144984A1 · Dunbar · 2003 [cited by applicant]
US 20070168192A1 · Peuziat et al. · 2007 [cited by applicant]
US 20080172364A1 · Cucerzan et al. · 2008 [cited by applicant]
US 20080243517A1 · Muschett et al. · 2008 [cited by applicant]
US 20080313215A1 · Beker et al. · 2008 [cited by applicant]
US 20090327263A1 · Maghoul · 2009 [cited by applicant]
US 20110252311A1 · Kay et al. · 2011 [cited by applicant]
US 20130110815A1 · Tankovich et al. · 2013 [cited by applicant]
US 20130117022A1 · Chen · 2013 [cited by examiner]
US 20130117263A1 · Lukose et al. · 2013 [cited by applicant]
US 20140006030A1 · Fleizach · 2014 [cited by examiner]
US 20150185985A1 · Kang et al. · 2015 [cited by applicant]
US 20150379128A1 · Chang et al. · 2015 [cited by applicant]
US 20160094654A1 · Raman et al. · 2016 [cited by applicant]
US 20160328105A1 · Chandra · 2016 [cited by examiner]
US 20160350136A1 · Karlo et al. · 2016 [cited by applicant]
US 20170004209A1 · Johl · 2017 [cited by applicant]
US 20170046180A1 · Desineni · 2017 [cited by examiner]
US 20170192941A1 · Glover et al. · 2017 [cited by applicant]
US 20180090135A1 · Schlesinger et al. · 2018 [cited by applicant]
US 20180166072A1 · Seksenov · 2018 [cited by examiner]
US 20220391466A1 · Andreica et al. · 2022 [cited by applicant]
CN 101211364 · 2008 [cited by applicant]
CN 102016502 · 2011 [cited by applicant]
CN 103119587 · 2013 [cited by applicant]
CN 103400579 · 2013 [cited by applicant]
EP 2728474 · 2014 [cited by applicant]
JP 11184670 · 1999 [cited by applicant]
JP H11184670 · 1999 [cited by applicant]
JP 2002189732 · 2002 [cited by applicant]
JP 2015114527 · 2015 [cited by applicant]
JP 2017027339 · 2017 [cited by applicant]
WO 2016157128 · 2016 [cited by applicant]
Azim, Tanzirul, Oriana Riva, and Suman Nath. “uLink: Enabling user-defined deep linking to app content.” In Proceedings of the 14th Annual International Conference on mobile systems, applications, and services, pp. 305-… [cited by examiner]
Ma, Yun, Xuanzhe Liu, Ruogu Du, Ziniu Hu, Yi Liu, Meihua Yu, and Gang Huang. “DroidLink: Automated generation of deep links for Android apps.” arXiv preprint arXiv:1605.06928 (2016). (Year: 2016). [cited by examiner]
China National Intellectual Property Administration: Notice of Grant issued in Application No. 201880012374.1; 6 pages; dated Jul. 1, 2023. [cited by applicant]
Heim, J. et al., “User profiles for adapting speech support in the opera web browser to disabled users;” In Universal Access in Ambient Intelligence Environments, pp. 154-172; Springer, Berlin, Heidelberg; 2007. [cited by applicant]
Azim et al.; uLink: Enabling user-defined deep linking to app content: In Proceeding of the 14th Annual International Conference on Mobile Systems, Applications, and Services; pp. 305-318; dated 2016. [cited by applicant]
China National Intellectual Property Administration; Notification of First Office Action issued in Application No. 201880012374.1; 18 pages; dated Dec. 1, 2022. [cited by applicant]
European Patent Office: Intention to Grant issued in Application No. 18701893.2, 51 pages, dated Jun. 8, 2022. [cited by applicant]
Japan Patent Office: Decision To Reject the Amendments issued for Application No. 2019-544669 dated Jan. 4, 2022. 9 pages. [cited by applicant]
Korean Intellectual Property Office; Notice of Allowance issued in Application No. 1020217028741; 3 pages; dated Nov. 16, 2021. [cited by applicant]
Korean Intellectual Property Office; Decision of Dismissal of Amendment issued in Application No. 20197023245; 11 pages; dated Aug. 9, 2021. [cited by applicant]
Japanese Patent Office: Office Action issued for Application No. 2019-544669; 7 pages; dated May 24, 2021. [cited by applicant]
Korean Intellectual Property Office; Decision of Rejection issued in Application No. 1020197023245; 8 pages; dated May 12, 2021. [cited by applicant]
European Patent Office; Communication Pursuant to Article 94(3) EPC issued in Application No. 18701893.2; 8 pages; dated Mar. 25, 2021. [cited by applicant]
Intellectual Property India; Office Action issue in Application No. 201927030773; 6 pages; dated Feb. 4, 2021. [cited by applicant]
Korean Intellectual Property Office: Notice of Office Action issued for Application No. 10-2019-7023245 dated Oct. 30, 2020. 70 pages. [cited by applicant]
Japan Patent Office: Office Action issued for Application No. 2019-544669 dated Oct. 12, 2020. 7 pages. [cited by applicant]
Written Opinion issued in International Application No. PCT/US2018/013130 mailed Jul. 18, 2018. 6 Pages. [cited by applicant]
International Search Report and Written Opinion in International Application No. PCT/US2018/013130 mailed Feb. 23, 2018. 16 pages. [cited by applicant]
Poon et al., “Browsing the Web from a Speech-Based Interface,” Proc. Of Human-Computer Interaction (JNTERACT'01), dated Jul. 9, 2001. 8 pages. [cited by applicant]
‘Speakeasysolutions.com’ [online] “Speakeasy Solutions Google Chrome Commands,” Speakeasy Solutions dated Oct. 2011. [retrieved on Feb. 15, 2018] Retreived from Internet: URL<http://www.speakeasysolutions.comwp-content/… [cited by applicant]
‘stanfordnip.github.jo’ [online] “Core NLP Annotators,” Version 3.8.0, [retrieved on Dec. 8, 2017] Retrireved from Internet: URL<https://stanfordnip.github.io/CoreNLP/annotators.html> 3 Pages. 2017. [cited by applicant]
‘www.ibm.com’ [online] “Named Entity Recognition annotator,” IBM Watson Explorer 10.0.0 [retrieved on Dec. 8, 2017] Retrieved from Internet: URL<https://www.ibm.com/support/knowledgecenter/SS8NLW_10.0.0/com.ibm.discover… [cited by applicant]
Japan Patent Office: Decision of Rejection issued for Application No. 2019-544669 dated Jan. 4, 2022. 3 pages. Jan. 4, 2022. [cited by applicant]