IP Library › Granted Patent US 12,423,119
Granted Patent B2
US 12,423,119 · App. 18/372,471 · Granted Sep 23, 2025

Automated content switching rule for controlling access to interactive content on a computing device

Inventors: Victor Carbune (Zurich, CH); Matthew Sharifi (Kilchberg, CH)
Assignee: GOOGLE LLC
G06F9/451G06F40/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,423,119
App. No.
18/372,471
Granted
Sep 23, 2025
Kind
B2
Abstract

Automated content switching rules may be generated and/or utilized for automatically switching away from certain interactive content during presentation of that interactive content when one or more switch conditions are met. In some instances, automated content switching rules may define one or more non-temporal switch conditions, e.g., based upon reaching certain points or milestones in certain interactive content, that may be used to initiate actions that switch away from the interactive content. In addition, in some instances, automated content switching rules may be used to not only switch away from particular interactive content, but additionally switch to other interactive content, thereby enabling a user to effectively schedule a workflow across different interactive content, applications and/or other computer-related tasks.

Claims (24)

1. A method, comprising:

in response to user input, generating an automated content switching rule for a user computing device, the automated content switching rule associated with interactive content presented on the user computing device, and the automated content switching rule including:

a switch condition defining a non-temporal triggering event for the interactive content; and

a conditioned action configured to initiate at least one operation on the user computing device to discontinue user interaction with the interactive content in response to the switch condition being met; and

during presentation of the interactive content on the user computing device, and using instructions external from an application presenting the interactive content on the user computing device:

performing image and/or view hierarchy analysis of a user interface for the application presenting the interactive content on the user computing device, wherein performing the image and/or view hierarchy analysis of the user interface attempts to identify an appearance of a control in the user interface overlaying the interactive content and configured to replay the interactive content or play a next interactive content;

using a result of the image and/or view hierarchy analysis of the user interface for the application, determining if the switch condition of the automated content switching rule has been met; and

in response to determining that the switch condition of the automated content switching rule has been met, executing the conditioned action to initiate the at least one operation on the user computing device to discontinue user interaction with the interactive content.

2. The method of claim 1 , wherein the interactive content includes a video game, a video, a movie, a song, an e-book, a web page, or social media content, wherein the non-temporal triggering event specifies reaching a predetermined point or milestone in the interactive content, and wherein the predetermined point or milestone includes an end point, a level, a predetermined event, a chapter, an episode, a game, or a video.

3. The method of claim 1 , wherein the at least one operation for the conditioned action is configured to restrict future user interaction with the interactive content, wherein executing the conditioned action to initiate the at least one operation on the user computing device includes blocking a subsequent user attempt to interact with the interactive content, and wherein the at least one operation for the conditioned action is configured to restrict future user interaction with the application, a function of the application, or a category or type of interactive content, application or function.

4. The method of claim 1 , wherein the user input includes a natural language input, and wherein generating the automated content switching rule includes performing user intent classification with an automated assistant to determine the switch condition and conditioned action for the automated content switching rule.

5. The method of claim 1 , wherein the switch condition is a first switch condition and the conditioned action is a first conditioned action, wherein the automated content switching rule further includes a second switch condition and a second conditioned action configured to initiate at least one operation on the user computing device in response to the second switch condition being met, and wherein the second switch condition is activated only after the first switch condition is met and the first conditioned action is executed.

6. A method, comprising:

in response to user input, generating an automated content switching rule for a user computing device, the automated content switching rule associated with interactive content presented on the user computing device, and the automated content switching rule including:

a switch condition defining a non-temporal triggering event for the interactive content; and

a conditioned action configured to initiate at least one operation on the user computing device to discontinue user interaction with the interactive content in response to the switch condition being met; and

during presentation of the interactive content on the user computing device, and using instructions external from an application presenting the interactive content on the user computing device:

performing semantic analysis of an application state for the application presenting the interactive content on the user computing device using a neural network configured to receive a screen state of the application and a condition description of the switch condition, wherein the screen state of the application includes an image and/or view hierarchy;

using a result of the semantic analysis of the application state for the application, determining if the switch condition of the automated content switching rule has been met; and

in response to determining that the switch condition of the automated content switching rule has been met, executing the conditioned action to initiate the at least one operation on the user computing device to discontinue user interaction with the interactive content.

7. The method of claim 6 , wherein the interactive content includes a video game, a video, a movie, a song, an e-book, a web page, or social media content, wherein the non-temporal triggering event specifies reaching a predetermined point or milestone in the interactive content, and wherein the predetermined point or milestone includes an end point, a level, a predetermined event, a chapter, an episode, a game, or a video.

8. The method of claim 6 , wherein the at least one operation for the conditioned action is configured to restrict future user interaction with the interactive content, wherein executing the conditioned action to initiate the at least one operation on the user computing device includes blocking a subsequent user attempt to interact with the interactive content, and wherein the at least one operation for the conditioned action is configured to restrict future user interaction with the application, a function of the application, or a category or type of interactive content, application or function.

9. The method of claim 6 , wherein the user input includes a natural language input, and wherein generating the automated content switching rule includes performing user intent classification with an automated assistant to determine the switch condition and conditioned action for the automated content switching rule.

10. The method of claim 6 , wherein the switch condition is a first switch condition and the conditioned action is a first conditioned action, wherein the automated content switching rule further includes a second switch condition and a second conditioned action configured to initiate at least one operation on the user computing device in response to the second switch condition being met, and wherein the second switch condition is activated only after the first switch condition is met and the first conditioned action is executed.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2023
From: CARBUNE, VICTOR; SHARIFI, MATTHEW
To: GOOGLE LLC
Reel/Frame 065109/0462 →
Continuity (2)
Continuation 17665643 · Feb 7, 2022
Related Publication 20240012660A1 · Jan 11, 2024
References Cited (24)
US 8989564B2 · Vallone · 2015 [cited by examiner]
US 9017078B2 · Gross · 2015 [cited by applicant]
US 9760254B1 · Donnelley et al. · 2017 [cited by applicant]
US 10896671B1 · Mohajer et al. · 2021 [cited by applicant]
US 10922357B1 · Chennuru et al. · 2021 [cited by applicant]
US 11087634B2 · Chambers · 2021 [cited by applicant]
US 11494647B2 · Pouran Ben Veyseh · 2022 [cited by examiner]
US 20090259926A1 · Deliyannis · 2009 [cited by examiner]
US 20130041665A1 · Jang · 2013 [cited by applicant]
US 20140283012A1 · Eggerton et al. · 2014 [cited by applicant]
US 20150229867A1 · Jojic · 2015 [cited by examiner]
US 20150352444A1 · Smith · 2015 [cited by examiner]
US 20170094343A1 · Greene · 2017 [cited by examiner]
US 20170302876A1 · Orad et al. · 2017 [cited by applicant]
US 20190019426A1 · Chambers · 2019 [cited by applicant]
US 20200333929A1 · Bhullar · 2020 [cited by examiner]
US 20210064746A1 · Koide · 2021 [cited by examiner]
US 20220283923A1 · Udipi · 2022 [cited by examiner]
US 20230124296A1 · Ngo · 2023 [cited by examiner]
US 20230251877A1 · Carbune et al. · 2023 [cited by applicant]
EP 2759954 · 2014 [cited by applicant]
WO 2013096944 · 2013 [cited by applicant]
European Patent Office; International Search Report and Written Opinion issued in Application No. PCT/US2022/038499; 10 pages; dated Nov. 28, 2022. [cited by applicant]
European Patent Office, Communication pursuant to Article 94(3) EPC issued in Application No. 22754708.0, 6 pages, dated Jun. 30, 2025. [cited by applicant]