IP Library › Granted Patent US 11,749,279
Granted Patent B2
US 11,749,279 · App. 17/888,385 · Granted Sep 5, 2023

Detection of story reader progress for pre-caching special effects

Inventors: Chaitanya Gharpure (Santa Clara, CA); Evan Fisher (San Francisco, CA); Eric Liu (Redwood City, CA); Peng Yang (San Jose, CA); Emily Hou (Mountain View, CA); Victoria Fang (Mountain View, CA)
Assignee: Google LLC
G10L15/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,749,279
App. No.
17/888,385
Granted
Sep 5, 2023
Kind
B2
Abstract

The disclosure provides technology for enhancing the ability of a computing device to conserve computing resources while providing special effects that are aligned with a text source being read aloud. An example method includes identifying effects data for a text source, wherein the effects data correlates a physical effect with an audible action of a user; receiving audio data comprising a plurality of audible actions, wherein at least one of the plurality of audible actions comprises a spoken word of the text source; determining, by a processing device, that a triggering condition pertaining to the effects data and the text source is satisfied; loading content for the physical effect prior to an occurrence of the audible action, and providing the physical effect to modify an environment of the user.

Claims (58)

1. A method comprising:

identifying effects data for a text source, wherein the effects data correlates a physical effect with an audible action of a user;

receiving audio data comprising a plurality of audible actions, wherein at least one of the plurality of audible actions comprises a spoken word corresponding to a determined reading progress of the user with respect to the text source;

determining, by a processing device, that a triggering condition pertaining to the effects data and the text source is satisfied;

loading content for the physical effect prior to an occurrence of the audible action; and

providing the physical effect to modify an environment of the user.

2. The method of claim 1 , further comprising setting the triggering condition pertaining to the effects data and the text source, wherein setting the triggering condition comprises:

determining the physical effect is associated with a first location in the text source;

selecting a second location in the text source that is before the first location, wherein the selecting is based on a reading speed and a load time associated with the physical effect; and

setting the triggering condition to correspond with the second location in the text source.

3. The method of claim 2 , wherein the second location in the text source is associated with at least one of a particular instance of a word, a paragraph, a page, or a chapter of the text source.

4. The method of claim 1 , further comprising setting the triggering condition pertaining to the effects data and the text source, wherein setting the triggering condition comprises:

calculating a duration of time to load the content based on an amount of the content for the physical effect and an amount of available computing resources;

determining a time in the future that the audible action will occur;

identifying a time to initiate the loading based on the calculated duration and the determined time of the audible action; and

setting the triggering condition to correspond with a location in the text source that is defined in accordance with the identified time.

5. The method of claim 4 , wherein determining the time comprises calculating the time in the future based on a reading speed and a current reading location in the text source.

6. The method of claim 1 , wherein the effects data indicates the physical effect and indicates a location in the text source that relates to the audible action, wherein the location indicates a word, paragraph, or a page of the text source.

7. The method of claim 1 , wherein the audible action comprises a spoken word of the text source and the physical effect comprises an acoustic effect corresponding to the spoken word.

8. The method of claim 1 , wherein the audible action comprises a page turn and the physical effect comprises a modification to an acoustic effect, an optical effect, or a haptic effect.

9. A system comprising:

a memory; and

a processing device, coupled to memory, to perform operations comprising:

identifying effects data for a text source, wherein the effects data correlates a physical effect with an audible action of a user;

receiving audio data comprising a plurality of audible actions, wherein at least one of the plurality of audible actions comprises a spoken word corresponding to a determined reading progress of the user with respect to the text source;

determining, by a processing device, that a triggering condition pertaining to the effects data and the text source is satisfied;

loading content for the physical effect prior to an occurrence of the audible action; and

providing the physical effect to modify an environment of the user.

10. The system of claim 9 , the operations further comprising setting the triggering condition pertaining to the effects data and the text source, wherein setting the triggering condition comprises:

determining the physical effect is associated with a first location in the text source;

selecting a second location in the text source that is before the first location, wherein the selecting is based on a reading speed and a load time associated with the physical effect; and

setting the triggering condition to correspond with the second location in the text source.

11. The system of claim 10 , wherein the second location in the text source is associated with at least one of a particular instance of a word, a paragraph, a page, or a chapter of the text source.

12. The system of claim 9 , the operations further comprising setting the triggering condition pertaining to the effects data and the text source, wherein setting the triggering condition comprises:

calculating a duration of time to load the content based on an amount of the content for the physical effect and an amount of available computing resources;

determining a time in the future that the audible action will occur;

identifying a time to initiate the loading based on the calculated duration and the determined time of the audible action; and

setting the triggering condition to correspond with a location in the text source that is defined in accordance with the identified time.

13. The system of claim 12 , wherein determining the time comprises calculating the time in the future based on a reading speed and a current reading location in the text source.

14. The system of claim 9 , wherein the effects data indicates the physical effect and indicates a location in the text source that relates to the audible action, wherein the location indicates a word, paragraph, or a page of the text source.

15. The system of claim 9 , wherein the audible action comprises a spoken word of the text source and the physical effect comprises an acoustic effect corresponding to the spoken word.

16. The system of claim 9 , wherein the audible action comprises a page turn and the physical effect comprises a modification to an acoustic effect, an optical effect, or a haptic effect.

17. A non-transitory computer readable medium, which when executed by a processing device, causes the processing device to perform operations comprising:

identifying effects data for a text source, wherein the effects data correlates a physical effect with an audible action of a user;

receiving audio data comprising a plurality of audible actions, wherein at least one of the plurality of audible actions comprises a spoken word corresponding to a determined reading progress of the user with respect to the text source;

determining, by a processing device, that a triggering condition pertaining to the effects data and the text source is satisfied;

loading content for the physical effect prior to an occurrence of the audible action; and

providing the physical effect to modify an environment of the user.

18. The non-transitory computer readable medium of claim 17 , the operations further comprising setting the triggering condition pertaining to the effects data and the text source, wherein setting the triggering condition comprises:

determining the physical effect is associated with a first location in the text source;

selecting a second location in the text source that is before the first location, wherein the selecting is based on a reading speed and a load time associated with the physical effect; and

setting the triggering condition to correspond with the second location in the text source.

19. The non-transitory computer readable medium of claim 18 , wherein the second location in the text source is associated with at least one of a particular instance of a word, a paragraph, a page, or a chapter of the text source.

20. The non-transitory computer readable medium of claim 17 , the operations further comprising setting the triggering condition pertaining to the effects data and the text source, wherein setting the triggering condition comprises:

calculating a duration of time to load the content based on an amount of the content for the physical effect and an amount of available computing resources;

determining a time in the future that the audible action will occur;

identifying a time to initiate the loading based on the calculated duration and the determined time of the audible action; and

setting the triggering condition to correspond with a location in the text source that is defined in accordance with the identified time.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2023
From: GHARPURE, CHAITANYA; FISHER, EVAN; LIU, ERIC; YANG, PENG; HOU, EMILY; FANG, VICTORIA
To: GOOGLE LLC
Reel/Frame 062538/0153 →
Continuity (2)
Continuation 16611167
Related Publication 20230085959A1 · Mar 23, 2023
Cited By (1)
US 12,450,806