IP Library › Granted Patent US 8,996,510
Granted Patent B2
US 8,996,510 · App. 13/297,018 · Granted Mar 31, 2015

Identifying digital content using bioresponse data

Inventors: Amit V. Karmarkar (Palo Alto, CA); Sharada Karmarkar (Palo Alto, CA); Richard R. Peters (Mill Valley, CA)
Assignee: Buckyball Mobile, Inc.
G06F3/013G06F17/30861
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,996,510
App. No.
13/297,018
Granted
Mar 31, 2015
Kind
B2
Abstract

In one exemplary embodiment, eye-tracking data may be collected from a user while the user is viewing a visual sensory stimulus. If the eye-tracking data includes an eye motion pattern exceeding a predetermined threshold, then the eye-tracking data may be used to identify a visual element within the user's field of view. In addition to the visual element, attributes and context information related to the sensory experience may be determined. Information related to the sensory experience may be stored in a repository for purposes of aiding the user's recollection of the visual element at a future time.

Claims (88)

1. A computer-implemented method of retrieving information regarding a sensory element experienced by a user according to bioresponse data, the method comprising:

determining bioresponse data from the user while the user is experiencing a sensory stimulus including the sensory element;

if the bioresponse data includes a pattern exceeding a threshold, then identifying, using the bioresponse data, the sensory element within the sensory stimulus and wherein the threshold comprises a initial period of time of 750 milliseconds, and wherein the threshold is increased to 950 milliseconds when the user exhibits an increased stress level;

identifying an attribute of the sensory element, wherein the attribute describes the sensory element,

associating the sensory element with the attribute.

2. The computer-implemented method of claim 1 , wherein the pattern comprises a visual fixation on the sensory element.

3. The computer-implemented method of claim 1 , further comprising:

wherein context data comprises a temperature of the physical environment in which the user experienced the sensory stimulus; and

storing the association of the sensory element with the attribute and the context data.

4. The computer-implemented method of claim 1 , wherein the context data includes at least one of date, time, or user location.

5. The computer-implemented method of claim 3 , wherein the context data includes at least one of a type, orientation, or acceleration of a device that is determining the bioresponse data.

6. The computer-implemented method of claim 3 , further comprising:

receiving a search inquiry, wherein the search inquiry represents the attribute and the context data;

searching the stored associations using the search inquiry; and

displaying the sensory element based on the searching.

7. The computer-implemented method of claim 1 , wherein the pattern is a visual regression on the sensory element, the visual regression comprising a number of fixations within a time period.

8. The computer-implemented method of claim 1 , wherein the pattern is a visual saccadic pattern associated with the sensory element.

9. The computer-implemented method of claim 1 , wherein:

the sensory element comprises an image in an HTML document, and

the attribute comprises a value of an HTML attribute of an HTML element associated with the sensory element.

10. The computer-implemented method of claim 1 , wherein:

the sensory element is obtained from a web search, and the attribute describes the sensory element.

11. The computer-implemented method of claim 1 , wherein the attribute is a name of a file containing the sensory element.

12. The computer-implemented method of claim 1 , wherein the attribute is determined by applying an image recognition algorithm against at least of a portion of the sensory element.

13. The computer-implemented method of claim 1 , wherein the sensory element is displayed on a screen of a digital computing device.

14. The computer-implemented method of claim 1 , wherein the sensory element is displayed on a screen of a digital kiosk.

15. The computer-implemented method of claim 1 , wherein the sensory element is visible to the eye of the user through an augmented reality goggle.

16. A computer-implemented method of retrieving, using bioresponse data, information regarding a sensory element experienced by a user, comprising:

receiving, from the user, a search query, wherein the search query includes at least one of date, time, location estimating the user's previous experience of the sensory element;

searching a repository of stored associations between the sensory element and the search query, wherein:

an association was stored based on bioresponse data determined from the user while the user was previously experiencing the sensory element,

the sensory element represents a portion of a sensory stimulus experienced by the user, and

the bioresponse data includes a pattern exceeding a threshold, and wherein the threshold comprises a initial period of time of 750 milliseconds, and wherein the threshold is increased to 950 milliseconds when the user exhibits an increased stress level; and

displaying the sensory element previously experienced by the user based on the searching.

17. A non-transitory computer-readable storage medium comprising computer-executable instructions for retrieving information regarding a sensory element experienced by a user according to bioresponse data, the computer-executable instructions comprising instructions for:

determining bioresponse data from the user while the user is experiencing a sensory stimulus including the sensory element, wherein the sensory element comprises a text element;

if the bioresponse data includes a pattern exceeding a threshold, then identifying, using the bioresponse data, the sensory element within the sensory stimulus, wherein the threshold is modified based on a stress level of the user, and wherein the threshold comprises a initial period of time of 750 milliseconds, and wherein the threshold is increased to 950 milliseconds when the user exhibits an increased stress level;

identifying an attribute of the sensory element, wherein the attribute describes the sensory element, wherein the attribute comprises a dictionary definition of at least a portion of the text element;

identifying a context data, wherein the context data identifies a physical environment in which the user experienced the sensory stimulus; and

associating the sensory element with the attribute and the context data; and

storing the association of the sensory element with the attribute.

18. The non-transitory computer-readable medium of claim 17 , wherein the pattern comprises a visual fixation on the sensory element.

19. The non-transitory computer-readable medium of claim 17 , further comprising:

wherein context data comprises a temperature of the physical environment in which the user experienced the sensory stimulus; and

storing the association of the sensory element with the attribute and the context data.

20. The non-transitory computer-readable medium of claim 17 , wherein the context data includes at least one of date, time, or user location.

21. The non-transitory computer-readable medium of claim 19 , wherein the context data includes at least one of a type, orientation, or acceleration of a device that is determining the bioresponse data.

22. The non-transitory computer-readable medium of claim 19 , further comprising:

receiving a search inquiry, wherein the search inquiry represents attribute or context data;

searching the stored associations using the search inquiry; and

displaying the sensory element based on the searching.

23. The non-transitory computer-readable medium of claim 17 , wherein the pattern is a visual regression on the sensory element, the visual regression comprising a number of fixations within a time period.

24. The non-transitory computer-readable medium of claim 17 , wherein the pattern is a visual saccadic pattern associated with the sensory element.

25. The non-transitory computer-readable medium of claim 17 , wherein:

the sensory element comprises an image in an HTML document, and

the attribute comprises a value of an HTML attribute of an HTML element associated with the sensory element.

26. The non-transitory computer-readable medium of claim 17 , wherein:

the sensory element is obtained from a web search, and the attribute describes the sensory element.

27. The non-transitory computer-readable medium of claim 17 , wherein the attribute is a name of a file containing the sensory element.

28. The non-transitory computer-readable medium of claim 17 , wherein the attribute is determined by applying an image recognition algorithm against at least of a portion of the sensory element.

29. The non-transitory computer-readable medium of claim 17 , wherein the sensory element includes text, and the attribute is a dictionary definition of at least a portion of the text.

30. The non-transitory computer-readable medium of claim 17 , wherein the sensory element is displayed on a screen of a digital computing device.

31. The non-transitory computer-readable medium of claim 17 , wherein the sensory element is displayed on a screen of a digital kiosk.

32. The non-transitory computer-readable medium of claim 17 , wherein the sensory element is visible to the eye of the user through an augmented reality goggle.

33. A non-transitory computer-readable storage medium comprising computer-executable instructions for retrieving, using bioresponse data, information regarding a sensory element experienced by a user, the computer-executable instructions comprising instructions for:

receiving, from the user, a search query, wherein the search query includes at least one of date, time, location estimating the user's previous experience of the sensory element;

searching a repository of stored associations between the sensory element and the search query, wherein:

an association was stored based on bioresponse data determined from the user while the user was previously experiencing the sensory element,

the sensory element represents a portion of a sensory stimulus experienced by the user, and

the bioresponse data includes a pattern exceeding a threshold, and wherein the threshold comprises a initial period of time of 750 milliseconds, and wherein the threshold is increased to 950 milliseconds when the user exhibits an increased stress level; and

displaying the sensory element previously experienced by the user based on the searching.

34. A computer system for retrieving information regarding a sensory element experienced by a user according to bioresponse data, comprising:

one or more sensors configured to determine bioresponse data from the user while the user is experiencing a sensory stimulus including the sensory element, wherein the bioresponse data comprises eye-tracking data that indicates a comprehension difficulty on the part of the user with respect to the sensory stimulus, and wherein the sensory stimulus comprises text; and

one or more processors configured to:

identify, using the bioresponse data, the sensory element within the sensory stimulus, if the bioresponse data includes a pattern exceeding a threshold and wherein the threshold comprises a initial period of time of 750 milliseconds, and wherein the threshold is increased to 950 milliseconds when the user exhibits an increased stress level;

identify an attribute of the sensory element, wherein the attribute describes the sensory element;

identify, using the bioresponse data, context data, wherein the context data identifies the physical environment in which the user experienced the sensory stimulus;

associate the sensory element with the attribute and the context data; and

store the association into memory.

35. A computer system for retrieving, using bioresponse data, information regarding a sensory element experienced by a user, comprising:

memory storing associations between the sensory element and related information, wherein:

an association was stored based on bioresponse data determined from the user while the user was previously experiencing the sensory element,

the sensory element represents a portion of a sensory stimulus experienced by the user, and

the bio response data includes a pattern exceeding a threshold, wherein the threshold is modified based on a stress level of the user, and wherein the threshold comprises a initial period of time of 750 milliseconds, and wherein the threshold is increased to 950 milliseconds when the user exhibits an increased stress level; and

one or more processors configured to:

receive, from the user, a search query, wherein the search query includes at least one of date, time, location estimating the user's previous experience of the sensory element;

search the memory based on the search query; and

cause to be displayed the sensory element previously experienced by the user based on the searching.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 15, 2011
From: KARMARKAR, AMIT V.; KARMARKAR, SHARADA; PETERS, RICHARD R.
To: BUCKYBALL MOBILE, INC.
Reel/Frame 027231/0682 →
Continuity (3)
Provisional Application 61526263 · Aug 23, 2011
Provisional Application 61535985 · Sep 17, 2011
Related Publication 20130054576A1 · Feb 28, 2013