Granted Patent B2

US 12,436,617 · App. 18/214,283 · Granted Oct 7, 2025

Inventors: Tatu V. J. Harviainen (Helsinki, FI); Tao Chen (Palo Alto, CA)

Assignee: Adeia Guides Inc.

G06F3/016G06F3/011

Abstract

Claims (73)

1. A method comprising:

receiving, at a server, a request for a media asset for interaction on a haptic enabled device;

determining, based at least in part on the request, haptic feedback settings of the haptic enabled device associated with the request;

determining a version of the media asset, wherein:

the version comprises:

haptic feedback rendering criteria compatible with the haptic enabled device, and

graphics rendering criteria, and

the determining is based at least in part on both:

a current network connection strength between the server and the haptic enabled device; and

user interaction data corresponding to the haptic enabled device;

transmitting, by the server to the haptic enabled device, the version of the media asset; and

causing to render the version of the media asset for display via the haptic enabled device based at least in part on the haptic feedback settings.

2. The method of claim 1 , further comprising:

determining required haptic resolution ranges for the causing to render the version of the media asset for display via the haptic enabled device;

comparing the required haptic resolution ranges for the causing to render the version of the media asset for display to haptic feedback rendering capabilities of the haptic enabled device; and

determining, based at least in part on the comparing, the media asset can be displayed via the haptic enabled device.

3. The method of claim 1 , wherein at least two versions of the media asset are accessible via the server.

4. The method of claim 3 , wherein:

a first version of the at least two versions of the media asset comprises first haptic feedback criteria; and

a second version of the at least two versions of the media asset comprises second haptic feedback criteria different from the first haptic feedback criteria.

5. The method of claim 1 , wherein the haptic feedback rendering criteria comprises one or more of kinesthetic feedback or tactile feedback required for the causing to render the version of the media asset for display via the haptic enabled device.

6. The method of claim 1 , further comprising:

determining, based at least in part on a media presentation description associated with the media asset, required haptic feedback settings for the causing to render the version of the media asset;

comparing the required haptic feedback settings to the haptic feedback settings of the haptic enabled device; and

determining, based at least in part on the comparing, the version of the media asset is configured to be displayed via the haptic enabled device.

7. The method of claim 1 , wherein the version of the media asset is caused to be rendered for display based at least in part on rendering criteria defined by settings corresponding to the haptic enabled device.

8. The method of claim 7 , wherein the rendering criteria is modified during display of the media asset based at least in part on analysis of one or more user patterns of the haptic enabled device for a duration of time that the media asset is displayed.

9. The method of claim 8 , wherein the one or more user patterns comprise at least one of user response to haptic feedback, user eye tracking with respect to elements of the media asset caused to be rendered for display, duration of use, or an activity level of a user for a duration that the media asset is displayed.

10. The method of claim 1 , further comprising:

analyzing eye tracking data to identify one or more objects within a range of focus or a line of sight; and

adjusting the haptic feedback rendering criteria and the graphics rendering criteria based at least in part on the one or more objects within the range of focus or the line of sight.

11. The method of claim 1 , wherein the determining the version of the media asset is based at least in part on maintaining a minimum quality of experience (QoE) score of the rendered version of the media asset at the haptic enabled device.

12. The method of claim 1 , wherein determining the version of the media asset comprises:

identifying the user interaction data indicating visual inspection of the media asset;

identifying a current haptics fidelity level and current graphics fidelity level of the media asset; and

selecting the version of the media asset based on both (a) the haptic feedback rendering criteria of the version of the media asset indicating a lower haptics fidelity level than the current haptics fidelity level and (b) the graphics rendering criteria of the version of the media asset indicating a higher graphics fidelity level than the current graphics fidelity level.

13. The method of claim 1 , wherein determining the version of the media asset comprises:

identifying the user interaction data indicating tactile inspection of the media asset;

identifying a current haptics fidelity level and current graphics fidelity level of the media asset; and

selecting the version of the media asset based on both (a) the haptic feedback rendering criteria of the version of the media asset indicating a higher haptics fidelity level than the current haptics fidelity level and (b) the graphics rendering criteria of the version of the media asset indicating a lower graphics fidelity level than the current graphics fidelity level.

14. A system comprising:

a server; and

a haptic enabled device communicatively coupled to the server, the haptic enabled device comprising processing circuitry configured to interface with processing circuitry of the server, wherein one or more of the processing circuitries are configured to execute instructions to:

receive, at the server, a request for a media asset for interaction on the haptic enabled device;

determine, based at least in part on the request, haptic feedback settings of the haptic enabled device associated with the request;

determine a version of the media asset, wherein:

the version comprises:

haptic feedback rendering criteria compatible with the haptic enabled device, and

graphics rendering criteria, and

the determining is based at least in part on both:

a current network connection strength between the server and the haptic enabled device; and

user interaction data corresponding to the haptic enabled device;

transmit, by the server to the haptic enabled device, the version of the media asset and

cause to render the version of the media asset for display via the haptic enabled device based at least in part on the haptic feedback settings.

15. The system of claim 14 , wherein one or more of the processing circuitries are further configured to execute instructions to:

determine required haptic resolution ranges for the causing to render the version of the media asset for display via the haptic enabled device;

compare the required haptic resolution ranges for the causing to render the version of the media asset for display to haptic feedback rendering capabilities of the haptic enabled device; and

determine, based at least in part on the comparing, the media asset can be displayed via the haptic enabled device.

16. The system of claim 14 , wherein at least two versions of the media asset are accessible via the server.

17. The system of claim 16 , wherein:

a first version of the at least two versions of the media asset comprises first haptic feedback criteria; and

a second version of the at least two versions of the media asset comprises second haptic feedback criteria different from the first haptic feedback criteria.

18. The system of claim 14 , wherein the haptic feedback rendering criteria comprises one or more of kinesthetic feedback or tactile feedback required for the causing to render the version of the media asset for display via the haptic enabled device.

19. The system of claim 14 , wherein one or more of the processing circuitries are further configured to execute instructions to:

determine, based at least in part on a media presentation description associated with the media asset, required haptic feedback settings for the causing to render the version of the media asset;

compare the required haptic feedback settings to the haptic feedback settings of the haptic enabled device; and

determine, based at least in part on the comparing, the version of the media asset is configured to be displayed via the haptic enabled device.

20. The system of claim 14 , wherein the version of the media asset is caused to be rendered for display based at least in part on rendering criteria defined by settings corresponding to the haptic enabled device.

21. The system of claim 20 , wherein the rendering criteria is modified during display of the media asset based at least in part on analysis of one or more user patterns of the haptic enabled device for a duration of time that the media asset is displayed.

22. The system of claim 21 , wherein the one or more user patterns comprise user response to haptic feedback, user eye tracking with respect to elements of the media asset caused to be rendered for display, duration of use, or an activity level of a user for a duration that the media asset is displayed.

23. The system of claim 14 , wherein one or more of the processing circuitries are further configured to execute instructions to:

analyze eye tracking data to identify one or more objects within a range of focus or a line of sight; and

adjust the haptic feedback rendering criteria and the graphics rendering criteria based at least in part on the one or more objects within the range of focus or the line of sight.

Assignments (1)

Continuity (1)

References Cited (101)