IP Library Granted Patent US 10,990,163
Granted Patent B2
US 10,990,163 · App. 15/976,590 · Granted Apr 27, 2021

Content interaction system and method

Inventors: Chamli Tennakoon (New York, NY); Subhash Chandra (Dubai, AE); Amit Goenka (Dubai, AE)
Assignee: Z5X GLOBAL FZ-LLC
G06F3/011G06F3/016G06F3/16G06F3/167G06F8/38A63J25/00A63J2005/001
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,990,163
App. No.
15/976,590
Granted
Apr 27, 2021
Kind
B2
Abstract

A content interaction system and method allow a user to simultaneously interact with a piece of content using three senses (sound, sight and smell) of the user. In one embodiment, the content interaction system may have a plurality of devices wherein the user may integrate one or more of the devices together.

Claims (25)

1. A content interaction system, comprising:

an interactive content delivery system that stores a plurality of pieces of interactive content and delivers at least one piece of interactive content to a user device, each piece of interactive content having a plurality of items and a plurality of sense markers encoded in the piece of interactive content, the sense markers including a smell sense marker indicating a piece of content within the interactive content having a smell sense interaction opportunity, an auditory sense marker indicating a piece of content within the interactive content having an auditory sense interaction opportunity and a sight sense marker indicating a piece of content within the interactive content having a sight sense interaction opportunity, each sense marker being activated by a user interaction with each particular sense marker encoded in the piece of interactive content;

the interactive content delivery system further comprising a content encoder engine that retrieves a piece of content and encodes the plurality of sense markers for the piece of content to generate at least one piece of interactive content, wherein the content encoder engine automatically maps a sense associated with one or more of a plurality of sense devices onto a scene of the interaction content based on an emotion using clustering;

the user device having a display that displays the plurality of items in the piece of interactive content to a user and a device that allows the user to interact with the particular sense marker selected from the plurality of sense markers encoded in the at least one piece of interactive content and to select a particular item of the plurality of items in the piece of interactive content; and

a sense interaction system coupled to the user device that, in response to the particular sense marker in the interactive content being activated, triggers a sense response that is interacted with by the user or automatically activated, wherein the sense response is two or more of a smell sense response, an auditory sense response and a sight sense response.

2. The system of claim 1 , wherein the sense interaction system further comprises a smell sense device that emanates a signal that is synchronized to the smell sense marker in the interactive content so that the user interacts with the interactive content using the sense of smell.

3. The system of claim 1 , wherein the sense interaction system further comprises a touch sense device that generates a signal that is synchronized to the touch sense marker in the interactive content so that the user interacts with the interactive content using the sense of touch.

4. The system of claim 1 , wherein the sense interaction system is embedded into the user device.

5. The system of claim 1 , wherein the sense interaction system further comprises a touch sense device that is synchronized to the touch sense marker in the interactive content so that the user interacts with the interactive content using the sense of touch, a smell sense device that emanates a signal that is synchronized to the smell sense marker in the interactive content so that the user interacts with the interactive content using the sense of smell, an auditory sense device that emanates a signal that is synchronized to the auditory sense marker in the interactive content so that the user interacts with the piece of content using the sense of hearing and a sight sense device that emanates a signal that is synchronized to the sight sense marker in the interactive content so that the user interacts with the piece of content using the sense of sight, wherein each device has a separate housing and is coupled together.

6. The system of claim 5 , wherein each sense device generates a tuple that maps the sense associated with the sense device onto a scene of the interaction content and a duration of the sense response.

7. The system of claim 1 , wherein the sense interaction system automatically generates a sense marker in the piece of interaction content.

8. The system of claim 1 , wherein the interactive content delivery system further comprises a user interface element that generates one or more sense markers that are embedded into the piece of interactive content.

9. The system of claim 1 , wherein the piece of content is one of a new piece of content and a third party piece of content.

10. A sense based interactive display device, comprising:

a user device having a display that displays a piece of interactive content to a user, the piece of interactive content having a plurality of items and a plurality of sense markers encoded in the content of the piece of interactive content, the sense markers including a touch sense marker indicating a piece of content within the interactive content having a touch sense interaction opportunity, a smell sense marker indicating a piece of content within the interactive content having a smell sense interaction opportunity, an auditory sense marker indicating a piece of content within the interactive content having an auditory sense interaction opportunity and a sight sense marker indicating a piece of content within the interactive content having a sight sense interaction opportunity, each sense marker being activated by a user interaction with each particular sense marker in the piece of interactive content;

a content encoder coupled to the user device that retrieves a piece of content and encodes the plurality of sense markers for the piece of content to generate the piece of interactive content, wherein the content encoder engine automatically maps a sense associated with one or more of a plurality of sense devices onto a scene of the interaction content based on an emotion using clustering;

the user device having a device that allows the user to interact with the particular sense marker selected from the plurality of sense markers encoded in the at least one piece of interactive content and to select a particular item of the plurality of items in the piece of interactive content; and

a sense interaction system coupled to the user device that, in response to the particular sense marker in the interactive content being activated, triggers a sense response that is interacted with by the user, wherein the sense response is two or more of a touch sense response, a smell sense response, an auditory sense response and a sight sense response.

11. The device of claim 10 , wherein the sense interaction system further comprises a smell sense device that emanates a signal that is synchronized to the smell sense marker in the interactive content so that the user interacts with the interactive content using the sense of smell.

12. The device of claim 10 , wherein the sense interaction system further comprises a touch sense device that generates a signal that is synchronized to the touch sense marker in the interactive content so that the user interacts with the interactive content using the sense of touch.

13. The device of claim 10 , wherein the sense interaction system is embedded into the user device.

14. The device of claim 10 , wherein the sense interaction system further comprises a touch sense device that is synchronized to the touch sense marker in the interactive content so that the user interacts with the interactive content using the sense of touch, a smell sense device that emanates a signal that is synchronized to the smell sense marker in the interactive content so that the user interacts with the interactive content using the sense of smell, an auditory sense device that emanates a signal that is synchronized to the auditory sense marker in the interactive content so that the user interacts with the piece of content using the sense of hearing and a sight sense device that emanates a signal that is synchronized to the sight sense marker in the interactive content so that the user interacts with the piece of content using the sense of sight, wherein each device has a separate housing and is coupled together.

15. The device of claim 14 , wherein each sense device generates a tuple that maps the sense associated with the sense device onto a scene of the interaction content and a duration of the sense response.

16. The device of claim 10 , wherein the sense interaction system automatically generates a sense marker in the piece of interaction content.

17. The device of claim 10 , wherein the piece of content is one of a new piece of content and a third party piece of content.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 30, 2023
From: Z5X GLOBAL FZ LLC
To: KOSHAYOJAN SERVICES LIMITED
Reel/Frame 064757/0797 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2018
From: TENNAKOON, CHAMLI; CHANDRA, SUBHASH; GOENKA, AMIT
To: Z5X GLOBAL FZ-LLC
Reel/Frame 047549/0479 →
Continuity (2)
Continuation 15629621 · Jun 21, 2017
Related Publication 20180373321A1 · Dec 27, 2018
Cited By (5)
US 1,109,856 US 12,197,636 US 12,212,821 US 12,279,025 US 12,387,913