IP Library Granted Patent US 9,473,813
Granted Patent B2
US 9,473,813 · App. 12/717,168 · Granted Oct 18, 2016

System and method for providing immersive surround environment for enhanced content experience

Inventors: Puneet Gupta (Karnataka, IN); Akshay Darbari (Karnataka, IN)
Assignee: Infosys Limited
H04N21/44008H04N21/4131H04N21/431H04N21/436H04N21/4394G06F17/3074G06F17/30743H03G3/32
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,473,813
App. No.
12/717,168
Granted
Oct 18, 2016
Kind
B2
Abstract

A method and system for providing an immersive surround environment for enhanced content experience is provided. The method includes receiving an encoded media stream and processing the stream to obtain decoded media data. The received media stream can also be captured real-time media. The method further includes extracting one or more environmental parameters from the stream. The environmental parameters are then embedded or encoded. Thereafter, the method includes providing the one or more environmental parameters to one or more devices that control environmental conditions to produce environmental effects.

Claims (35)

1. A system for providing an immersive surround environment for enhanced content experience, the system comprising:

a decoder configured to receive an encoded media stream, the encoded media stream comprising different types of media data, environmental parameters associated with the different types of media data, frame synchronization information and stream elements information, and further configured to decompress and decode the media stream;

a content analyzer configured to analyze the decoded media stream and further configured to extract the environmental parameters corresponding to the different types of media data in the decoded media stream;

a stream and environmental parameter synchronization module configured to identify one or more additional environmental parameters based on the extracted environmental parameters and further configured to simulate the identified additional environmental parameters for the different types of media data;

an environmental effect encoder configured to encode the extracted environmental parameters and the simulated environmental parameters corresponding to the different types of media data and further configured to synchronize the environmental parameters with the frame synchronization information and the stream elements information corresponding to the encoded media stream to generate encoded environmental parameters; and

an encoded stream playback system configured to decode the encoded media stream and the encoded environmental parameters, wherein the encoded stream playback system is further configured to provide media output to an audio/visual equipment for playback and to provide the decoded environmental parameters to one or more output devices for simulating environmental effects in conjunction with the media output.

2. The system of claim 1 , wherein the encoded stream playback system comprises:

a standard player/decoder configured to decode the encoded stream and provide the media output to the audio/visual equipment; and

an environmental effect playback system configured to provide the decoded environmental parameters to the one or more output devices for simulating the environmental effects.

3. The system of claim 1 , wherein the encoded media stream is encoded in accordance with standard file formats, the standard file formats comprise: MPEG-2, MPEG-4, AVS, VC-1, Dirac, H.264, AAC, AC3, G.711, G.723, MP3, JPEG, JPEG 2000, BMP, GIF, TIFF, WAV, MPEG, AC3, AAC, WMA, AVI, 3GP, WMV, DivX, AVCHD and PNG.

4. The system of claim 1 , wherein the environmental parameters are at least one of temperature, ambient light, humidity and wind velocity.

5. The system of claim 4 , wherein the environmental parameters are extracted from color layout, structure, shape, region, texture, location, face, motion of image/video stream and/or pitch, harmony, tempo, rhythm, loudness, lyrics analyzer for audio speech stream and all for audio-video stream.

6. The system of claim 1 , wherein the different types of media data comprise an image stream, an audio stream, a speech stream, a video stream and an audio-video stream.

7. The system of claim 1 , wherein the encoded media stream includes media stream captured at real-time.

8. A method for providing an immersive surround environment for enhanced content experience, the method comprising:

receiving an encoded media stream, the encoded media stream comprising different types of media data, environmental parameters associated with the different types of media data, frame synchronization information, stream elements information, and processing the encoded media stream to obtain the decoded media data;

extracting the one or more environmental parameters corresponding to the different types of media data from the decoded media data;

identifying one or more additional environmental parameters based on the extracted environmental parameters;

simulating the identified additional environmental parameters for the different types of media data;

encoding the extracted one or more environmental parameters and the simulated at least one of the environmental parameters;

synchronizing the encoded one or more environmental parameters with the frame synchronization information and the stream elements information corresponding to the encoded media stream to output an encoded environmental parameter stream;

decoding the encoded media stream to obtain media output;

decoding the encoded environmental parameter stream to obtain one or more environmental parameters; and

providing the one or more environmental parameters to one or more devices that control environmental conditions to simulate environmental effects in conjunction with the media output.

9. The method of claim 8 , wherein the step of encoding the one or more environmental parameters comprises encoding the one or more environmental parameters at various levels within the encoded stream.

10. The method of claim 9 , wherein the various levels comprise at least one of: stream, group of pictures, frame, slice, macroblock and block.

11. The method of claim 8 , wherein the step of encoding the one or more environmental parameters to output the encoded environmental parameter stream comprises the steps of:

replicating encoded media stream structure by retaining header information of the encoded media stream; and

mapping the one or more environmental parameters to one or more specific identifiers of the encoded media stream.

12. The method of claim 8 , further comprising:

receiving an environmental parameter stream comprising the one or more environmental parameters;

replicating an encoded media stream by retaining header information of the encoded media stream;

incorporating placeholders corresponding to at least one of image streams, audio/speech streams, audio streams and audio-video file formats;

mapping the one or more environmental parameters to one or more specific identifiers of the replicated encoded media stream.

13. The method of claim 8 , wherein the encoded media stream includes media stream captured at real-time.

Assignments (2)
CHANGE OF NAME Recorded Mar 22, 2013
From: INFOSYS TECHNOLOGIES LIMITED
To: INFOSYS LIMITED
Reel/Frame 030069/0879 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 12, 2010
From: GUPTA, PUNEET; DARBARI, AKSHAY
To: INFOSYS TECHNOLOGIES LIMITED
Reel/Frame 024371/0322 →
Priority Claims (1)
IN 3251/CHE/2009 · Dec 31, 2009 · national
Continuity (1)
Related Publication 20110160882A1 · Jun 30, 2011