EXPERIENCE OR "SENTIO" CODECS, AND METHODS AND SYSTEMS FOR IMPROVING QoE AND ENCODING BASED ON QoE EXPERIENCES
Certain embodiments teach a variety of experience or “sentio” codecs, and methods and systems for enabling an experience platform, as well as a Quality of Experience (QoS) engine which allows the sentio codec to select a suitable encoding engine or device. The sentio codec is capable of encoding and transmitting data streams that correspond to participant experiences with a variety of different dimensions and features. As will be appreciated, the following description provides one paradigm for understanding the multi-dimensional experience available to the participants, and as implemented utilizing a sentio codec. There are many suitable ways of describing, characterizing and implementing the sentio codec and experience platform contemplated herein.
1 . A sentio codec for encoding and decoding a plurality of multi-dimensional data streams for a multi-dimensional experience, the sensio codec comprising:
a plurality of codecs suitable for encoding and decoding multi-dimensional experience data streams related to a multi-dimensional experience;
a QoE decision engine;
a network engine;
wherein the sentio codec implements a low-latency transfer protocol suitable for enabling a multi-dimensional experience.
2 . A sentio codec as recited in claim 1 , wherein the plurality of codecs includes an audio codec and a video codec.
3 . A sentio codec as recited in claim 2 , wherein the plurality of codecs further includes a gesture command codec.
4 . A sentio codec as recited in claim 2 , wherein the plurality of codecs further includes a sensor data codec.
5 . A sentio codec as recited in claim 2 , wherein the plurality of codecs further includes an emotion data codec.
6 . A sentio codec as recited in claim 1 , wherein the sentio codec takes available network bandwidth into account when encoding data streams.
7 . A sentio codec as recited in claim 1 , wherein the sentio codec takes a characteristic of an intended recipient device into account when encoding data streams.
8 . A sentio codec as recited in claim 1 , wherein the sentio codec takes into account a characteristic of a transmission device into account when encoding data streams.
9 . A sentio codec as recited in claim 1 , wherein the sentio codec takes into account a characteristic of a participant experience into account when encoding data streams.
10 . A computer implemented method for providing an experience using a low-latency protocol for encoding and transmitting experiences, the computer implemented method comprising:
receiving a plurality of data streams including video, audio, graphics, text, gestures and at least one emotion; and
encoding the plurality of data streams under control of a quality of experience engine and a hybrid network stack with network intelligence, the encoding providing a low latency transfer protocol adapted to convey the experience.
11 . A computer implemented method as recited in claim 10 , wherein the experience includes a plurality of layers, and the encoding generates the plurality of layers.
12 . A computer implemented method as recited in claim 10 , wherein the quality of experience engine affects the encoding by taking into consideration the nature and type of devices involved in providing the experience.
13 . A computer implemented method for encoding and transmitting experiences, the experiences including audio and video, the computer implement method characterized in that the experiences further include gestures and at least one emotion; and the method encodes and transmits the gestures and the at least one emotion.
14 . A computer implemented method as recited in claim 13 further comprising encoding and transmitting virtual goods as part of the experiences.
15 . A computer implemented method as recited in claim 13 , further characterized in that video data streams are analyzed by region, each region being encoded as either video, image, graphic or text data.
16 . A computer implemented method as recited in claim 13 , further characterized in that the encoding is accomplished according to a low-latency transfer protocol.
17 . A computer implemented method as recited in claim 16 , further characterized in that a network engine provides instructions on how to encode, the network engine utilizing network information including bandwidth, latency, and jitter.