Electrical devices control based on media-content context

1. A metadata server, comprising:

circuitry configured to:

receive a first segment from a plurality of segments of first media content;

determine first context information and second context information associated with the first segment of the first media content based on a plurality of characteristics of at least one frame of a plurality of frames in the first segment;

generate first metadata associated with the first segment based on the determined first context information and the second context information, wherein

the first metadata includes a first sub-metadata and a second sub-metadata,

the first sub-metadata includes first timing information corresponding to the first context information,

the second sub-metadata includes second timing information corresponding to the second context information,

the first context information is different from the second context information,

the first timing information indicates a first time at which a first electrical device is controllable by a media device during playback of the first segment of the first media content by the media device, and

the second timing information indicates a second time at which a second electrical device, different from the first electrical device, is controllable by the media device during the playback of the first segment of the first media content by the media device; and

transmit the received first segment of the first media content and the generated first metadata to the media device.

2. The metadata server according to claim 1 , wherein the circuitry is further configured to:

transmit, to a media server, a first request which includes identification information of the first media content;

receive, from the media server, the first media content including the first segment, based on the first request;

generate the first metadata associated with the first segment based on the received first media content; and

transmit the received first segment of the first media content and the generated first metadata to the media device.

3. The metadata server according to claim 1 , wherein the circuitry is further configured to apply at least one machine learning model on the plurality of characteristics of the at least one frame of the plurality of frames in the first segment to determine the first context information and the second context information associated with the first segment.

4. The metadata server according to claim 1 , wherein the circuitry is further configured to:

retrieve the plurality of segments of the first media content;

generate a plurality of metadata based on the first context information associated with a corresponding segment of the plurality of segments, wherein each of the plurality of metadata is associated with the corresponding segment of the plurality of segments; and

generate second media content from the first media content based on the generated plurality of metadata.

5. The metadata server according to claim 4 , wherein

the circuitry is further configured to generate a plurality of versions of the second media content,

each version of the plurality of versions corresponds to a specific version of metadata, and

the specific version of the metadata is selectable based on usage of electrical devices controllable at a user premises.

6. The metadata server according to claim 1 , wherein

the first media content corresponds to audio content, and

the first context information of the audio content comprises at least one of a song, a musical tone, a monologue, a dialogue, a laughter sound, a distress sound, a pleasant sound, an unpleasant sound, an ambient noise, a background sound, a loud sound, or defined sound pattern associated with a real-time object.

7. The metadata server according to claim 1 , wherein

the first media content corresponds to video content or audio-video (AV) content, and

the first context information of the video content or the AV content comprises at least one of an action scene, a comedy scene, a romantic scene, a suspense scene, a horror scene, a drama scene, a poetry scene, a party scene, or a dance scene.

8. The metadata server according to claim 1 , wherein

the first media content corresponds to audio content, and

the plurality of characteristics of the at least one frame in the first segment of the audio content comprises at least one of a loudness parameter, a pitch parameter, a tone parameter, a rate-of-speech parameter, a voice quality parameter, a phonetic parameter, an intonation parameter, an intensity of overtones, a voice modulation parameter, a pronunciation parameter, a prosody parameter, a timbre parameter, or at least one psychoacoustic parameter.

9. The metadata server according to claim 1 , wherein

the first media content corresponds to video content or audio-video (AV) content, and

the plurality of characteristics of the at least one frame in the first segment of the video content or the AV content corresponds to at least one of an object recognized in the at least one frame, a person recognized in the at least one frame, an emotional state of at least one object in the at least one frame, background information of the at least one frame, an ambient lighting condition in the at least one frame, motion information of the at least one object in the at least one frame, a gesture associated with the at least one object in the at least one frame, or genre information associated with the at least one frame.

10. The metadata server according to claim 1 , wherein the circuitry is further configured to:

identify a type of the first segment of the first media content, wherein the type of the first segment comprises one of an audio type segment, an audio-video (AV) type segment, or a gaming type segment; and

generate the first metadata associated with the first segment based on the identified type of the first segment.

11. The metadata server according to claim 1 , wherein each of the first electrical device and the second electrical device comprises at least one of an aroma dispenser, an electrical furniture, a lighting device, a sound reproduction device, an electrical curtain, an electrical toy, an electrical wind-chime, an electrical vase, a digital photo-frame, or an internet of things (IOT) device.

12. The metadata server according to claim 1 , wherein the circuitry is further configured to:

recognize a profession of each of one or more persons in the at least one frame based on stored profile information of the one or more persons; and

determine one of the first context information or the second context information based on an action performed by the recognized profession of the one or more persons.

13. A media device, comprising:

circuitry configured to:

transmit identification information of first media content to a metadata server;

receive, from the metadata server, second media content which includes the first media content and a plurality of metadata, wherein

at least one metadata of the plurality of metadata includes a first sub-metadata and a second sub-metadata,

the first sub-metadata includes first timing information corresponding to first context information,

the second sub-metadata includes second timing information corresponding to second context information, and

the first context information is different from the second context information;

control, at a first time, a first electrical device in synchronization with playback of the first media content based on the first timing information; and

control, at a second time, a second electrical device in synchronization with the playback of the first media content based on the second timing information.

14. The media device according to claim 13 , wherein the circuitry is further configured to control the first electrical device and the second electrical device, via a controller device which is communicatively coupled to the media device and each of the first electrical device and the second electrical device.

15. The media device according to claim 13 , wherein

the circuitry is further configured to receive subscription information from each of the first electrical device and the second electrical device, and

the subscription information indicates a subscription between a corresponding electrical device of the first electrical device and the second electrical device with one of the first context information and the second context information included in a corresponding metadata of the plurality of metadata received from the metadata server.

16. The media device according to claim 15 , wherein the circuitry is further configured to control the first electrical device and the second electrical device based on the at least one metadata and the subscription information associated with each of the first electrical device and the second electrical device.

17. The media device according to claim 13 , further comprising an image capturing device,

wherein the circuitry is further configured to:

control the image capturing device to capture at least one image of at least one viewer, in a field-of-view of the image capturing device, based on the control of the first electrical device and the second electrical device in synchronization with the playback of the first media content;

determine an emotional state of the at least one viewer from the captured at least one image; and

update the plurality of metadata based on the determined emotional state.

18. The media device according to claim 13 , wherein each of the first electrical device and the second electrical device comprises at least one of an aroma dispenser, an electrical furniture, a lighting device, a sound reproduction device, an electrical curtain, an electrical toy, an electrical wind-chime, an electrical vase, a digital photo-frame, or an internet of things (IOT) device.

19. A method, comprising:

in a metadata server:

receiving a first segment from a plurality of segments of first media content;

determining first context information and second context information associated with the first segment of the first media content based on a plurality of characteristics of at least one frame of a plurality of frames in the first segment;

generating first metadata associated with the first segment based on the determined first context information and the second context information, wherein

the first metadata includes a first sub-metadata and a second sub-metadata,

the first sub-metadata includes first timing information corresponding to the first context information,

the second sub-metadata includes second timing information corresponding to the second context information,

the first context information is different from the second context information,

the first timing information indicates a first time at which a first electrical device is controllable by a media device during playback of the first segment of the first media content by the media device, and

the second timing information indicates a second time at which a second electrical device, different from the first electrical device, is controllable by the media device during the playback of the first segment of the first media content by the media device; and

transmitting the received first segment of the first media content and the generated first metadata to the media device.

20. A method, comprising:

in a media device:

transmitting identification information of first media content to a metadata server;

receiving, from the metadata server, second media content which includes the first media content and a plurality of metadata, wherein

at least one metadata of the plurality of metadata includes a first sub-metadata and a second sub-metadata,

the first sub-metadata includes first timing information corresponding to first context information,

the second sub-metadata includes second timing information corresponding to second context information, and

the first context information is different from the second context information;

controlling, at a first time, a first electrical device in synchronization with playback of the first media content based on the first timing information; and

controlling, at a second time, a second electrical device in synchronization with the playback of the first media content based on the second timing information.