Granted Patent B2

US 12,732,645 · App. 18/908,140 · Granted Sep 8, 2026

Inventors: Ruyi Zhang (Suwon-si, KR); Xue He (Suwon-si, KR); Peiwei Li (Suwon-si, KR)

Assignee: SAMSUNG ELECTRONICS CO., LTD.

H04N21/232H04N21/21815H04N21/236H04N21/2389H04N21/47202H04N21/2343H04N21/2393

Abstract

Claims (79)

1 . A multimedia on demand method comprising:

receiving, by a computational storage drive from a host, a first request for multimedia on demand;

in response to the first request, performing, by the computational storage drive, an on demand processing process for multimedia that corresponds to the first request to generate a corresponding on demand result, the on demand processing process comprising a flow control and at least one of a codec process or a multiplexing process for the multimedia; and

transmitting the on demand result to the host,

wherein the computational storage drive comprises a processor and an integrated circuit chip; and

wherein performing the on demand processing process comprises:

performing, by the processor, the flow control, the flow control comprising a codec control, and a request control that is performed based on the request control;

performing, by the integrated circuit chip, at least one of the codec process or the multiplexing process,

wherein the processor comprises a stream controller and a codec controller;

wherein the integrated circuit chip comprises a multiplexer and a codec;

wherein performing, by the processor, the flow control comprises:

performing, by the stream controller, the request control; and

performing, by the codec controller, the codec control;

wherein performing, by the stream controller, the request control comprises receiving the first request, and in response to the first request, performing:

in a case in which request content of the first request is to obtain source data, requesting the source data from a controller of the computational storage drive;

in a case in which encoding parameters of the source data do not satisfy a preset requirement of encoding parameters, instructing the codec controller by a transcoding request to control the codec to transcode the source data and use the transcoded source data as the on demand result;

in a case in which the encoding parameters of the source data satisfies the preset requirement of encoding parameters, instructing the codec controller by an encapsulation request to control the multiplexer to encapsulate the source data and use the encapsulated source data as the on demand result; and

in a case in which the request content of the first request is to change a resolution or to change an encapsulation format, instructing the codec controller by the encapsulation request to control the multiplexer to encapsulate corresponding multimedia data in accordance with the request content of the first request and use the encapsulated multimedia data as the on demand result; and

wherein performing, by the codec controller, the codec control comprises:

controlling an operation of the codec and the multiplexer based on the codec control; and

setting codec parameters of the codec based on the first request.

2 . The multimedia on demand method according to claim 1 , wherein performing, by the codec controller, the codec control further comprises:

performing memory management during the codec process; and

performing memory access management during data movement between the processor of the computational storage drive and the integrated circuit chip.

3 . The multimedia on demand method according to claim 1 , wherein performing, by the integrated circuit chip, the at least one of the codec process or the multiplexing process comprises at least one of:

performing, by the multiplexer, the multiplexing process; or

performing, by the codec, the codec process.

4 . The multimedia on demand method according to claim 1 , wherein receiving, by the computational storage drive from the host, the first request comprises:

receiving, by the computational storage drive from the host, the first request in a case in which multimedia cache data that corresponds to the first request is not looked up in the host.

5 . The multimedia on demand method according to claim 1 , wherein the computational storage drive includes a dynamic random access memory (DRAM), a flash memory, the controller, and processing circuitry including the processor and the integrated circuit chip, and

wherein the on demand processing process is performed by the processing circuitry.

6 . A multimedia on demand system comprising:

a host; and

a computational storage drive;

wherein the host transmits, to the computational storage drive, a first request for multimedia on demand;

wherein the computational storage drive, in response to the first request, performs an on demand processing process for multimedia that corresponds to the first request to generate a corresponding on demand result, the on demand processing process comprising a flow control and at least one of a codec process or a multiplexing process for the multimedia;

wherein the computational storage drive transmits the on demand result to the host; and

wherein the host receives the on demand result from the computational storage drive,

wherein the computational storage drive comprises a processor and an integrated circuit chip; and

wherein the processor performs the flow control, the flow control comprising a codec control, and a request control that is performed based on the request control; and

the integrated circuit chip performs at least one of the codec process or the multiplexing process, wherein the processor comprises a stream controller and a codec controller;

wherein the integrated circuit chip comprises a multiplexer and a codec;

wherein the stream controller performs the request control;

wherein the codec controller performs the codec control;

wherein the stream controller performs the request control to receive the first request, and in response to the first request, to perform:

in a case in which request content of the first request is to obtain source data, requesting the source data from a controller of the computational storage drive;

in a case in which encoding parameters of the source data do not satisfy a preset requirement of encoding parameters, instructing the codec controller by a transcoding request to control the codec to transcode the source data and use the transcoded source data as the on demand result;

in a case in which the encoding parameters of the source data satisfies the preset requirement of encoding parameters, instructing the codec controller by an encapsulation request to control the multiplexer to encapsulate the source data and use the encapsulated source data as the on demand result; and

in a case in which the request content of the first request is to change a resolution or to change an encapsulation format, instructing the codec controller by the encapsulation request to control the multiplexer to encapsulate corresponding multimedia data in accordance with the request content of the first request and use the encapsulated multimedia data as the on demand result; and

wherein the codec controller controls an operation of the codec and the multiplexer based on the codec control, and sets codec parameters of the codec based on the first request.

7 . The multimedia on demand system according to claim 6 , wherein the codec controller performs the codec control by:

performing memory management during the codec process; and

performing memory access management during data movement between the processor of the computational storage drive and the integrated circuit chip.

8 . The multimedia on demand system according to claim 6 , wherein the multiplexer performs the multiplexing process, or the codec performs the codec process.

9 . The multimedia on demand system according to claim 6 , wherein the host does not look up multimedia cache data for the multimedia before transmitting the first request to the computational storage drive.

10 . The multimedia on demand system according to claim 6 , wherein the computational storage drive includes a dynamic random access memory (DRAM), a flash memory, the controller, and processing circuitry including the processor and the integrated circuit chip, and

wherein the processing circuitry performs the on demand processing process.

11 . A computational storage drive comprising processing circuitry configured to:

receive, from a host, a first request for multimedia on demand;

in response to the first request, perform an on demand processing process for multimedia that corresponds to the first request to generate a corresponding on demand result, the on demand processing process comprising a flow control and at least one of a codec process or a multiplexing process for the multimedia; and

transmit the on demand result to the host,

wherein the processing circuitry comprises a processor and an integrated circuit chip; and

wherein the processor performs the flow control, the flow control comprising a codec control, and a request control that is performed based on the request control; and

the integrated circuit chip performs at least one of the codec process or the multiplexing process,

wherein the processor comprises a stream controller and a codec controller;

wherein the integrated circuit chip comprises a multiplexer and a codec;

wherein the stream controller performs the request control;

wherein the codec controller performs the codec control;

wherein the stream controller performs the request control to receive the first request, and in response to the first request, to perform:

in a case in which request content of the first request is to obtain source data, requesting the source data from a controller of the computational storage drive;

in a case in which encoding parameters of the source data do not satisfy a preset requirement of encoding parameters, instructing the codec controller by a transcoding request to control the codec to transcode the source data and use the transcoded source data as the on demand result;

in a case in which the encoding parameters of the source data satisfies the preset requirement of encoding parameters, instructing the codec controller by an encapsulation request to control the multiplexer to encapsulate the source data and use the encapsulated source data as the on demand result; and

in a case in which the request content of the first request is to change a resolution or to change an encapsulation format, instructing the codec controller by the encapsulation request to control the multiplexer to encapsulate corresponding multimedia data in accordance with the request content of the first request and use the encapsulated multimedia data as the on demand result; and

wherein the codec controller controls an operation of the codec and the multiplexer based on the codec control, and sets codec parameters of the codec based on the first request.

12 . The computational storage drive according to claim 11 , wherein the codec controller performs the codec control by:

performing memory management during the codec process; and

performing memory access management during data movement between the processor of the computational storage drive and the integrated circuit chip.

13 . The computational storage drive according to claim 11 , wherein the multiplexer performs the multiplexing process, or the codec performs the codec process.

14 . The computational storage drive according to claim 11 , wherein the computational storage drive includes a dynamic random access memory (DRAM), a flash memory, the controller, and the processing circuitry.

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (14)