IP Library Granted Patent US 10,491,911
Granted Patent B2
US 10,491,911 · App. 15/049,066 · Granted Nov 26, 2019

Transcoding on-the-fly (TOTF)

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,491,911
App. No.
15/049,066
Granted
Nov 26, 2019
Kind
B2
Abstract

Approaches for transcoding on-the-fly (TOTF). A digital video is encoded to produce a set of encoding decisions. A video quality profile is created that describes the set of encoding decisions. Upon determining that the video quality profile is associated with a compressed digital video bit stream, a final rate of compression is determined, frame by frame, for the compressed digital video bit stream using the video quality profile. The final rate of compression may be determined either internal or external to an encoder/transcoder. The video quality profile may be created by reviewing a plurality of encoding decisions to determine which encoding decisions merit inclusion based on a variety of criteria.

Claims (36)

1. One or more non-transitory computer-readable storage mediums storing one or more sequences of instructions for performing transcoding in real-time, which when executed by one or more processors, cause:

collecting pre-processing information on actual video quality achieved by an encoding/transcoding process performed on stored digital video prior to real-time encoding or transcoding of a compressed digital video bit stream by performing:

(a) encoding said stored digital video to produce a set of encoding decisions, and

(b) creating a video quality profile that identifies said set of encoding decisions made to achieve said actual video quality;

receiving a request to encode or transcode in real-time said compressed digital video bit stream;

after receiving said request; determining that said video quality profile is associated with said compressed digital video bit stream; and

after determining that said video quality profile is associated with said compressed digital video bit stream, encoding or transcoding in real-time said compressed digital video bit stream by determining a final rate of compression, frame by frame, for said compressed digital video bit stream using, at least a portion of, said set of encoding decisions for said stored digital video identified by said video quality profile.

2. The one or more non-transitory computer-readable storage mediums of claim 1 , wherein said compressed digital video bit stream is streamed to one or more users in said final rate of compression contemporaneous with determining said final rate of compression.

3. The one or more non-transitory computer-readable storage mediums of claim 1 , wherein said set of encoding decisions comprises evaluations of modes in a High Efficiency Video Coding (HEVC) codec.

4. The one or more non-transitory computer-readable storage mediums of claim 1 , wherein creating said video quality profile comprises reviewing a plurality of encoding decisions involved in encoding said digital video to determine which encoding decisions, in said plurality, merit inclusion in said set of encoding decisions based on storage costs associated therewith.

5. The one or more non-transitory computer-readable storage mediums of claim 1 , wherein creating said video quality profile comprises reviewing a plurality of encoding decisions involved in encoding said digital video to determine which encoding decisions, in said plurality, merit inclusion in said set of encoding decisions based on one or more of: storage costs associated therewith, network bandwidth, and quality of user experience.

6. The one or more non-transitory computer-readable storage of claim 1 , wherein said VQ profile is associated with a lower quality than a target video quality, and wherein determining a final rate of compression comprises:

transcoding said compressed digital video bit stream using said VQ profile that produce said final rate of compression, for a plurality of frames of said compressed digital video bit stream, at said target video quality.

7. The one or more non-transitory computer-readable storage of claim 1 , wherein said set of encoding decisions comprises at least one decision based on user-supplied data identifying a user's esthetic preference concerning the appearance of digital video.

8. The one or more non-transitory computer-readable storage of claim 1 , wherein said set of encoding decisions comprises at least one decision based on a set of characteristics or capabilities of a display device upon which said compressed digital video bit stream is to be delivered.

9. The one or more non-transitory computer-readable storage of claim 1 , wherein said encoding said digital video to produce said set of encoding decisions is performed in an offline environment.

10. The one or more non-transitory computer-readable storage mediums of claim 1 , wherein determining said final rate of compression is performed by an encoder or transcoder in the performance of internal encoding/transcoding decisions.

11. The one or more non-transitory computer-readable storage mediums of claim 1 , wherein determining said final rate of compression is performed external to, and separate from, an encoder or transcoder.

12. An apparatus for performing transcoding on-the-fly, comprising:

one or more processors; and

one or more non-transitory computer-readable storage mediums storing one or more sequences of instructions, which when executed, cause:

collecting pre-processing information on actual video quality achieved by an encoding/transcoding process performed on stored digital video prior to real-time encoding or transcoding of a compressed digital video bit stream by performing:

(a) encoding said stored digital video to produce a set of encoding decisions made to achieve said actual video quality, and

(b) creating a video quality profile that identifies said set of encoding decisions;

receiving a request to encode or transcode in real-time said compressed digital video bit stream;

after receiving said request determining that said video quality profile is associated with said compressed digital video bit stream; and

after determining that said video quality profile is associated with said compressed digital video bit stream, encoding or transcoding in real-time said compressed digital video bit stream by determining a final rate of compression, frame by frame, for said compressed digital video bit stream using, at least a portion of, said set of encoding decisions for said stored digital video identified by said video quality profile.

13. The apparatus of claim 12 , wherein said compressed digital video bit stream is streamed to one or more users in said final rate of compression contemporaneous with determining said final rate of compression.

14. The apparatus of claim 12 , wherein said set of encoding decisions comprises evaluations of modes in a High Efficiency Video Coding (HEVC) codec.

15. The apparatus of claim 12 , wherein creating said video quality profile comprises reviewing a plurality of encoding decisions involved in encoding said digital video to determine which encoding decisions, in said plurality, merit inclusion in said set of encoding decisions based on storage costs associated therewith.

16. The apparatus of claim 12 , wherein creating said video quality profile comprises reviewing a plurality of encoding decisions involved in encoding said digital video to determine which encoding decisions, in said plurality, merit inclusion in said set of encoding decisions based on one or more of: storage costs associated therewith, network bandwidth, and quality of user experience.

17. The apparatus of claim 12 , wherein said VQ profile is associated with a lower quality than a target video quality, and wherein determining a final rate of compression comprises:

transcoding said compressed digital video bit stream using said VQ profile that produce said final rate of compression, for a plurality of frames of said compressed digital video bit stream, at said target video quality.

18. The apparatus of claim 12 , wherein said set of encoding decisions comprises at least one decision based on user-supplied data identifying a user's esthetic preference concerning the appearance of digital video.

19. The apparatus of claim 12 , wherein said set of encoding decisions comprises at least one decision based on a set of characteristics or capabilities of a display device upon which said compressed digital video bit stream is to be delivered.

20. The apparatus of claim 12 , wherein said encoding said digital video to produce said set of encoding decisions is performed in an offline environment.

Assignments (6)
RELEASE OF SECURITY INTEREST Recorded Dec 21, 2023
From: JPMORGAN CHASE BANK, N.A.
To: HARMONIC INC.
Reel/Frame 065937/0327 →
SECURITY INTEREST Recorded Dec 21, 2023
From: HARMONIC INC.
To: CITIBANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 066090/0906 →
RELEASE OF SECURITY INTEREST Recorded Dec 21, 2023
From: JPMORGAN CHASE BANK, N.A.
To: HARMONIC INC.
Reel/Frame 066092/0633 →
SECURITY INTEREST Recorded Nov 10, 2020
From: HARMONIC INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 054327/0688 →
SECURITY INTEREST Recorded Dec 20, 2019
From: HARMONIC INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 051395/0836 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 9, 2016
From: KOREN, NOAM; ROSENBERG, JEREMY COLE; SAN MARTIN, MARCELO C.
To: HARMONIC, INC.
Reel/Frame 038515/0377 →