IP Library Granted Patent US 8,532,170
Granted Patent B2
US 8,532,170 · App. 11/846,836 · Granted Sep 10, 2013

Enhanced presentation of sub-picture information

Inventors: Yong-Gab Park (Santa Clara, CA); John E. Crosbie (Fremont, CA); Shrikant Acharya (Fremont, CA)
Assignee: Harman International Industries, Incorporated
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,532,170
App. No.
11/846,836
Granted
Sep 10, 2013
Kind
B2
Abstract

A system is provided for processing video images for display. In one example, the system comprises a stream parser for retrieving a compressed main video data and a sub-picture identifier. A video decoder generates a main video image having a main video intensity value for each pixel in the main video. A sub-picture decoder determines a sub-picture image based on the sub-picture identifier. The sub-picture image includes a pixel data for each pixel in the sub-picture image indicative of a sub-picture pixel type including a background pixel type and a pattern pixel type. Each pixel includes a command code indicative of a background contrast level, a pattern contrast level, a background color level and a pattern color level. An intensity formatter generates a sub-picture pixel intensity for each pixel in the sub-picture image. A preprocessing function calculates, for each sub-picture pixel, a sub-picture pixel intensity by alpha-blending the sub-picture pixel with no main video pixel when the background color intensity is greater than the pattern color intensity. A filtering function performs anti-aliasing filtering on the sub-picture image. A sub-picture alpha-blending function combines the sub-picture image with the main video image using alpha-blending.

Claims (50)

1. A computer implemented system for processing video images for display comprising:

at least one processor in communication with an associated non-transitory computer readable memory of the computer-implemented system with the computer-implemented system further comprising:

a stream parser for retrieving a main video and a sub-picture identifier;

a video decoder to generate a main video image having a main video intensity value for each pixel in the main video;

a sub-picture decoder to determine a sub-picture image based on the sub-picture identifier, the sub-picture image having pixel data for each pixel in the sub-picture image, the pixel data being indicative of a sub-picture pixel type including at least a first pixel type and a second pixel type, each pixel further having a command code indicative of a pixel type contrast level corresponding to each pixel type and a pixel type color intensity corresponding to each pixel type;

an intensity formatter to generate a sub-picture pixel intensity for each pixel in the sub-picture image;

a preprocessing function to calculate, for each sub-picture pixel, an adjusted sub-picture intensity level by performing a set contrast command with no main video image data when the first pixel type color intensity is greater than the second pixel type color intensity

a filtering function to perform anti-aliasing filtering on the sub-picture image; and a sub-picture set contrast command function to combine the sub-picture image with the main video image.

2. The system of claim 1 where the first pixel type is a background pixel type and the second pixel type is a pixel type selected from the group consisting of a pattern pixel type, an emphasis 1 pixel type and an emphasis 2 pixel type.

3. The system of claim 2 where the pixel data are coded using Run-Length Coding (RLC) followed by a display control sequence table (DSCQT) containing the sub-picture command codes, and where the sub-picture decoder decodes the RLC coding to generate a stream of pixel data and a set of sub-picture control commands including the command codes.

4. The system of claim 3 where the command codes are arranged as two-byte values including a four-bit portion for the color command code and a four-bit portion for the contrast command code.

5. The system of claim 3 where the intensity formatter determines an intensity value for each sub-picture pixel using the pixel data is used to select one of the four-bit portions of the color command code to use in a intensity-color palette to retrieve an intensity-color value for each sub-picture pixel, the intensity-color value including the intensity value for the sub-picture pixel.

6. The system of claim 1 where the intensity formatter is a YUV formatter to format the sub-picture pixels to a YUV-based format including a YUV420 format.

7. The system of claim 1 where the preprocessing function determines a sub-picture intensity level with the low contrast level using the following:

sub-picture intensity level=sub-picture intensity*sub-picture ratio;

where, sub-picture ratio=k/16; and

k=contrast command code value when the contrast command code value is ‘0;’ and k=contrast command code value+1, when the contrast command code value is not ‘0.’

8. The system of claim 1 where the sub-picture alpha-blending function combines the sub-picture image with the main video image by calculating an alpha-blended intensity using the following:

alpha-blended pixel intensity=main picture intensity*main picture ratio+sub-picture intensity*sub-picture ratio;

where, main picture ratio=(16−k)/16 and sub-picture ratio=k/16; and

k=contrast command code value when the contrast command code value is ‘0;’ and k=contrast command code value+1, when the contrast command code value is not ‘0.’

9. A computer implemented method for processing a sub-picture image comprising:

providing a video images processing system having at least one processor in communication with an associated non-transitory computer readable memory, the video images processing system configured for:

generating a main video image;

decoding a selected sub-picture image having a pixel data and a sub-picture display control command for each sub-picture pixel, the pixel data being indicative of a sub-picture pixel type including a first pixel type, and a second pixel type;

generating a sub-picture intensity value for each pixel using the pixel data and the display control command;

for each sub-picture pixel, performing a preprocessing function including:

calculating a first pixel type color intensity using a first pixel type color code and a second pixel type color intensity using a second pixel type color code of the sub-picture pixel;

comparing the first pixel type color intensity with the second pixel type color intensity;

if the first pixel type color intensity is greater than the second pixel type color intensity, performing a set contrast function on the sub-picture image data with no main video image data;

anti-aliasing filtering each sub-picture pixel; and

combining the sub-picture image data with the main video image data using the set contrast command function.

10. The method of claim 9 further comprising:

decoding the sub-picture image by run-length decoding to generate the pixel data followed by a display control sequence table (DSCQT) containing the sub-picture display control command.

11. The method of claim 10 further comprising:

formatting the sub-picture display control command to include command codes arranged as two-byte values including a four-bit portion for the color command code and a four-bit portion for the contrast command code.

12. The method of claim 11 further comprising using the pixel data as a 2-bit code indicative of a selection of a background, a pattern, an emphasis1 and an emphasis2 pixel type for indexing into the two-byte command code values.

13. The method of claim 12 further comprising:

determining an intensity value for each sub-picture pixel using the pixel data to select one of the four-bit portions of the color command code;

using the selected four-bit portion in an intensity-color palette to retrieve an intensity-color value for each sub-picture pixel, the intensity-color value including the intensity value for the sub-picture pixel.

14. The method of claim 9 where step of generating a sub-picture intensity value for each pixel includes determining a YUV format including a YUV420 format.

15. The method of claim 9 where the step of performing the alpha-blending function on the sub-picture image includes determining the sub-picture intensity level using:

sub-picture intensity level=sub-picture intensity*sub-picture ratio;

where, sub-picture ratio=k/16; and

k=contrast command code value when the contrast command code value is ‘0;’ and k=contrast command code value+1, when the contrast command code value is not ‘0.’

16. The method of claim 9 where the step of combining the sub-picture image data with the main video image data using alpha-blending comprises:

combining the sub-picture image with the main video image by calculating an alpha-blended intensity using the following:

alpha-blended pixel intensity=main picture intensity*main picture ratio+sub-picture intensity*sub-picture ratio;

where, main picture ratio=(16−k)/16 and sub-picture ratio=k/16; and

k=contrast command code value when the contrast command code value is ‘0;’ and k=contrast command code value+1, when the contrast command code value is not ‘0.’

Assignments (5)
RELEASE Recorded Nov 14, 2012
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED; HARMAN BECKER AUTOMOTIVE SYSTEMS GMBH
Reel/Frame 029294/0254 →
SECURITY AGREEMENT Recorded Feb 17, 2011
From: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED; HARMAN BECKER AUTOMOTIVE SYSTEMS GMBH
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 025823/0354 →
RELEASE Recorded Feb 15, 2011
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED; HARMAN BECKER AUTOMOTIVE SYSTEMS GMBH
Reel/Frame 025795/0143 →
SECURITY AGREEMENT Recorded May 8, 2009
From: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED; BECKER SERVICE-UND VERWALTUNG GMBH; CROWN AUDIO, INC.; HARMAN BECKER AUTOMOTIVE SYSTEMS (MICHIGAN), INC.; HARMAN BECKER AUTOMOTIVE SYSTEMS HOLDING GMBH; HARMAN BECKER AUTOMOTIVE SYSTEMS, INC.; HARMAN CONSUMER GROUP, INC.; HARMAN DEUTSCHLAND GMBH; HARMAN FINANCIAL GROUP LLC; HARMAN HOLDING GMBH & CO. KG; HARMAN MUSIC GROUP, INCORPORATED; HARMAN SOFTWARE TECHNOLOGY INTERNATIONAL BETEILIGUNGS GMBH; HARMAN SOFTWARE TECHNOLOGY MANAGEMENT GMBH; HBAS INTERNATIONAL GMBH; HBAS MANUFACTURING, INC.; INNOVATIVE SYSTEMS GMBH NAVIGATION-MULTIMEDIA; JBL INCORPORATED; LEXICON, INCORPORATED; MARGI SYSTEMS, INC.; QNX SOFTWARE SYSTEMS (WAVEMAKERS), INC.; QNX SOFTWARE SYSTEMS CANADA CORPORATION; QNX SOFTWARE SYSTEMS CO.; QNX SOFTWARE SYSTEMS GMBH; QNX SOFTWARE SYSTEMS GMBH & CO. KG; QNX SOFTWARE SYSTEMS INTERNATIONAL CORPORATION; QNX SOFTWARE SYSTEMS, INC.; XS EMBEDDED GMBH (F/K/A HARMAN BECKER MEDIA DRIVE TECHNOLOGY GMBH)
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 022659/0743 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 13, 2007
From: PARK, YONG-GAB; CROSBIE, JOHN E.; ACHARYA, SHRIKANT
To: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
Reel/Frame 020108/0394 →
Continuity (1)
Related Publication 20090060026A1 · Mar 5, 2009