IP Library Granted Patent US 9,218,644
Granted Patent B2
US 9,218,644 · App. 12/689,356 · Granted Dec 22, 2015

Method and system for enhanced 2D video display based on 3D video input

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,218,644
App. No.
12/689,356
Granted
Dec 22, 2015
Kind
B2
Abstract

A video processing device may generate a two dimensional (2D) output video stream from a three dimensional (3D) input video stream that comprises a plurality of view sequences. The plurality of view sequences may comprise sequences of stereoscopic left and right reference fields or frames. A view sequence may initially be selected as a base sequence for the 2D output video stream, and the 2D output video stream may be enhanced using video content and/or information from unselected view sequences. The video content and/or information utilized in enhancing the 2D output video stream may comprise depth information, and/or foreground and/or background information. The enhancement of the 2D input video stream may comprise improving depth, contrast, sharpness, and/or rate upconversion using frame and/or field based interpolation of images in the 2D output video stream.

Claims (41)

1. A method for image processing, the method comprising:

performing by one or more processors, one or more circuits, or any combination thereof in an image processing system:

extracting a plurality of view sequences from a three-dimension (3D) input image stream, the plurality of view sequences comprising a left view sequence and a right view sequence; and

generating a two dimensional (2D) output image stream based on a base sequence of said plurality of extracted view sequences, wherein image data for said 2D output image stream is generated utilizing view information derived from said base sequence and at least one other sequence of said plurality of extracted view sequences, where said base sequence corresponds to one of said left view sequence or said right view sequence and said at least one other sequence comprises the other of said left view sequence or said right view sequence, such that:

when said base sequence corresponds to said left view sequence, said at least one other sequence comprises said right view sequence; and

when said base sequence corresponds to said right view sequence, said at least one other sequence comprises said left view sequence

wherein generating said 2D output image stream comprises:

selecting one of said left view sequence or said right view sequence as the base sequence for generating said 2D image stream; and

enhancing at least one of a contrast or a sharpness of said one of said left view sequence or said right view sequence selected as said base sequence using the other of said left view sequence or said right view sequence not selected as said base view sequence.

2. The method according to claim 1 , wherein said plurality of extracted view sequences comprises sequences of stereoscopic left and right reference fields or frames.

3. The method according to claim 1 , wherein said view information utilized during said generation of said image data for said 2D output image stream comprises foreground information, background information, or both.

4. The method according to claim 1 , comprising classifying regions of frames of said plurality of extracted view sequences as a foreground region or a background region based at least in part upon said view information.

5. The method according to claim 4 , comprising modifying images in said generated 2D output image stream based at least in part upon said region classifications.

6. The method according to claim 5 , wherein said modification enhances contrast, sharpness, or both of said images in said 2D output image stream.

7. The method according to claim 1 , comprising performing frame rate upconversion operations on said 2D output image stream using frame or field interpolation based upon the view information derived from said base sequence and said at least one other sequence.

8. The method according to claim 7 , comprising modifying said interpolation based on the view information derived from said at least one other sequence of said plurality of extracted view sequences.

9. The method according to claim 1 , comprising locally performing graphic processing corresponding to include a graphic object in a plurality of images of said 2D output image stream.

10. The method according to claim 9 , comprising wherein locally performing said local graphics processing comprises splicing said graphic object into said plurality of images based on one or more points of focus within each image in said 2D output image stream of said plurality of images.

11. A system for image processing, the system comprising:

one or more circuits, one or more processors, or any combination thereof that are operable to extract a plurality of view sequences from a compressed three-dimension (3D) input image stream; and

said one or more circuits, one or more processors, or combination thereof are operable to generate a two dimensional (2D) output image stream based on a base sequence corresponding to one of a left view sequence or a right view sequence of said plurality of extracted view sequences, wherein image data for said 2D output image stream is generated utilizing view information derived from said base sequence and at least one other sequence corresponding to the other of said left view sequence or said right view sequence of said plurality of extracted view sequences, such that:

when said base sequence corresponds to said left view sequence, said at least one other sequence corresponds to said right view sequence; and

when said base sequence corresponds to said right view sequence, said at least one other sequence corresponds to said left view sequence;

wherein said one or more circuits, one or more processors, or combination thereof are operable to generate said 2D output image stream by:

selecting one of said left view sequence or said right view sequence as the base sequence for generating said 2D image stream; and

enhancing at least one of a contrast or a sharpness of said one of said left view sequence or said right view sequence selected as said base sequence using the other of said left view sequence or said right view sequence not selected as said base view sequence.

12. The system according to claim 11 , wherein said plurality of extracted view sequences comprises sequences of stereoscopic left and right reference fields or frames.

13. The system according to claim 11 , wherein said view information utilized during said generation of said image data for said 2D output image stream comprises foreground information, background information, or both.

14. The system according to claim 11 , wherein said one or more circuits, one or more processors, or combination thereof are operable to classify regions of frames of said plurality of extracted view sequences as a foreground region or a background region based at least in part on said view information.

15. The system according to claim 14 , wherein said one or more circuits, one or more processors, or combination thereof are operable to modify said base sequence for said generated 2D output image stream based at least in part on said region classifications.

16. The system according to claim 15 , wherein modifying said base sequence based at least in part on said region classifications enhances contrast, sharpness, or both of images in said 2D output image stream.

17. The system according to claim 11 , wherein said one or more circuits, one or more processors, or combination thereof are operable to perform frame rate upconversion operations on said 2D output image stream using frame or field interpolation based upon view information derived from said base sequence and said at least one other sequence.

18. The system according to claim 17 , wherein said one or more circuits, one or more processors, or combination thereof are operable to modify said interpolation based on view information derived from said at least one other sequence of said plurality of extracted view sequences.

19. The system according to claim 11 , wherein said one or more circuits, one or more processors, or combination thereof are operable to locally perform graphic processing corresponding to include a graphic object in a plurality of images of said 2D output image stream.

20. The system according to claim 19 , wherein said one or more circuits, one or more processors, or combination thereof are operable to perform said local graphics processing based on one or more points of focus within each image said plurality of images in said 2D output image stream.

21. A method for video processing, the method comprising: performing by one or more processors, one or more circuits, or any combination thereof in a video processing system:

extracting a plurality of view sequences from a compressed three-dimension (3D) input video stream, the plurality of view sequences comprising a left view sequence and a right view sequence;

generating a two dimensional (2D) output video stream based on a first view content derived from one of said left view sequence or said right view sequence;

enhancing at least one of a contrast or a sharpness of the 2D output video by utilizing a second view content derived from the other of said left view sequence or said right view sequence, such that:

when said first view content is derived from said left view sequence, said second view content is derived from said right view sequence; and

when said first view content is derived from said right view sequence, said second view content is derived from said left view sequence.

Assignments (6)
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENT NUMBER 9,385,856 TO 9,385,756 PREVIOUSLY RECORDED AT REEL: 47349 FRAME: 001. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER. Recorded Mar 22, 2019
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 051144/0648 →
CORRECTIVE ASSIGNMENT TO CORRECT THE EFFECTIVE DATE PREVIOUSLY RECORDED ON REEL 047229 FRAME 0408. ASSIGNOR(S) HEREBY CONFIRMS THE THE EFFECTIVE DATE IS 09/05/2018. Recorded Oct 29, 2018
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 047349/0001 →
MERGER Recorded Oct 4, 2018
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 047229/0408 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Feb 3, 2017
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: BROADCOM CORPORATION
Reel/Frame 041712/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2017
From: BROADCOM CORPORATION
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 041706/0001 →
PATENT SECURITY AGREEMENT Recorded Feb 11, 2016
From: BROADCOM CORPORATION
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 037806/0001 →