IP Library Granted Patent US 9,307,223
Granted Patent B2
US 9,307,223 · App. 14/819,728 · Granted Apr 5, 2016

Method and system for mixing video and graphics

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,307,223
App. No.
14/819,728
Granted
Apr 5, 2016
Kind
B2
Abstract

A method and system are provided in which a video processor may select a 2D video output format or a 3D video output format. The video processor may generate composited video data by combining video data from a video source, and one or both of video data from additional video sources and graphics data from graphics source(s). The video processor may select the order in which such combination is to occur. The video data from the various video sources may comprise one or both of 2D video data and 3D video data. The graphics data from the graphics sources may comprise one or both of 2D graphics data and 3D graphics data. The video processor may perform 2D-to-3D and/or 3D-to-2D format conversion when appropriate to generate the composited video data in accordance with the selected output video format.

Claims (38)

1. A method, comprising:

selecting a video output format from a plurality of video formats;

selecting an order for windows of a video composition canvas corresponding to the selected video output format, the order of each window determining content overlap in a composited video data, the content overlap preventing display of at least a portion of the content;

mapping video data from a video source, and at least one of video data from additional video sources and graphics data from graphics sources to respective windows of the video composition canvas; and

generating the composited video data, by combining the windows of the video composition canvas based on the selected order, wherein the combination is based on a layout of the video composition canvas that corresponds to the selected video output format,

wherein the generating step includes converting a format of the content to an intermediate format different from the video output format prior to generating the composited video data, generating the composited video data in the intermediate format, and converting the composited video data to the selected output format.

2. The method of claim 1 , wherein the video data from the video source is formatted in at least one of the plurality of video formats.

3. The method of claim 1 , wherein the video data from the additional video sources is formatted in at least one of the plurality of video formats.

4. The method of claim 1 , wherein the graphics data from the graphics sources includes at least one of 2D graphics data and 3D graphics data.

5. The method of claim 1 , further comprising:

generating at least one of a high-definition multimedia interface (HDMI) signal including the composited video data and a National Television System Committee (NTSC) signal including the composited video data.

6. The method of claim 1 , further comprising:

converting a format of at least one of the video data from the video source, the video data from the additional video sources, and the graphics data from the graphics sources, wherein the format conversion is based on the selected video output format.

7. The method of claim 6 , wherein the format conversion is a 2D-to-3D format conversion that includes one of a conversion from 2D video data to 3D left-and-right (L/R) video data and a conversion from 2D graphics data to 3D L/R graphics data.

8. The method of claim 7 , wherein in the conversion from 2D video data to 3D left-and-right (L/R) video data, left video data and the right video data are in different frames of the video data.

9. The method of claim 6 , wherein the format conversion is a 2D-to-3D format conversion that includes one of a conversion from 2D video data to 3D over-and-under (O/U) video data and a conversion from 2D graphics data to 3D O/U graphics data.

10. The method of claim 6 , wherein the format conversion is a 3D-to-2D format conversion that includes one of a conversion from 3D video data to 2D video data and a conversion from 3D graphics data to 2D graphics data.

11. A system, comprising:

circuitry configured to

select a video output format from a plurality of video formats;

select an order for windows of a video composition canvas corresponding to the selected video output format, the order of each window determining content overlap in a composited video data, the content overlap preventing display of at least a portion of the content;

map video data from a video source, and at least one of video data from additional video sources and graphics data from graphics sources to respective windows of the video composition canvas; and

generate the composited video data, by combining the windows of the video composition canvas based on the selected order, wherein the combination is based on a layout of the video composition canvas that corresponds to the selected video output,

wherein the circuitry is further configured to convert a format of the content to an intermediate format different from the video output format prior to generating the composited video data, generate the composited video data in the intermediate format, and convert the composited video data to the selected output format.

12. The system of claim 11 , wherein the video data from the video source is formatted in at least one of the plurality of video formats.

13. The system of claim 11 , wherein the video data from the additional video sources is formatted in at least one of the plurality of video formats.

14. The system of claim 11 , wherein the graphics data from the graphics sources includes at least one of 2D graphics data and 36D graphics data.

15. The system of claim 11 , wherein the circuitry is further configured to generate at least one of a high-definition multimedia interface (HDMI) signal comprising the composited video data and a National Television System Committee (NTSC) signal comprising the composited video data.

16. The system of claim 11 , wherein the circuitry is further configured to convert a format of at least one of the video data from the video source, the video data from the additional video sources, and the graphics data from the graphics sources, wherein the format conversion is based on the selected video output format.

17. The system of claim 16 , wherein the format conversion is a 2D-to-3D format conversion that includes one of a conversion from 2D video data to 3D left-and-right (L/R) video data and a conversion from 2D graphics data to 3D L/R graphics data.

18. The system of claim 16 , wherein the format conversion is a 2D-to-3D format conversion that includes one of a conversion from 2D video data to 3D over-and-under (O/U) video data and a conversion from 2D graphics data to 3D O/U graphics data.

19. The system of claim 16 , wherein the format conversion is a 3D-to-2D format conversion that includes one of a conversion from 3D video data to 2D video data and a conversion from 36D graphics data to 2D graphics data.

20. A non-transitory computer readable medium having stored thereon a program that when executed by a computer causes the computer to execute a method comprising:

selecting a video output format from a plurality of video formats;

selecting an order for windows of a video composition canvas corresponding to the selected video output format, the order of each window determining content overlap in a composited video data, the content overlap preventing display of at least a portion of the content;

mapping video data from a video source, and at least one of video data from additional video sources and graphics data from graphics sources to respective windows of the video composition canvas; and

generating the composited video data, by combining the windows of the video composition canvas based on the selected order, wherein the combination is based on a layout of the video composition canvas that corresponds to the selected video output format,

wherein the generating step includes converting a format of the content to an intermediate format different from the video output format prior to generating the composited video data, generating the composited video data in the intermediate format, and converting the composited video data to the selected output format.

Assignments (6)
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENT NUMBER 9,385,856 TO 9,385,756 PREVIOUSLY RECORDED AT REEL: 47349 FRAME: 001. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER. Recorded Mar 22, 2019
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 051144/0648 →
CORRECTIVE ASSIGNMENT TO CORRECT THE EFFECTIVE DATE PREVIOUSLY RECORDED ON REEL 047229 FRAME 0408. ASSIGNOR(S) HEREBY CONFIRMS THE THE EFFECTIVE DATE IS 09/05/2018. Recorded Oct 29, 2018
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 047349/0001 →
MERGER Recorded Oct 4, 2018
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 047229/0408 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Feb 3, 2017
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: BROADCOM CORPORATION
Reel/Frame 041712/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2017
From: BROADCOM CORPORATION
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 041706/0001 →
PATENT SECURITY AGREEMENT Recorded Feb 11, 2016
From: BROADCOM CORPORATION
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 037806/0001 →