IP Library Granted Patent US 9,967,536
Granted Patent B2
US 9,967,536 · App. 15/002,245 · Granted May 8, 2018

Video format determination device, video format determination method, and video display device

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,967,536
App. No.
15/002,245
Granted
May 8, 2018
Kind
B2
Abstract

There is provided a video format determination device including a video input unit that receives video having a feature amount for each pixel, a region representative value calculation unit that divides a left-eye video region and a right-eye video region in a three-dimensional video format to be determined in input video into small regions, and then computes representative values of feature amounts of the respective small regions for each of the left-eye video region and the right-eye video region, a correction value calculation unit that calculates a correction value to correct the representative values, a data correction unit that corrects the representative values, an inter-region correlation calculation unit that calculates the correlation between the left- and right-eye video regions, and an evaluation determination unit that evaluates the correlation to determine whether input video is in the three-dimensional video format.

Claims (48)

1. An apparatus included in a display device, the apparatus comprising:

a transmitter that transmits signals to shutter glasses; and

a video format determination device including processing circuitry configured to:

receive at least one video having a feature amount for each pixel;

divide a left-eye video region and a right-eye video region in a three-dimensional video format to be determined in input video into a plurality of blocks having M rows and N columns, respectively, and compute representative values of feature amounts of the respective plurality of blocks for each of the left-eye video region and the right-eye video region, both M and N being 2 or more;

calculate a correction value to correct the representative values based on an average value of the feature amounts of the left-eye video region and an average value of the feature amounts of the right-eye video region;

correct the representative values of the respective plurality of blocks computed for one of the left-eye video region and the right-eye video region using the correction value;

calculate a correlation between the left-eye video region and the right-eye video region by cumulatively adding differences of the representative values of the corresponding plurality of blocks in the left-eye video region and the right-eye video region;

calculate an intra-region correlation that is a correlation value within one of the left-eye video region and the right-eye video region or is an average of the correlation value in the left-eye video region and the correlation value in the right-eye video region; and

determine whether the input video is in the three-dimensional video format or in a two-dimensional video format based on a ratio between the correlation and the intra-region correlation.

2. The apparatus according to claim 1 , wherein the processing circuitry is configured to use, for each respective pixel, a luminance value of the pixel as the feature amount for the pixel.

3. The apparatus according to claim 1 , wherein the processing circuitry is configured to calculate the correlation between the left-eye video region and the right-eye video region based on the differences of the representative values of the corresponding plurality of blocks in the left-eye video region and the right-eye video region.

4. The apparatus according to claim 1 , wherein the processing circuitry is configured to calculate the correlation between the left-eye video region and the right-eye video region by performing cumulative weighted addition of the differences of the representative values of the corresponding plurality of blocks between the left-eye video region and the right-eye video region.

5. The apparatus according to claim 4 , wherein the processing circuitry is configured to perform the cumulative weighted addition using a weighting function that suppresses addition of a difference whose value is equal to or lower than a predetermined value.

6. The apparatus according to claim 1 , wherein the processing circuitry is further configured to

calculate an evaluation value based on the ratio between the correlation and the intra-region correlation, and

determine whether the input video is in the three-dimensional video format or in the two-dimensional video format based on the evaluation value.

7. The apparatus according to claim 6 , wherein the processing circuitry is configured to defer determination of a video format of the input video when the correlation within at least one region of the left-eye video region and the right-eye video region has a value equal to or lower than a predetermined threshold value.

8. The apparatus according to claim 1 , wherein the processing circuitry is further configured to

dispose the left-eye video region and the right-eye video region on the left and right of the input video, respectively, and

compute the representative values of the respective plurality of blocks in a determination mode to determine whether the input video is the three-dimensional video in a side-by-side format.

9. The apparatus according to claim 1 , wherein the processing circuitry is further configured to

dispose the left-eye video region and the right-eye video region on the top and bottom of the input video, respectively, and

compute the representative values of the respective plurality of blocks in a determination mode to determine whether the input video is the three-dimensional video in a top-and-bottom format.

10. The apparatus according to claim 1 , wherein

a plurality of determination modes in which a video format is determined with regard to each of a plurality of three-dimensional video formats is provided, and

the processing circuitry is configured to, when the input video is determined to not be a three-dimensional video in a certain determination mode, determine whether the input video is the three-dimensional video by switching to another determination mode.

11. The apparatus according to claim 1 , wherein the processing circuitry is configured to, during determination of a video format of a moving image, decide whether a determination state of the video format should be transitioned based on a determination result of the video format for a current frame, a determination state of the video format for the previous frame, and a time elapsed from a change in the determination result.

12. The apparatus according to claim 1 , wherein the processing circuitry is configured to set a threshold value to be used in determining an evaluation value according to a determination state of a video format.

13. A video format determination method, comprising:

receiving video having a feature amount for each pixel;

dividing a left-eye video region and a right-eye video region in a three-dimensional video format to be determined in input video into a plurality of blocks having M rows and N columns, respectively, and computing representative values of feature amounts of the respective plurality of blocks for each of the left-eye video region and the right-eye video region, both M and N being 2 or more;

calculating, by processing circuitry, a correction value to correct the representative values based on an average value of the feature amounts of the left-eye video region and an average value of the feature amounts of the right-eye video region;

correcting, by the processing circuitry, the representative values of the respective plurality of blocks computed for one of the left-eye video region and the right-eye video region using the correction value;

calculating, by the processing circuitry, a correlation between the left-eye video region and the right-eye video region by cumulatively adding differences of the representative values of the corresponding plurality of blocks in the left-eye video region and the right-eye video region;

calculating, by the processing circuitry, an intra-region correlation that is a correlation value within one of the left-eye video region and the right-eye video region or is an average of the correlation value in the left-eye video region and the correlation value in the right-eye video region; and

determining, by the processing circuitry, whether the input video is in the three-dimensional video format or in a two-dimensional video format based on a ratio between the correlation and the intra-region correlation.

14. A display device, comprising:

a display panel; and

video signal processing circuitry configured to:

receive at least one video signal;

divide a left-eye video region and a right-eye video region in a three-dimensional video format to be determined in the input video signal into plurality of blocks having M rows and N columns, respectively, and compute representative values of feature amounts of the respective plurality of blocks for each of the left-eye video region and the right-eye video region, both M and N being 2 or more;

calculate a correction value to correct the representative values based on an average value of the feature amounts of the left-eye video region and an average value of the feature amounts of the right-eye video region;

correct the representative values of the respective plurality of blocks computed for one of the left-eye video region and the right-eye video region using the correction value;

calculate a correlation between the left-eye video region and the right-eye video region by cumulatively adding differences of the representative values of the corresponding plurality of blocks in the left-eye video region and the right-eye video region;

calculate an intra-region correlation that is a correlation value within one of the left-eye video region and the right-eye video region or is an average of the correlation value in the left-eye video region and the correlation value in the right-eye video region;

generate an evaluation result, based on a ratio between the correlation and the intra-region correlation, that indicates whether the input video signal is in the three-dimensional video format or in a two-dimensional video format; and

process the input signal by switching display formats according to a format indicated in the evaluation result.

Assignments (1)
ASSIGNMENT OF THE ENTIRE INTEREST SUBJECT TO AN AGREEMENT RECITED IN THE DOCUMENT Recorded Jan 18, 2017
From: SONY CORPORATION
To: SATURN LICENSING LLC
Reel/Frame 041391/0037 →