IP Library Granted Patent US 11,930,207
Granted Patent B2
US 11,930,207 · App. 17/267,869 · Granted Mar 12, 2024

Display device, signal processing device, and signal processing method

Inventor: Kunio Yoshida (Tokyo, JP)
Assignee: Saturn Licensing LLC
H04N19/577G09G5/393G09G2340/125G09G2340/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,930,207
App. No.
17/267,869
Granted
Mar 12, 2024
Kind
B2
Abstract

The present technology relates to a display device, a signal processing device, and a signal processing method which make it possible to realize interpolation more suitable for viewing when interpolating motion between original images. Provided is a display device which includes a signal processing unit that, when an interpolation frame is generated for original frames along a time axis, the interpolation frame interpolating between the original frames, controls an interpolation rate of the interpolation frame depending on motion between the original frames in a certain direction. The present technology can be applied, for example, to a television receiver.

Claims (66)

1. A display device comprising:

a signal processor configured to control, when an interpolation frame is generated for original frames along a time axis, the interpolation frame interpolating between the original frames, an interpolation rate of the interpolation frame depending on motion between the original frames in a certain direction.

2. The display device according to claim 1 ,

wherein the signal processor is configured to change an interpolation rate range that is a range in which the interpolation rate is changeable, depending on a type of content including the original frames.

3. The display device according to claim 1 ,

wherein the signal processor is configured to:

determine a target interpolation rate that is a target of the interpolation rate on a basis of a motion amount detected from the original frames by calculating a motion vector total sum in a specific direction on a basis of motion vectors obtained in each predetermined direction in an entire screen image corresponding to the original frames, and

determining the target interpolation rate depending on the motion vector total sum that has been calculated, and

control the interpolation rate on a basis of the target interpolation rate that has been determined.

4. The display device according to claim 1 ,

wherein the signal processor is configured to:

determine a target interpolation rate that is a target of the interpolation rate on a basis of a motion amount detected from the original frames by calculating, on a basis of motion vectors obtained in each predetermined direction in an entire screen image corresponding to the original frames, a motion vector total sum of an object in a specific direction in a predetermined area corresponding to the entire screen image, and

determining the target interpolation rate depending on the motion vector total sum of the object that has been calculated, and

control the interpolation rate on a basis of the target interpolation rate that has been determined.

5. The display device according to claim 1 ,

wherein the signal processor is configured to:

determine a target interpolation rate that is a target of the interpolation rate on a basis of a shake amount detected from the original frames, and

control the interpolation rate on a basis of the target interpolation rate that has been determined.

6. The display device according to claim 5 ,

wherein the signal processor is configured to:

calculate, on a basis of a motion vector amount obtained for each combination of predetermined diagonal directions in an entire screen image corresponding to the original frames, a shake amount that is a total sum of shakes in a combination of specific diagonal directions, and

determine the target interpolation rate depending on the shake amount that has been calculated.

7. The display device according to claim 5 ,

wherein the signal processor is configured to:

calculate, on a basis of a motion vector amount obtained for each combination of predetermined diagonal directions in an entire screen image corresponding to the original frames, a shake amount that is a total sum of shakes of an object in a combination of specific diagonal directions in a predetermined area corresponding to the entire screen image, and

determine the target interpolation rate depending on the shake amount of the object that has been calculated.

8. The display device according to claim 1 ,

wherein the interpolation rate includes a rate that indicates a degree of interpolation of the interpolation frame.

9. The display device according to claim 8 ,

wherein the interpolation rate has a relationship in which in a case where the interpolation rate is defined as 100% when one or a plurality of the interpolation frames is generated assuming that a positional change between the original frames has occurred in an even movement, and the interpolation rate is defined as 0% when the interpolation frames become identical with the original frames, the interpolation frames are further approximated to the original frames as the interpolation rate is lowered.

10. The display device according to claim 1 ,

wherein the signal processor comprises:

an interpolation rate control unit configured to control the interpolation rate; and

an interpolation unit configured to generate the interpolation frame using the interpolation rate and interpolates between the original frames.

11. The display device according to claim 1 ,

further comprising a display unit configured to display a video of content including the original frames.

12. A signal processing device comprising:

an interpolation rate control unit configured to control, when an interpolation frame is generated for original frames along a time axis, the interpolation frame interpolating between the original frames, an interpolation rate of the interpolation frame depending on motion between the original frames in a certain direction.

13. A signal processing method of a display device,

wherein when an interpolation frame is generated for original frames along a time axis, the interpolation frame interpolating between the original frames, the method comprises:

controlling an interpolation rate of the interpolation frame depending on motion between the original frames in a certain direction.

14. The signal processing method according to claim 13 ,

wherein when the interpolation frame is generated for the original frames along the time axis, the method comprises:

changing an interpolation rate range that is a range in which the interpolation rate is changeable, depending on a type of content including the original frames.

15. The signal processing method according to claim 13 ,

wherein when the interpolation frame is generated for the original frames along the time axis, the method comprises:

determining a target interpolation rate that is a target of the interpolation rate on a basis of a motion amount detected from the original frames by calculating a motion vector total sum in a specific direction on a basis of motion vectors obtained in each predetermined direction in an entire screen image corresponding to the original frames, and determining the target interpolation rate depending on the motion vector total sum that has been calculated, and

controlling the interpolation rate on a basis of the target interpolation rate that has been determined.

16. The signal processing method according to claim 13 ,

wherein when the interpolation frame is generated for the original frames along the time axis, the method comprises:

determining a target interpolation rate that is a target of the interpolation rate on a basis of a motion amount detected from the original frames by calculating, on a basis of motion vectors obtained in each predetermined direction in an entire screen image corresponding to the original frames, a motion vector total sum of an object in a specific direction in a predetermined area corresponding to the entire screen image, and determining the target interpolation rate depending on the motion vector total sum of the object that has been calculated, and

controlling the interpolation rate on a basis of the target interpolation rate that has been determined.

17. The signal processing method according to claim 13 ,

wherein when the interpolation frame is generated for the original frames along the time axis, the method comprises:

determining a target interpolation rate that is a target of the interpolation rate on a basis of a shake amount detected from the original frames, and

controlling the interpolation rate on a basis of the target interpolation rate that has been determined.

18. The signal processing method according to claim 17 ,

wherein when the interpolation frame is generated for the original frames along the time axis, the method comprises:

calculating, on a basis of a motion vector amount obtained for each combination of predetermined diagonal directions in an entire screen image corresponding to the original frames, a shake amount that is a total sum of shakes in a combination of specific diagonal directions, and

determining the target interpolation rate depending on the shake amount that has been calculated.

19. The signal processing method according to claim 17 ,

wherein when the interpolation frame is generated for the original frames along the time axis, the method comprises:

calculating, on a basis of a motion vector amount obtained for each combination of predetermined diagonal directions in an entire screen image corresponding to the original frames, a shake amount that is a total sum of shakes of an object in a combination of specific diagonal directions in a predetermined area corresponding to the entire screen image, and

determining the target interpolation rate depending on the shake amount of the object that has been calculated.

20. The signal processing method according to claim 13 ,

wherein the interpolation rate includes a rate that indicates a degree of interpolation of the interpolation frame.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 5, 2022
From: SONY GROUP CORPORATION
To: SATURN LICENSING LLC
Reel/Frame 058558/0747 →
CHANGE OF NAME Recorded Dec 21, 2021
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 058553/0161 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2021
From: YOSHIDA, KUNIO
To: SONY CORPORATION
Reel/Frame 055241/0291 →
Priority Claims (1)
JP 2018-155482 · Aug 22, 2018 · national
Continuity (1)
Related Publication 20210176488A1 · Jun 10, 2021