IP Library Granted Patent US 11,776,445
Granted Patent B2
US 11,776,445 · App. 17/621,961 · Granted Oct 3, 2023

Image processing device and image processing method

Inventors: Toshiyuki Ogura (Tokyo, JP); Hiroaki Eto (Kanagawa, JP)
Assignee: Saturn Licensing LLC
G09G3/20G06T7/20G09G2340/0435
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,776,445
App. No.
17/621,961
Granted
Oct 3, 2023
Kind
B2
Abstract

It is intended to make it possible to make a favorable display of, for example, images of low frame-rate content, with a high-luminance and high-contrast television set. On the basis of an image stream having a first frame rate, for each frame, an object having luminance exceeding a luminance threshold value and/or a motion amount exceeding a motion-amount threshold value is detected as a target object. An image stream having a second frame rate larger than the first frame rate is acquired by inserting, between every pair of two consecutive frames in the image stream having the first frame rate, a predetermined number of frames of interpolated images obtained by performing motion compensation for causing the target object to sequentially move.

Claims (33)

1. An image processing device comprising:

a circuitry configured to

detect for each frame in an image having a first frame rate, a target object in accordance with its motion amount; and

obtain an image stream having a second frame rate larger than the first frame rate by inserting, between consecutive frames in the image stream having the first frame rate, a number of frames of interpolated images by performing motion compensation of the target object.

2. The image processing device according to claim 1 , wherein the circuitry is configured to detect target object having a motion amount exceeding a motion amount threshold value.

3. The image processing device according to claim 2 , wherein the motion amount threshold value includes a maximum value of an object motion amount at which judder is unnoticeable in the image stream having the first frame rate.

4. The image processing device according to claim 2 , wherein the motion-amount threshold value includes a variable that changes according to an environment.

5. The image processing device according to claim 1 , wherein the circuitry is configured to cause a movement amount of the target object in the number of interpolated images to be changed according to the motion amount of the target object.

6. The image processing device according to claim 1 , wherein the first frame rate is a frame rate of 24 Hz and wherein the second frame rate is a frame rate of 120 Hz.

7. The image processing device according to claim 1 , further comprising:

a display panel configured to display the image stream having the second frame rate.

8. The image processing device according to claim 7 , wherein the display panel includes a 4 K-size or 8 K-size display panel.

9. The image processing device according to claim 1 , wherein the circuitry is configured to obtain the image stream having the first frame rate by reception of a broadcasting signal, reproduction from a storage, or communication.

10. The image processing device according to claim 1 , wherein the circuitry is configured to detect the target object, in case the target object has a size exceeding a size threshold value.

11. An image processing method comprising:

detecting for each frame in an image stream having a first frame rate, a target object in accordance with its motion amount; and

obtaining an image stream having a second frame rate larger than the first frame rate by inserting, between consecutive frames in the image stream having the first frame rate, a number of frames of interpolated images by performing motion compensation of the target object.

12. An image processing method according to claim 11 , comprising detecting the target object having a motion amount exceeding a motion amount threshold value.

13. The image processing method according to claim 11 , comprising causing a movement amount of the target object in the number of interpolated images to be changed according to the motion amount of the target object.

14. An image processing device comprising:

circuitry configured to:

detect for each frame in an image stream having a first frame rate, a target object in accordance with its luminance; and

obtain an image stream having a second frame rate larger than the first frame rate by inserting, between consecutive frames in the image stream having the first frame rate, a number of frames of interpolated images by performing motion compensation of the target object.

15. The image processing device according to claim 14 , wherein the circuitry is configured to detect the target object having a luminance exceeding a luminance threshold value.

16. The image processing device according to claim 15 , wherein the luminance threshold value includes a maximum value of object luminance at which judder is unnoticeable in the image stream having the first frame rate.

17. The image processing device according to claim 15 , wherein the luminance threshold value includes a variable that changes according to an environment.

18. The image processing device according to claim 14 , wherein the first frame rate is a frame rate of 24 Hz and wherein the second frame rate is a frame rate of 120 Hz.

19. The image processing device according to claim 14 , further comprising:

a display panel configured to display the image stream having the second frame rate.

20. An image processing method comprising:

detecting for each frame in an image stream having a first frame rate, a target object in accordance with its luminance; and

obtaining an image stream having a second frame rate larger than the first frame rate by inserting, between consecutive frames in the image stream having the first frame rate, a number of frames of interpolated images by performing motion compensation of the target object.

21. An image processing method according to claim 20 , comprising detecting the target object having a luminance exceeding a luminance threshold value.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 23, 2023
From: SONY GROUP CORPORATION
To: SATURN LICENSING LLC
Reel/Frame 062451/0005 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2021
From: OGURA, TOSHIYUKI; ETO, HIROAKI
To: SONY GROUP CORPORATION
Reel/Frame 058470/0022 →
Priority Claims (1)
JP 2019-128042 · Jul 10, 2019 · national
Continuity (1)
Related Publication 20220254290A1 · Aug 11, 2022