IP Library › Granted Patent US 12711633
Granted Patent B2
US 12711633 · App. 18/546,249 · Granted Aug 18, 2026

Image processing device, image processing method, projector device

Inventors: Atsuhiro Chiba (Tokyo, JP); Shogo Kubota (Kanagawa, JP); Mariko Nishiyama (Kanagawa, JP); Ryo Miyao (Kanagawa, JP); Tetsuo Ikeda (Tokyo, JP); Maho Hayashi (Tokyo, JP); Yuya Takayama (Tokyo, JP)
Assignee: Sony Group Corporation
G06T7/194G06T3/40G06V10/751G06V10/764G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12711633
App. No.
18/546,249
Granted
Aug 18, 2026
Kind
B2
Abstract

An image processing device according to the present technology includes: a foreground-background classification unit configured to classify an input image into a foreground image portion which is a portion in which a subject in a foreground is captured and a background image portion which is a portion in which a subject in a background farther than the foreground image portion is captured; a foreground correction unit configured to correct the foreground image portion; and an inconsistency correction unit configured to correct an inconsistent portion caused by the correction of the foreground image portion by the foreground correction unit.

Claims (48)

1 . An image processing device, comprising:

a foreground-background classification unit configured to classify an input image into a foreground image portion which is a portion in which a subject in a foreground is captured and a background image portion which is a portion in which a subject in a background farther than the foreground image portion is captured;

a foreground correction unit configured to correct the foreground image portion; and

an inconsistency correction unit configured to correct an inconsistent portion caused by the correction of the foreground image portion by the foreground correction unit.

2 . The image processing device according to claim 1 , wherein

the foreground-background classification unit is configured to:

classify the input image into the foreground image portion and the background image portion based on ranging information of the subject in the input image.

3 . The image processing device according to claim 2 , wherein

the foreground-background classification unit is configured to:

classify the input image into the foreground image portion and the background image portion based on a difference in distance between subjects in the input image.

4 . The image processing device according to claim 1 , wherein

the foreground-background classification unit is configured to:

classify the input image into the foreground image portion and the background image portion based on an image analysis result of the input image.

5 . The image processing device according to claim 4 , wherein

the foreground-background classification unit is configured to:

classify the input image into the foreground image portion and the background image portion based on a result of object recognition processing performed on the input image.

6 . The image processing device according to claim 5 , wherein

the foreground-background classification unit is configured to:

perform the object recognition processing using an image recognizer based on artificial intelligence.

7 . The image processing device according to claim 4 , wherein

the foreground-background classification unit is configured to:

perform image analysis based on template matching to classify the input image into the foreground image portion and the background image portion.

8 . The image processing device according to claim 1 , wherein

the foreground correction unit is configured to:

make at least a portion of the foreground image portion transparent or reduced in size as the correction of the foreground image portion.

9 . The image processing device according to claim 1 , wherein

the inconsistency correction unit is configured to:

perform correction using an image of an overlapping portion of the background image portion in a past frame overlapping a current inconsistent portion that is the inconsistent portion in a current frame as correction of the current inconsistent portion.

10 . The image processing device according to claim 9 , wherein

the inconsistency correction unit is configured to:

generate a last value holding image that is an image holding a pixel value when the input image is last classified into the background image portion in a period earlier than at least a current frame for each pixel of the input image and perform correction of the current inconsistent portion using the last value holding image.

11 . The image processing device according to claim 10 , wherein

the inconsistency correction unit is configured to:

generate the last value holding image by performing processing of holding a pixel value of a pixel classified into the background image portion and maintaining an existing holding value for a pixel classified into the foreground image portion over a plurality of frames of the input image.

12 . The image processing device according to claim 9 , wherein

the inconsistency correction unit is configured to:

interpolate pixel values using the image of the overlapping portion for portion of the current inconsistent portion where the overlapping portion is not present.

13 . The image processing device according to claim 1 , wherein

the foreground-background classification unit is configured to:

change a size of a distance range in which the input image is classified into the foreground image portion so as to have a negative correlation with a distance between a display surface on which the input image is displayed and a user viewing an image displayed on the display surface.

14 . The image processing device according to claim 1 , wherein

the foreground-background classification unit is configured to:

change a size of a distance range in which the input image is classified as the foreground image portion so as to have a positive correlation with a size of a display area of the input image.

15 . A projector device, comprising:

a foreground-background classification unit configured to classify an input image into a foreground image portion which is a portion in which a subject in a foreground is captured and a background image portion which is a portion in which a subject in a background farther than the foreground image portion is captured;

a foreground correction unit configured to correct the foreground image portion;

an inconsistency correction unit configured to correct an inconsistent portion caused by the correction of the foreground image portion by the foreground correction unit; and

a projection unit configured to generate a reproduction image based on an image of the inconsistent portion corrected by the inconsistency correction unit and project the reproduction image onto a projection surface.