IP Library Granted Patent US 10,169,916
Granted Patent B2
US 10,169,916 · App. 14/893,036 · Granted Jan 1, 2019

Image processing device and image processing method

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,169,916
App. No.
14/893,036
Granted
Jan 1, 2019
Kind
B2
Abstract

There is provided an image processing device including: a setting unit configured to set a filter intensity based on a degree of how exactly an imaging device that produces a captured image containing a marker related to display of a virtual object faces the marker, the degree being detected based on the captured image; and an image processing unit configured to combine the virtual object corresponding to the marker with the captured image by using a filter having the set filter intensity.

Claims (58)

1. An image processing device, comprising:

circuitry configured to:

determine first coordinates of corners corresponding to a marker in a captured image;

determine a criteria score, based on the first coordinates of the corners and a criteria corresponding to a shape of the marker,

wherein the criteria score indicates a degree corresponding to a relative location relationship between an imaging device and the marker;

set a filter intensity corresponding to the determined criteria score;

correct a location of the marker based on a filter having the set filter intensity; and

combine a virtual object corresponding to the marker with the captured image at the corrected location based on the filter having the set filter intensity.

2. The image processing device according to claim 1 , wherein the criteria score approaches zero based on an increase in the degree.

3. The image processing device according to claim 1 , wherein the circuitry is further configured to set the filter intensity corresponding to the determined criteria score based on filter intensity setting information, and wherein the filter intensity setting information includes the criteria score and a value that determines the filter intensity.

4. The image processing device according to claim 3 ,

wherein the filter intensity setting information is set for one of each marker of a plurality of markers or each virtual object of a plurality of virtual objects corresponding to the plurality of markers and

wherein the circuitry is further configured to set the filter intensity based on the filter intensity setting information set for one of the marker or the virtual object corresponding to the marker.

5. The image processing device according to claim 3 ,

wherein a plurality of pieces of the filter intensity setting information are set, and

wherein the circuitry is further configured to:

select the filter intensity setting information corresponding to the relative location relationship between the marker and the virtual object corresponding to the marker from the set plurality of pieces of the filter intensity setting information, and

determine the value that determines the filter intensity, based on the selected filter intensity setting information.

6. The image processing device according to claim 1 ,

wherein the circuitry is further configured to:

set a rectangular region containing the marker, and

determine second coordinates of four corners of the rectangular region as the first coordinates of the corners corresponding to the marker.

7. The image processing device according to claim 1 , wherein the circuitry is further configured to correct the location of the marker that is represented by two-dimensional coordinates.

8. The image processing device according to claim 1 ,

wherein the circuitry is further configured to correct the location of the marker represented by three-dimensional coordinates, and

wherein the location indicates the relative location relationship between the imaging device and the marker.

9. An image processing method, comprising:

determining coordinates of corners corresponding to a marker in a captured image;

determining a criteria score, based on the determined coordinates of the corners and a criteria corresponding to a shape of the marker,

wherein the criteria score indicates a degree corresponding to a relative location relationship between an imaging device and the marker;

setting a filter intensity corresponding to the determined criteria score;

correcting a location of the marker based on a filter having the set filter intensity; and

combining a virtual object corresponding to the marker with the captured image at the corrected location based on the filter having the set filter intensity.

10. A non-transitory computer-readable medium having stored thereon computer readable instructions, which when executed by a computer, cause the computer to execute operations, the operations comprising:

determining coordinates of corners corresponding to a marker in a captured image;

determining a criteria score, based on the coordinates of the corners and a criteria corresponding to a shape of the marker,

wherein the criteria score indicates a degree corresponding to a relative location relationship between an imaging device and the marker;

setting a filter intensity corresponding to the determined criteria score;

correcting a location of the marker based on a filter having the set filter intensity; and

combining a virtual object corresponding to the marker with the captured image at the corrected location based on the filter having the set filter intensity.

11. An image processing device, comprising:

circuitry configured to:

determine coordinates of corners corresponding to a marker in a captured image;

determine a criteria score based on the coordinates of the corners and a criteria corresponding to a shape of the marker,

wherein the criteria score indicates a degree that is a relative location relationship between an imaging device and the marker;

set a filter intensity corresponding to the determined criteria score based on filter intensity setting information,

wherein the filter intensity setting information includes the criteria score and a value that determines the filter intensity, and

wherein the filter intensity setting information is set for one of the marker or a virtual object corresponding to the marker; and

combine the virtual object corresponding to the marker with the captured image based on a filter having the set filter intensity.

12. An image processing device, comprising:

circuitry configured to:

determine coordinates of corners corresponding to a marker in a captured image;

determine a criteria score, based on the coordinates of the corners and a criteria corresponding to a shape of the marker,

wherein the criteria score indicates a degree corresponding to a first relative location relationship between an imaging device and the marker;

set a plurality of pieces of filter intensity setting information;

select a piece of filter intensity setting information from the plurality of pieces of filter intensity setting information, wherein the piece of filter intensity setting information corresponds to a second relative location relationship between the marker and a virtual object corresponding to the marker from the set plurality of pieces of filter intensity setting information;

set a filter intensity corresponding to the determined criteria score based on the selected piece of filter intensity setting information; and

combine the virtual object corresponding to the marker with the captured image based on a filter having the set filter intensity.

Assignments (1)
CHANGE OF NAME Recorded Dec 17, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 073986/0571 →