IP Library Granted Patent US 11,488,354
Granted Patent B2
US 11,488,354 · App. 16/490,151 · Granted Nov 1, 2022

Information processing apparatus and information processing method

Inventors: Daiki Yamanaka (Tokyo, JP); Masashi Eshima (Chiba, JP); Akihiko Kaino (Kanagawa, JP)
Assignee: SONY CORPORATION
G06T17/10G01B11/245G06T7/55G06T17/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,488,354
App. No.
16/490,151
Granted
Nov 1, 2022
Kind
B2
Abstract

To enable both an increase in reproducibility for reproduction of a shape of an object and suppression of an increase in data amount. An information processing apparatus including: an acquisition unit that acquires first information associated with a result of estimation of a shape of an object on a real space and second information associated with a result of estimation of a geometrical feature of the object; and a correction unit that corrects the first information on the basis of the second information.

Claims (71)

1. An information processing apparatus, comprising:

circuitry configured to:

acquire first information and second information, wherein

the first information is associated with a result of estimation of a shape of an object on a real space,

the second information includes a result of estimation of a boundary of adjacent outer surfaces of a plurality of outer surfaces of the object,

the boundary is estimated based on a normal map, and

the normal map corresponds to a distribution of normal vectors of the plurality of outer surfaces;

project a plurality of endpoints of the boundary to specify a set of sides of a plurality of sides of the object, wherein

the set of sides of the plurality of sides of the object connects a set of vertices of a plurality of vertices of the object,

the set of vertices corresponds to the plurality of endpoints of the boundary, and

the plurality of endpoints of the boundary is projected based on the second information;

project a center of gravity, of at least one outer surface of the plurality of outer surfaces of the object, on the normal map,

wherein the at least one outer surface includes at least one side of the specified set of sides of the object;

estimate a normal vector of the at least one outer surface of the plurality of outer surfaces based on a projection point, of the projected center of gravity, on the normal map; and

correct a position of a vertex, on the specified set of sides of the object, based on a result of estimation of the normal vector of the at least one outer surface.

2. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to:

detect a polarization direction of each of a plurality of polarizations, wherein the polarization direction of each the plurality of polarizations is different; and

generate the normal map based on a polarization image of the object, wherein the polarization image of the object is associated with a result of the detection of the polarization direction of each of the plurality of polarizations.

3. The information processing apparatus according to claim 1 , wherein the first information includes information associated with a result of estimation of a set of outer surfaces of the plurality of outer surfaces.

4. The information processing apparatus according to claim 3 , wherein

the first information further includes mesh data that indicates the plurality of sides and the at least one outer surface of the plurality of outer surfaces,

the at least one outer surface is associated with the plurality of vertices, and

the plurality of sides connects the plurality of vertices.

5. The information processing apparatus according to claim 4 , wherein the circuitry is further configured to:

correct positions of the set of vertices of the plurality of vertices, and

correct the first information based on the second information and the correction of the positions of the set of vertices.

6. The information processing apparatus according to claim 5 , wherein the circuitry is further configured to:

estimate an approximate plane based on the second information;

project the approximate plane on the first information; and

correct the positions of the set of vertices of the plurality of vertices based on a result of the projection of the approximate plane.

7. An information processing method, comprising:

acquiring first information and second information, wherein

the first information is associated with a result of estimation of a shape of an object on a real space,

the second information includes a result of estimation of a boundary of adjacent outer surfaces of a plurality of outer surfaces of the object,

the boundary is estimated based on a normal map, and

the normal map corresponds to a distribution of normal vectors of the plurality of outer surfaces; and

projecting a plurality of endpoints of the boundary to specify a set of sides of a plurality of sides of the object, wherein

the set of sides of the plurality of sides of the object connects a set of vertices of a plurality of vertices of the object,

the set of vertices corresponds to the plurality of endpoints of the boundary, and

the plurality of endpoints of the boundary is projected based on the second information;

projecting a center of gravity, of at least one outer surface of the plurality of outer surfaces of the object, on the normal map,

wherein the at least one outer surface includes at least one side of the specified set of sides of the object;

estimating a normal vector of the at least one outer surface of the plurality of outer surfaces based on a projection point, of the projected center of gravity, on the normal map; and

correcting a position of a vertex, on the specified set of sides of the object, based on a result of estimation of the normal vector of the at least one outer surface.

8. A non-transitory computer-readable medium having stored thereon computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

acquiring first information and second information, wherein

the first information is associated with a result of estimation of a shape of an object on a real space, and

second information includes a result of estimation of a boundary of adjacent outer surfaces of a plurality of outer surfaces of the object,

the boundary is estimated based on a normal map, and

the normal map corresponds to a distribution of normal vectors of the plurality of outer surfaces;

projecting a plurality of endpoints of the boundary to specify a set of sides of a plurality of sides of the object, wherein

the set of sides of the plurality of sides of the object connects a set of vertices of a plurality of vertices of the object,

the set of vertices corresponds to the plurality of endpoints of the boundary, and

the plurality of endpoints of the boundary is projected based on the second information;

projecting a center of gravity, of at least one outer surface of the plurality of outer surfaces of the object, on the normal map,

wherein the at least one outer surface includes at least one side of the specified set of sides of the object;

estimating a normal vector of the at least one outer surface of the plurality of outer surfaces based on a projection point, of the projected center of gravity, on the normal map; and

correcting a position of a vertex, on the specified set of sides of the object, based on a result of estimation of the normal vector of the at least one outer surface.

9. An information processing apparatus, comprising:

circuitry configured to:

acquire first information and second information, wherein

the first information is associated with a result of estimation of a shape of an object on a real space,

the second information includes a result of estimation of a boundary of adjacent outer surfaces of a plurality of outer surfaces of the object,

the boundary is estimated based on a normal map, and

the normal map corresponds to a distribution of normal vectors of the plurality of outer surfaces;

project a result of estimation of an endpoint of the boundary on the first information based on the second information;

specify a vertex of a plurality of vertices, wherein the vertex corresponds to a projection point of the result of estimation of the endpoint;

project a center of gravity of at least one outer surface of the plurality of outer surfaces to the normal map, wherein the at least one outer surface includes the specified vertex;

estimate a normal vector of the at least one outer surface of the plurality of outer surfaces based on a projection point of the center of gravity on the normal map;

correct positions of a set of vertices of the plurality of vertices based on a result of the estimation of the normal vector; and

correct the first information based on the second information and the corrected positions of the set of vertices.

Assignments (2)
CHANGE OF NAME Recorded Dec 17, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 073986/0571 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 5, 2019
From: YAMANAKA, DAIKI; ESHIMA, MASASHI; KAINO, AKIHIKO
To: SONY CORPORATION
Reel/Frame 050930/0937 →
Priority Claims (1)
JP JP2017-100739 · May 22, 2017 · national
Continuity (1)
Related Publication 20210407189A1 · Dec 30, 2021