IP Library Granted Patent US 11,244,145
Granted Patent B2
US 11,244,145 · App. 16/651,383 · Granted Feb 8, 2022

Information processing apparatus, information processing method, and recording medium

Inventors: Masashi Eshima (Chiba, JP); Akihiko Kaino (Kanagawa, JP); Daiki Yamanaka (Tokyo, JP)
Assignee: SONY CORPORATION
G06K9/00255G06K9/00281G06K9/00912G06T11/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,244,145
App. No.
16/651,383
Granted
Feb 8, 2022
Kind
B2
Abstract

An information processing apparatus includes an estimating unit that estimates a normal on at least a part of a face of an object in a real space on the basis of polarization information corresponding to a detection result of each of a plurality of beams of polarized light acquired by a polarization sensor and having different polarization directions and a control unit that controls output of notification information for guiding a change in a position in the real space according to an estimation result of the normal.

Claims (39)

1. An information processing apparatus, comprising:

circuitry configured to:

estimate a normal on at least a part of a face of an object in a real space based on polarization information, wherein

the polarization information corresponds to a detection result of each of a plurality of beams of polarized light acquired by a polarization sensor, and

the plurality of beams have different polarization directions; and

control output of notification information, wherein the output of the notification information is controlled to guide a change in a position of the polarization sensor in the real space based on the estimated normal;

acquire position information of the changed position of the polarization sensor in the real space based on the estimated normal; and

control output of the notification information based on the acquired position information and the estimated normal.

2. The information processing apparatus according to claim 1 , wherein the notification information is information to:

maintain a state where the object is located within at least a part of a detection range of the polarization sensor, and

change the position of the polarization sensor in the real space.

3. The information processing apparatus according to claim 2 , wherein the notification information is information to locate the face of the object on an optical axis of the polarization sensor.

4. The information processing apparatus according to claim 1 , wherein the notification information is information to observe the face of the object from different directions.

5. The information processing apparatus according to claim 1 , wherein the notification information is display information for the guidance.

6. The information processing apparatus according to claim 5 , wherein the display information includes information that is an index for localizing a gaze point from a specific viewpoint in at least a part of a region of the face of the object.

7. The information processing apparatus according to claim 5 , wherein

the display information includes first display information and second display information for guidance so that a user directly faces the first display information, and

the circuitry is further configured to present the first display information in a state that superimposes the first display information on the face of the object, wherein the superimposed first display information is directed in a direction in the real space based the estimated normal.

8. The information processing apparatus according to claim 1 , wherein the notification information executes guidance so that an angle between a direction of the normal of the face and a direction corresponding to a vector extending from the polarization sensor to the face becomes larger.

9. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to control the output of the notification information based on a degree of reliability of the estimated normal.

10. The information processing apparatus according to claim 9 , wherein the circuitry is further configured to control the output of the notification information to guide movement of the polarization sensor to a direction in which the degree of reliability becomes higher.

11. The information processing apparatus according to claim 9 , wherein the circuitry is further configured to control the output of the notification information when the degree of reliability is equal to or less than a threshold.

12. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to control the output of the notification information based on a past observation result of the face.

13. The information processing apparatus according to claim 12 , wherein the notification information is information that guides movement of the polarization sensor to a direction, in which observation of the face of the object has not been executed in past, among respective directions for the face of the object.

14. The information processing apparatus according to claim 12 , wherein the circuitry is further configured to control the output of the notification information based on presence of a direction, in which observation of the face of the object has not been performed in past, among respective directions for the face of the object.

15. An information processing method, comprising:

estimating a normal on at least a part of a face of an object in a real space based on polarization information, wherein

the polarization information corresponds to a detection result of each of a plurality of beams of polarized light acquired by a polarization sensor, and

the plurality of beams have different polarization directions;

controlling output of notification information, wherein the output of the notification information is controlled to guide a change in a position of the polarization sensor in the real space based on the estimated normal;

acquiring position information of the changed position of the polarization sensor in the real space based on the estimated normal; and

controlling output of the notification information based on the acquired position information and the estimated normal.

16. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

estimating a normal on at least a part of a face of an object in a real space based on polarization information, wherein

the polarization information corresponds to a detection result of each of a plurality of beams of polarized light acquired by a polarization sensor, and

the plurality of beams have different polarization directions;

controlling output of notification information, wherein the output of the notification information is controlled to guide a change in a position of the polarization sensor in the real space based on the estimated normal;

acquiring position information of the changed position of the polarization sensor in the real space based on the estimated normal; and

controlling output of the notification information based on the acquired position information and the estimated normal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 23, 2020
From: ESHIMA, MASASHI; KAINO, AKIHIKO; YAMANAKA, DAIKI
To: SONY CORPORATION
Reel/Frame 053290/0036 →
Priority Claims (1)
JP JP2017-194815 · Oct 5, 2017 · national
Continuity (1)
Related Publication 20200242335A1 · Jul 30, 2020
Cited By (2)
US 12,552,021 US 12,576,520