IP Library Granted Patent US 11,481,920
Granted Patent B2
US 11,481,920 · App. 17/055,936 · Granted Oct 25, 2022

Information processing apparatus, server, movable object device, and information processing method

Inventor: Takahide Otani (Tokyo, JP)
Assignee: SONY CORPORATION
G06T7/73H04N5/232
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,481,920
App. No.
17/055,936
Granted
Oct 25, 2022
Kind
B2
Abstract

An information processing apparatus includes a scene obtaining unit and a suitability determining unit. The scene obtaining unit is configured to obtain a scene including position and attitude information of a movable object equipped with a camera and information regarding a three-dimensional shape of an object to be imaged, the object to be imaged being imaged by the camera. The suitability determining unit is configured to determine suitability of the scene on the basis of suitability data indicating whether or not the obtained scene is suitable for localizing processing.

Claims (54)

1. An information processing apparatus, comprising:

circuitry configured to:

obtain a scene and information corresponding to a three-dimensional shape of an object to be imaged by a camera, wherein

the scene includes position information and attitude information of a movable object,

the movable object is different from the object, and

the movable object is associated with a movable object device that is equipped with the camera;

determine suitability data indicating whether the obtained scene is suitable for localizing processing;

store the suitability data to associate the position information and the attitude information of the movable object with the information corresponding to the three-dimensional shape of the object; and

determine suitability of the obtained scene based on the stored suitability data.

2. The information processing apparatus according to claim 1 , wherein the circuitry is further is configured to store the obtained scene that is unsuitable for localizing processing.

3. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to determine the suitable data based on the information corresponding to the three-dimensional shape of the object the obtained scene that is not stored in the information processing apparatus.

4. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to obtain the attitude information of the movable object based on a motion sensor.

5. The information processing apparatus according to claim 1 , wherein

the circuitry is further configured to determine the suitability data based on analysis of an image and the obtained scene that is not stored in the information processing apparatus,

the image is associated with the camera, and

the image includes including the object.

6. The information processing apparatus according to claim 3 , wherein the circuitry is further configured to:

detect a disturbance factor in the image, and

determine the suitability based on a result of the detection.

7. The information processing apparatus according to claim 6 , wherein the circuitry is further configured to detect at least one of a shadow region or a moving object in the image as the disturbance factor.

8. The information processing apparatus according to claim 7 , wherein the circuitry is further configured to determine the suitability based on a rate of the shadow region that is associated with the image.

9. The information processing apparatus according to claim 7 , wherein the circuitry is further configured to determine the suitability based on a position of the shadow region in the image.

10. A server configured to be communicable with a movable object, the server comprising:

circuitry configured to:

obtain a scene and information corresponding a three-dimensional shape of an object to be imaged by a camera, wherein

the scene includes position information and attitude information of the movable object, and

the movable object is different from the object;

determine suitability data indicating whether the obtained scene is suitable for localizing processing;

store the suitability data to associate the position information and the attitude information of the movable object with the information corresponding to the three-dimensional shape of the object; and

determine suitability of the obtained scene based on the stored suitability data.

11. A movable object device that is equipped with a camera and is configured to be communicable with a server, the movable object device comprising:

circuitry configured to:

obtain a scene and information corresponding a three-dimensional shape of an object to be imaged by the camera, wherein

the scene includes position information and attitude information of the movable object device; and

request the server to determine suitability of the scene, wherein the server:

determines suitability data indicating whether the obtained scene is suitable for localizing processing;

stores the suitability data to associate the position information and the attitude information of the movable object device with the information corresponding to the three-dimensional shape of the object; and

determines the suitability of the obtained scene based on the stored suitability data.

12. An information processing method, comprising:

obtaining a scene and information corresponding to a three-dimensional shape of an object to be imaged by a camera, wherein

the scene includes position information and attitude information of a movable object,

the movable object is different from the object, and

the movable object is associated with a movable object device that is equipped with the camera;

determining suitability data indicating whether the obtained scene is suitable for localizing processing;

storing the suitability data to associate the position information and the attitude information of the movable object with the information corresponding to the three-dimensional shape of the object; and

determining suitability of the obtained scene based on a basis of the stored suitability data.

13. A non-transitory computer-readable medium having stored thereon computer-executable instructions which, when executed by an information processing apparatus, cause the information processing apparatus to execute operations, the operations comprising:

obtaining a scene and information corresponding to a three-dimensional shape of an object to be imaged by a camera, wherein

the scene includes position information and attitude information of a movable object,

the movable object is different from the object, and

the movable object is associated with a movable object device that is equipped with the camera;

determining suitability data indicating whether the obtained scene is suitable for localizing processing;

storing the suitability data to associate the position and the attitude information of the movable object with the information corresponding to the three-dimensional shape of the object; and

determining suitability of the obtained scene based on the suitability data.

Assignments (2)
CHANGE OF NAME Recorded Dec 17, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 073986/0571 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 9, 2021
From: OTANI, TAKAHIDE
To: SONY GROUP CORPORATION
Reel/Frame 057124/0804 →
Priority Claims (1)
JP JP2018-096895 · May 21, 2018 · national
Continuity (1)
Related Publication 20210233271A1 · Jul 29, 2021
Cited By (1)
US 12,367,689