IP Library › Granted Patent US 10,984,661
Granted Patent B2
US 10,984,661 · App. 16/301,614 · Granted Apr 20, 2021

Information processing device and information processing method

Inventors: Kazuma Yoshii (Tokyo, JP); Sho Tanaka (Tokyo, JP)
Assignee: SONY CORPORATION
G08G5/0047B64C39/024G05D1/0011G05D1/0088G05D1/101G06K9/00812G08G5/003B64C2201/127
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,984,661
App. No.
16/301,614
Granted
Apr 20, 2021
Kind
B2
Abstract

An information processing device is provided, for example, in a vehicle. A control unit of the information processing device executes flight control of an unmanned flying object such that the unmanned flying object moves to a destination and acquires a captured image from the unmanned flying object. The control unit performs adjustment of an arrival time at the destination, for example, depending on a congestion situation or movement guidance of the vehicle to an empty space at the destination on the basis of the captured image of the destination or a surrounding area of the destination. Further, retrieval of a movement route in the destination is performed on the basis of the captured image obtained by causing the unmanned flying object to move inside the destination and imaging the inside of the destination, and the detected movement route is set in a moving object which is used for movement in the destination.

Claims (47)

1. A first information processing device, comprising:

a display unit; and

a control unit configured to:

execute flight control of an unmanned flying object;

control the unmanned flying object to move the unmanned flying object to a destination, wherein the unmanned flying object is moved based on the execution of the flight control;

set an imaging direction of the unmanned flying object based on an arrangement of the display unit of the first information processing device;

control the unmanned flying object to capture an image of one of the destination or a surrounding area of the destination, wherein the image of one of the destination or the surrounding area of the destination is captured based on the set imaging direction; and

execute movement control based on the captured image of one of the destination or the surrounding area of the destination.

2. The first information processing device according to claim 1 , wherein

the first information processing device is in a vehicle, and

the control unit is further configured to execute movement control of the vehicle to the destination based on the captured image of one of the destination or the surrounding area of the destination.

3. The first information processing device according to claim 2 , wherein the control unit is further configured to:

determine a congestion situation based on the captured image of one of the destination or the surrounding area of the destination; and

execute the movement control of the vehicle to the destination based on the determined congestion situation.

4. The first information processing device according to claim 3 , wherein

the control unit is further configured to control at least one of a movement route or a speed of the vehicle to adjust an arrival time of the vehicle at the destination, and

at least one of the movement route or the speed of the vehicle is controlled based on the determined congestion situation.

5. The first information processing device according to claim 1 , wherein

the first information processing device is in a vehicle,

the control unit is further configured to set a parking lot as the destination of the vehicle, and

the control unit is further configured to:

control the unmanned flying object to capture an image of the parking lot;

retrieve an empty space based on the captured image of the parking lot;

control the unmanned flying object to move to a position of the retrieved empty space; and

perform movement guidance of the vehicle to the empty space based on the movement of the unmanned flying object to the position of the retrieved empty space.

6. The first information processing device according to claim 5 , wherein the control unit is further configured to control the unmanned flying object to move from a position of the vehicle to the position of the retrieved empty space.

7. The first information processing device according to claim 1 , wherein the control unit is further configured to:

control the unmanned flying object to move the unmanned flying object in the destination;

control the unmanned flying object to capture an image of an inside of the destination; and

retrieve a movement route in the destination based on the captured image of the inside of the destination.

8. The first information processing device according to claim 7 , wherein the control unit is further configured to set the movement route in a moving object for movement of the moving object in the destination.

9. The first information processing device according to claim 1 , wherein

the first information processing device is in a vehicle,

the control unit is further configured to change a control authority over the flight control of the unmanned flying object to a second information processing device of an occupant that gets off the vehicle, and

the control authority is changed based on that the occupant gets off the vehicle.

10. The first information processing device according to claim 9 , wherein

the control unit is further configured to provide information to the second information processing device of the occupant, and

the information is associated with the flight control of the unmanned flying object.

11. The first information processing device according to claim 1 , wherein the display unit is configured to display the captured image.

12. The first information processing device according to claim 11 , wherein the control unit is further configured to set an image size of the captured image based on an image display size on the display unit.

13. An information processing method, comprising:

in an information processing device that includes a display unit and a control unit:

causing the control unit to execute flight control of an unmanned flying object;

causing the unmanned flying object to move the unmanned flying object to a destination, wherein the unmanned flying object is moved based on the execution of the flight control;

setting an imaging direction of the unmanned flying object, wherein the imaging direction is set based on an arrangement of the display unit of the information processing device;

causing the unmanned flying object to capture an image of one of the destination or a surrounding area of the destination, wherein the image of one of the destination or the surrounding area of the destination is captured based on the set imaging direction; and

causing the control unit to execute movement control, wherein the movement control is executed based on the captured image of one of the destination or the surrounding area of the destination.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2018
From: YOSHII, KAZUMA; TANAKA, SHO
To: SONY CORPORATION
Reel/Frame 047501/0891 →
Priority Claims (1)
JP JP2016-110807 · Jun 2, 2016 · national
Continuity (1)
Related Publication 20190325758A1 · Oct 24, 2019