IP Library Granted Patent US 11,656,633
Granted Patent B2
US 11,656,633 · App. 16/761,694 · Granted May 23, 2023

Determining method of article transfer place, determining method of landing place, article transfer system, and information processing device

Inventors: Toshiaki Tazume (Tokyo, JP); Qingnan Zhou (Tokyo, JP); Hayato Mizukami (Tokyo, JP)
Assignee: Rakuten Group, Inc.
G05D1/0676B64C39/024G05D1/0027G06Q10/0832B64U2101/60B64U2201/10B64U2201/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,656,633
App. No.
16/761,694
Granted
May 23, 2023
Kind
B2
Abstract

The article transfer system S selects an article transfer candidate on the basis of first sensing information obtained from first sensing performed by the unmanned aerial vehicle in flight, performs a movement control of the unmanned ground vehicle on the basis of position information of the selected article transfer candidate, and determines an article transfer place with reference to the selected article transfer candidate on the basis of second sensing information obtained from second sensing performed by the unmanned ground vehicle.

Claims (50)

1. A control method performed by a system which includes a control unit that controls an unmanned ground vehicle, comprising:

selecting, based at least in part on information obtained from first sensing of observing a state of surroundings of at least one of an atmosphere and a ground performed by an unmanned aerial vehicle in flight, a candidate ground location for determining one of:

an article transfer place, determined relative to a ground location, for a transfer performed between the unmanned aerial vehicle and the unmanned ground vehicle, and

a landing place, determined relative to a ground location, for the unmanned aerial vehicle to land on the unmanned ground vehicle;

performing a movement control of the unmanned ground vehicle based at least in part on information of the selected candidate ground location; and

determining the article transfer place or the landing place with reference to the selected candidate ground location, the determination based at least in part on information obtained from second sensing performed by the unmanned ground vehicle of surroundings of the unmanned ground vehicle,

wherein the selecting of the candidate ground location comprises:

selecting a plurality of first candidate ground locations and a plurality of second candidate ground locations for the article transfer place or the landing place, the first candidate ground locations being located in a first area, the second candidate ground locations being located in a second area, and

determining a density of candidate ground locations in each of the first area and the second area, and

wherein the performing of the movement control comprises controlling the unmanned ground vehicle to move preferentially toward one of the first area and the second area according to a greatest density of candidate ground locations.

2. The control method according to claim 1 , wherein a search is made for a space where the unmanned ground vehicle can stop for a predetermined time or more with reference to the candidate ground location, and the searched space or a point in the searched space is determined as the article transfer place or the landing place.

3. The control method according to claim 1 , wherein a search is made for a space in which ground and sky surroundings are free of obstacles with reference to the candidate ground location, and the searched space or a point in the searched space is determined as the article transfer place or the landing place.

4. The control method according to claim 1 , wherein the article transfer place or the landing place is determined based at least in part on the information obtained from the second sensing while the unmanned ground vehicle is moving according to the movement control.

5. The control method according to claim 1 , wherein the article transfer place or the landing place is determined based at least in part on information obtained from third sensing performed by a sensor installed on the ground.

6. The control method according to claim 1 , wherein the article transfer place or the landing place is determined based at least in part on a past transfer history or a past landing history.

7. The control method according to claim 1 , wherein a search is made for a space where the unmanned ground vehicle can stop fora predetermined time or more, and the searched space or a point in the searched space is selected as the candidate ground location.

8. The control method according to claim 1 , wherein a search is made fora space in which ground and sky surroundings are free of obstacles, and the searched space or a point in the searched space is selected as the candidate ground location.

9. The control method according to claim 1 , wherein the candidate ground location is selected based at least in part on information obtained from third sensing performed by a sensor installed on the ground.

10. The control method according to claim 1 , wherein the candidate ground location is determined based at least in part on a past transfer history or a past landing history.

11. The control method according to claim 1 ,

wherein a plurality of candidate ground locations for the article transfer place or the landing place is selected, and

wherein the unmanned ground vehicle is controlled to move toward at least one of the candidate ground locations in an order determined according to a predetermined criterion.

12. The control method according to claim 11 , wherein the predetermined criterion is a proximity to a delivery destination of the article.

13. The control method according to claim 11 , wherein the predetermined criterion is a proximity to a current position of the unmanned ground vehicle.

14. The control method according to claim 11 , wherein the predetermined criterion is a density of surrounding candidate ground locations.

15. The control method according to claim 1 , further comprising causing the unmanned aerial vehicle to fly to the determined article transfer place or landing place.

16. The control method according to claim 1 , further comprising causing the unmanned aerial vehicle and the unmanned ground vehicle to perform an article transfer at the determined article transfer place or landing place.

17. The control method according to claim 1 , further comprising outputting an alarm in a case where an approach of a moving object to the determined article transfer place or landing place is detected.

18. An article transfer system which includes an unmanned aerial vehicle and an unmanned ground vehicle, comprising:

at least one memory configured to store computer program code; and

at least one processor configured to access the computer program code and operate as instructed by the computer program code, the computer program code including:

selection code configured to cause at least one of the at least one processor to select, based at least in part on information obtained from first sensing of observing a state of surroundings of at least one of an atmosphere and a ground performed by an unmanned aerial vehicle in flight, a candidate ground location for determining for one of:

an article transfer place, determined relative to a ground location, for a transfer performed between the unmanned aerial vehicle and the unmanned ground vehicle, and

a landing place, determined relative to a ground location, for the unmanned aerial vehicle to land on the unmanned ground vehicle;

movement control code configured to cause at least one of the at least one processor to cause the unmanned ground vehicle to perform a movement control based at least in part on information of the selected candidate ground location; and

location determination code configured to cause at least one of the at least one processor to determine the article transfer place or the landing place with reference to the selected candidate ground location, the determination based at least in part on information obtained from second sensing performed by the unmanned ground vehicle of surroundings of the unmanned ground vehicle,

wherein the selecting of the candidate ground location comprises:

selecting a plurality of first candidate ground locations and a plurality of second candidate ground locations for the article transfer place or the landing place, the first candidate ground locations being located in a first area, the second candidate ground locations being located in a second area, and

determining a density of candidate ground locations in each of the first area and the second area, and

wherein the performing of the movement control comprises controlling the unmanned ground vehicle to move preferentially toward one of the first area and the second area according to a greatest density of candidate ground locations.

19. A control method performed by a system which includes a control unit that controls at least one from among an unmanned aerial vehicle and an unmanned ground vehicle, comprising:

selecting, based at least in part on information obtained from first sensing of observing a state of surroundings of at least one of an atmosphere and a ground performed by an unmanned aerial vehicle in flight, a candidate ground location for determining one of:

an article transfer place, determined relative to a ground location, for a transfer performed between the unmanned aerial vehicle and the unmanned ground vehicle, and

a landing place, determined relative to a ground location, for the unmanned aerial vehicle to land on the unmanned ground vehicle;

determining the article transfer place or the landing place with reference to the selected candidate ground location, the determination based at least in part on information obtained from second sensing performed by the unmanned ground vehicle of surroundings of the unmanned ground vehicle; and

causing the unmanned aerial vehicle to fly to the determined article transfer place or landing place,

wherein the selecting of the candidate ground location comprises:

selecting a plurality of first candidate ground locations and a plurality of second candidate ground locations for the article transfer place or the landing place, the first candidate ground locations being located in a first area, the second candidate ground locations being located in a second area, and

determining a density of candidate ground locations in each of the first area and the second area, and

wherein the unmanned ground vehicle moves preferentially toward one of the first area and the second area according to a greatest density of candidate ground locations, prior to performing the second sensing.

Assignments (2)
CHANGE OF NAME Recorded Jul 9, 2021
From: RAKUTEN INC
To: RAKUTEN GROUP INC
Reel/Frame 056816/0068 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 7, 2020
From: TAZUME, TOSHIAKI; ZHOU, QINGNAN; MIZUKAMI, HAYATO
To: RAKUTEN, INC.
Reel/Frame 052601/0766 →