IP Library Granted Patent US 11,475,390
Granted Patent B2
US 11,475,390 · App. 16/066,294 · Granted Oct 18, 2022

Logistics system, package delivery method, and program

Inventors: Junji Torii (Tokyo, JP); Hideaki Mukai (Tokyo, JP); Takayuki Kageyama (Tokyo, JP)
Assignee: RAKUTEN GROUP, INC.
G06Q10/0832B64C27/08B64C39/024G06F21/31G06F21/44G06Q50/28H04W12/06H04W12/63B64C2201/128G06F2221/2129G06V20/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,475,390
App. No.
16/066,294
Granted
Oct 18, 2022
Kind
B2
Abstract

Association means of a logistics system associates authentication information on a user with the package and storing the associated authentication information into a storage means; Instruction means instructs an unmanned aerial vehicle into which the package is to be loaded to move to the location, based on location information on a location of a collection destination or a delivery destination of the package. Arrival determination means determines whether the unmanned aerial vehicle has arrived at the location. Checking means checks whether the user is at the location based on the authentication information associated with the package and on a situation of the location detected by the unmanned aerial vehicle or details of communication to and from a terminal of the user. Movement control means moves the unmanned aerial vehicle toward the user at the location when the checking means confirms that the user is at the location.

Claims (101)

1. A logistics system, comprising at least one processor configured to:

associate authentication information on a user who is to leave or receive a package with the package and record the associated authentication information into a storage;

instruct an unmanned aerial vehicle into which the package is to be loaded to move to a first location, based on location information on a location of a collection destination of the package or a location of a delivery destination of the package;

determine whether the unmanned aerial vehicle has arrived at the first location based on position information on a position of the unmanned aerial vehicle and the location information;

check whether the user is at the first location, when it is determined that the unmanned aerial vehicle has arrived at the first location, based on the authentication information associated with the package and on a situation of the first location detected by the unmanned aerial vehicle;

move the unmanned aerial vehicle toward the user at the first location after it is confirmed that the user is at the first location;

wherein the unmanned aerial vehicle includes a camera,

wherein the at least one processor is configured to perform checking by determining whether photographed images, which are obtained by photographing the situation of the first location continuously or repeatedly by the camera, exhibit a predetermined pattern of changes;

wherein the predetermined pattern is a change in a shape of one or more objects;

wherein the one or more objects are an authentication image displayed on a terminal of the user;

wherein the at least one processor is configured to:

acquire distance information on a distance between the unmanned aerial vehicle and the user, and

check whether the photographed image contains the authentication image in a second display mode different from the first display mode, to thereby perform checking in a stepwise manner depending on the distance information, when the distance information indicates a distance smaller than a predetermined distance,

wherein the terminal of the user changes the authentication image from the first display mode to the second display mode when the distance information indicates the distance smaller than the predetermined distance.

2. The logistics system according to claim 1 , wherein the at least one processor is configured to:

notify the user of the authentication information associated with the package, and

perform checking based on the authentication information.

3. The logistics system according to claim 2 ,

wherein the authentication information includes authentication image data on an authentication image,

wherein the at least one processor is configured to transmit the authentication image data to a terminal of the user, and

perform checking by determining whether a photographed image contains the authentication image displayed on the terminal,

wherein, the photographed image is obtained by using the camera to photograph the situation of the first location.

4. The logistics system according to claim 1 ,

wherein the authentication information includes appearance information on an appearance of the user, and

wherein the at least one processor is configured to perform checking by determining whether a photographed image, which is obtained by photographing the situation of the first location by the camera, contains the user.

5. A logistics system, comprising at least one processor configured to:

associate authentication information on a user who is to leave or receive a package with the package and record the associated authentication information into a storage;

instruct an unmanned aerial vehicle into which the package is to be loaded to move to a first location, based on location information on a location of a collection destination of the package or a location of a delivery destination of the package;

determine whether the unmanned aerial vehicle has arrived at the first location based on position information on a position of the unmanned aerial vehicle and the location information;

check whether the user is at the first location, when it is determined that the unmanned aerial vehicle has arrived at the first location, based on the authentication information associated with the package and on a situation of the first location detected by the unmanned aerial vehicle;

move the unmanned aerial vehicle toward the user at the first location after it is confirmed that the user is at the first location;

wherein the unmanned aerial vehicle includes a camera,

wherein the at least one processor is configured to perform checking by determining whether photographed images, which are obtained by photographing the situation of the first location continuously or repeatedly by the camera, exhibit a predetermined pattern of changes;

wherein the predetermined pattern is a change in a shape of one or more objects;

wherein the one or more objects are an authentication image displayed on a terminal of the user;

wherein the at least one processor is configured to:

perform checking by determining whether a degree of similarity between a situation of the first location and a predetermined situation is equal to or larger than a threshold value, wherein the situation is contained in the photographed image obtained by photographing the situation of the first location by the camera,

acquire distance information on a distance between the unmanned aerial vehicle and the user, and

cause the unmanned aerial vehicle to move to the user when the distance information indicates a distance larger than a predetermined distance and change the threshold value and perform determination based on the changed threshold value, to thereby perform checking in a stepwise manner depending on the distance information, when the distance information indicates a distance smaller than the predetermined distance.

6. The logistics system according to claim 1 ,

wherein the unmanned aerial vehicle and a terminal are each capable of performing short-range communication,

wherein the at least one processor is configured to acquire the authentication information from the terminal when the unmanned aerial vehicle and the terminal are connected to each other by the short-range communication, and

perform checking based on the authentication information.

7. The logistics system according to claim 1 ,

wherein the at least one processor is configured to estimate a position of the user based on a photographed image, which is obtained by photographing the situation of the first location by the camera, and

move the unmanned aerial vehicle based on the position.

8. The logistics system according to claim 1 ,

wherein the unmanned aerial vehicle is configured to generate an electromagnetic wave or sound wave having directivity in a plurality of directions, when it is determined that the unmanned aerial vehicle has arrived at the first location,

wherein the at least one processor is configured to:

acquire timing information on a timing at which a terminal has detected the electromagnetic wave or the sound wave;

estimate a position of the user based on the timing information, and

move the unmanned aerial vehicle based on the position.

9. The logistics system according to claim 1 ,

wherein a terminal is configured to receive a positional relationship indication operation for indicating a positional relationship between the terminal and the unmanned aerial vehicle,

wherein the at least one processor is configured to estimate a position of the user based on the positional relationship indication operation, and

move the unmanned aerial vehicle based on the position.

10. The logistics system according to claim 1 ,

wherein a terminal is configured to receive a direction instruction operation for indicating a movement direction of the unmanned aerial vehicle, and

wherein the at least one processor is configured to move the unmanned aerial vehicle based on the direction instruction operation.

11. The logistics system according to claim 1 ,

wherein the unmanned aerial vehicle and a terminal are each capable of performing short-range communication,

wherein the at least one processor is configured to:

estimate a position of the user based on a communication state in a case where the unmanned aerial vehicle and the terminal are connected to each other by the short-range communication, and

move the unmanned aerial vehicle based on the position.

12. The logistics system according to claim 1 ,

wherein the unmanned aerial vehicle is configured to wait at a height of a predetermined level or more after the unmanned aerial vehicle has arrived at the first location, and

wherein the at least one processor is configured to cause, when it is confirmed that the user is at the first location, the unmanned aerial vehicle to descend to a height less than the predetermined level at the first location, to thereby move the unmanned aerial vehicle toward the user.

13. The logistics system according to claim 1 , wherein the at least one processor is configured to acquire terminal position information on a position of a terminal of the user as the location information.

14. The logistics system according to claim 1 ,

wherein the at least one processor is configured to store an image, which is obtained by photographing the user leaving or receiving the package by the camera, into the storage.

15. A non-transitory computer-readable information storage medium having stored thereon a program for causing a computer to:

associate authentication information on a user who is to leave or receive a package with the package and record the associated authentication information into a storage;

instruct an unmanned aerial vehicle into which the package is to be loaded to move to a first location, based on location information on a location of a collection destination of the package or a location of a delivery destination of the package;

determine whether the unmanned aerial vehicle has arrived at the first location based on position information on a position of the unmanned aerial vehicle and the location information;

check whether the user is at the first location, when it is determined that the unmanned aerial vehicle has arrived at the first location, based on the authentication information associated with the package and on a situation of the first location detected by the unmanned aerial vehicle; and

move the unmanned aerial vehicle toward the user at the first location after it is confirmed that the user is at the first location;

wherein the unmanned aerial vehicle includes a camera,

check by determining whether photographed images, which are obtained by photographing the situation of the first location continuously or repeatedly by the camera, exhibit a predetermined pattern of changes;

wherein the predetermined pattern is a change in a shape of one or more objects;

wherein the one or more objects are an authentication image displayed on a terminal of the user;

wherein the program causes the computer to:

acquire distance information on a distance between the unmanned aerial vehicle and the user, and

check whether the photographed image contains the authentication image in a second display mode different from the first display mode, to thereby perform checking in a stepwise manner depending on the distance information, when the distance information indicates a distance smaller than a predetermined distance,

wherein the terminal of the user changes the authentication image from the first display mode to the second display mode when the distance information indicates the distance smaller than the predetermined distance.

16. The logistics system according to claim 1 ,

wherein the predetermined pattern is switching between authentication images in a predetermined display order and/or at a predetermined timing.

17. The logistics system according to claim 1 , wherein the shapes of the one or more objects are regular polygons.

18. A non-transitory computer-readable information storage medium having stored thereon a program for causing a computer to:

associate authentication information on a user who is to leave or receive a package with the package and record the associated authentication information into a storage;

instruct an unmanned aerial vehicle into which the package is to be loaded to move to a first location, based on location information on a location of a collection destination of the package or a location of a delivery destination of the package;

determine whether the unmanned aerial vehicle has arrived at the first location based on position information on a position of the unmanned aerial vehicle and the location information;

check whether the user is at the first location, when it is determined that the unmanned aerial vehicle has arrived at the first location, based on the authentication information associated with the package and on a situation of the first location detected by the unmanned aerial vehicle; and

move the unmanned aerial vehicle toward the user at the first location after it is confirmed that the user is at the first location;

wherein the unmanned aerial vehicle includes a camera,

check by determining whether photographed images, which are obtained by photographing the situation of the first location continuously or repeatedly by the camera, exhibit a predetermined pattern of changes;

wherein the predetermined pattern is a change in a shape of one or more objects;

wherein the one or more objects are an authentication image displayed on a terminal of the user;

wherein the program causes the computer to:

perform checking by determining whether a degree of similarity between a situation of the first location and a predetermined situation is equal to or larger than a threshold value, wherein the situation is contained in the photographed image obtained by photographing the situation of the first location by the camera,

acquire distance information on a distance between the unmanned aerial vehicle and the user, and

cause the unmanned aerial vehicle to move to the user when the distance information indicates a distance larger than a predetermined distance and change the threshold value and perform determination based on the changed threshold value, to thereby perform checking in a stepwise manner depending on the distance information, when the distance information indicates a distance smaller than the predetermined distance.

Assignments (2)
CHANGE OF NAME Recorded Jul 13, 2021
From: RAKUTEN, INC.
To: RAKUTEN GROUP, INC.
Reel/Frame 056845/0831 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 26, 2018
From: TORII, JUNJI; MUKAI, HIDEAKI; KAGEYAMA, TAKAYUKI
To: RAKUTEN, INC.
Reel/Frame 046209/0057 →
Continuity (1)
Related Publication 20190019141A1 · Jan 17, 2019