IP Library Granted Patent US 11,299,170
Granted Patent B2
US 11,299,170 · App. 16/266,443 · Granted Apr 12, 2022

Passenger support device, passenger support method and program storage medium

Inventors: Akira Sasaki (Miyoshi, JP); Eisuke Ando (Nagoya, JP); Misako Hayashima (Okazaki, JP); Saki Kitoh (Okazaki, JP); Masahiro Yamashita (Seto, JP)
Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
B60W50/0098B25J11/00B25J11/008B60W50/10B60W2710/30G05D1/021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,299,170
App. No.
16/266,443
Granted
Apr 12, 2022
Kind
B2
Abstract

There is provided a passenger support device including (i) an informing portion that sets behavior items to be performed by a passenger by a time a vehicle arrives at a destination and sets an order of performing the behavior items, the informing portion informing the passenger of the behavior items to be performed based on the order, (ii) an action recognition portion that recognizes an action of the passenger performing the behavior items, and (iii) an action support portion that supports the action of the passenger performing the behavior items, based on each of the behavior items and the action of the passenger recognized by the action recognition portion.

Claims (44)

1. A passenger support device comprising:

a camera;

a processor; and

memory storing instructions that, when executed by the processor, cause the processor to:

set behavior items to be performed by a passenger by a time a vehicle arrives at a destination, set an order of performing the behavior items, and inform the passenger of the behavior items to be performed based on the order;

determine that the behavior items cannot be performed by the time the vehicle arrives at the destination;

request that the passenger confirm a behavior item can be omitted;

remove the confirmed behavior item from the behavior items to be performed;

analyze, using artificial intelligence, actions of the passenger performing the behavior items from images captured by the camera;

predict, using the artificial intelligence and an analysis result, an action of the passenger performing the behavior items;

support the predicted action of the passenger performing the behavior items, based on each of the behavior items;

store a history of behavior items performed, a time required to perform the behavior items, and a frequency of performing the behavior items; and

select the behavior items to be performed in order of the frequency such that performing the behavior items is finished by the time the vehicle arrives at the destination.

2. The passenger support device according to claim 1 , wherein the processor indicates a behavior item to be performed next after performing each of the behavior items is finished.

3. The passenger support device according to claim 1 , wherein the processor indicates each of the behavior items by display on a display medium and by sound output from a sound output portion.

4. The passenger support device according to claim 1 , wherein the processor further: receives input indicating addition, removal, and a change in the order of performing the behavior items, from the passenger; and sets the behavior items to be performed and the order of performing the behavior items based on the received input.

5. The passenger support device according to claim 4 , wherein the processor further acquires a required time for the vehicle to reach the destination, wherein the processor sets the behavior items to be performed such that the behavior items are finished by the required time.

6. The passenger support device according to claim 4 , wherein the processor receives the input indicating addition, the removal, and the order of performing the behavior items on an interactive basis.

7. The passenger support device according to claim 1 , further comprising a robot arm that supports the action of the passenger performing one of the behavior items.

8. The passenger support device according to claim 7 , wherein the robot arm is activated in accordance with the behavior item and the recognized action of the passenger.

9. The passenger support device according to claim 1 , wherein the processor further: receives input indicating a change in the order of performing the behavior items, without addition or removal, from the passenger; and change the order of performing the behavior items based on the received input.

10. A passenger support method, comprising:

setting behavior items to be performed by a passenger, by a time a vehicle arrives at a destination and setting an order of performing the behavior items;

informing the passenger of the behavior items to be performed based on the order;

determining that the behavior items cannot be performed by the time the vehicle arrives at the destination;

requesting that the passenger confirm a behavior item can be omitted;

removing the confirmed behavior item from the behavior items to be performed;

analyzing, using artificial intelligence, actions of the passenger performing the behavior items from images captured by a camera;

predicting, using artificial intelligence and an analysis result, an action of the passenger performing the behavior items;

supporting the predicted action of the passenger performing the behavior items, based on each of the behavior items;

storing a history of behavior items performed, a time required to perform the behavior items, and a frequency of performing the behavior items; and

selecting the behavior items to be performed in order of the frequency such that performing the behavior items is finished by the time the vehicle arrives at the destination.

11. The method according to claim 10 , further comprising: receiving input indicating a change in the order of performing the behavior items, without addition or removal, from the passenger; and changing the order of performing the behavior items based on the received input.

12. A non-transitory storage medium that stores a program causing a computer to execute a passenger support processing, the processing comprising:

setting behavior items to be performed by a passenger, by a time a vehicle arrives at a destination and setting an order of performing the behavior items;

informing the passenger of the behavior items to be performed based on the order;

determining that the behavior items cannot be performed by the time the vehicle arrives at the destination;

requesting that the passenger confirm a behavior item can be omitted;

removing the confirmed behavior item from the behavior items to be performed;

analyzing, using artificial intelligence, actions of the passenger performing the behavior items from images captured by a camera; predicting, using the artificial intelligence and an analysis result, an action of the passenger performing the behavior items;

supporting the predicted action of the passenger performing the behavior items, based on each of the behavior items;

storing a history of behavior items performed, a time required to perform the behavior items, and a frequency of performing the behavior items; and

selecting the behavior items to be performed in order of the frequency such that performing the behavior items is finished by the time the vehicle arrives at the destination.

13. The non-transitory storage medium according to claim 12 , wherein the processing further comprises: receiving input indicating a change in the order of performing the behavior items, without addition or removal, from the passenger; and changing the order of performing the behavior items based on the received input.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 4, 2019
From: SASAKI, AKIRA; ANDO, EISUKE; HAYASHIMA, MISAKO; KITOH, SAKI; YAMASHITA, MASAHIRO
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 048233/0677 →
Priority Claims (1)
JP JP2018-019561 · Feb 6, 2018 · national
Continuity (1)
Related Publication 20190241193A1 · Aug 8, 2019