IP Library › Granted Patent US 12,122,322
Granted Patent B2
US 12,122,322 · App. 17/329,502 · Granted Oct 22, 2024

Vehicle control system, server, and vehicle control method

Inventors: Ryo Morosawa (Tokyo, JP); Haisong Liu (Tokyo, JP); Akira Nakajima (Tokyo, JP); Kenji Okuma (Tokyo, JP); Hiroaki Maruyama (Tokyo, JP); Yoshikazu Matsuo (Tokyo, JP); Shuto Higashi (Tokyo, JP); Fumiaki Yamaguchi (Tokyo, JP)
Assignee: HONDA MOTOR CO., LTD.
B60R25/01B60R25/20B60R25/31E05F15/73E05F15/76G06V20/56G06V20/59G06V40/28B60R25/305E05B81/64E05F2015/767E05Y2400/45E05Y2400/66E05Y2400/85E05Y2900/531
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,122,322
App. No.
17/329,502
Granted
Oct 22, 2024
Kind
B2
Abstract

The present invention includes: a vehicle exterior image acquisition unit acquiring a vehicle exterior image, a vehicle interior image acquisition unit acquiring a vehicle interior image, a person recognition unit recognizing, based on the vehicle exterior and interior images, a presence of a person in the vehicle and a motion of a person outside the vehicle, a door control unit controlling a state of a door of the vehicle, and a motion determination unit determining a specific motion to be carried out when the person outside the vehicle instructs an opening operation of the door, wherein the door control unit executes the opening operation when the person outside the vehicle has performed the specific motion, if the presence of a person in the vehicle has been recognized based on a recognition result of the person recognition unit.

Claims (28)

1. A vehicle control system comprising a processor and a memory, wherein the processor:

acquires a vehicle exterior image, which is an image of an external surrounding of a vehicle;

acquires a vehicle interior image, which is an image of an interior of the vehicle;

recognizes, based on the vehicle exterior image and the vehicle interior image, a presence of a person in the vehicle and a motion of a person outside the vehicle;

controls a state of a door of the vehicle;

recognizes an arrival of a predetermined timing and updates, at the predetermined timing, a specific motion to be performed by the person outside the vehicle when instructing an opening operation of the door, the specific motion being a specific movement of fingers or a specific gesture using a body; and

distributes motion information indicating the specific motion as updated to a first terminal device of a registered user who has been registered in advance as a user of the vehicle and a second user terminal device of a specific permitted user who has been recorded, in the memory, in advance, as a person having a specific relationship to the registered user,

wherein the processor executes the opening operation on the door when the person outside the vehicle has performed the specific motion as updated if the presence of the person in the vehicle has been recognized based on a recognition result of the person motion of the person outside the vehicle.

2. The vehicle control system according to claim 1 , wherein

the memory stores user information including information on the registered user and terminal information regarding the second terminal device of the specific permitted user, and

the processor identifies the registered user based on the user information.

3. The vehicle control system according to claim 1 wherein the processor includes

provides, through near-field wireless communication, the motion information to a third terminal device located outside the vehicle, and

when communication has been established with the third terminal device approaching the vehicle, the motion information providing unit transmits the motion information to the third terminal device.

4. The vehicle control system according to claim 1 , wherein the processor-includes:

provides, through near-field wireless communication, the motion information to a third terminal device located outside the vehicle;

identifies the registered user; and

transmits the motion information to the third terminal device in response to receiving a request from the third terminal device, on a condition that the presence of the person in the vehicle who is the registered user has been recognized based on the recognition result of the motion of the person outside the vehicle.

5. The vehicle control system according to claim 1 , wherein the opening operation comprises an automatic operation of opening the door, or setting the door to be openable from outside the vehicle.

6. A server comprising the processor, the server being communicably connected to an onboard device of the vehicle to constitute the vehicle control system according to claim 1 .

7. A vehicle control method executed by a computer performing vehicle control, the method comprising the steps of:

acquiring a vehicle exterior image, which is an image of an external surrounding of a vehicle;

acquiring a vehicle interior image, which is an image of an interior of the vehicle;

recognizing, based on the vehicle exterior image and the vehicle interior image, a motion of a person outside the vehicle and a presence of a person inside the vehicle;

controlling a state of a door of the vehicle;

recognizing an arrival of a predetermined timing and updating, at the predetermined timing, a specific motion to be performed by the person outside the vehicle when instructing an opening operation of the door, the specific motion being a specific movement of fingers or a specific gesture using a body;

distributing motion information indicating the specific motion as updated to a first terminal device of a registered user who has been registered in advance as an user of the vehicle and a second user terminal device of a specific permitted user who has been recorded, in a memory, as a person having a specific relationship to the registered user in advance,

wherein at the step of controlling, the opening operation of the door is executed when the person outside the vehicle has performed the specific motion as updated, if the presence of the person in the vehicle has been recognized based on a recognition result of the motion of the person outside the vehicle in the step of recognizing.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 1, 2021
From: MOROSAWA, RYO; LIU, HAISONG; NAKAJIMA, AKIRA; OKUMA, KENJI; MARUYAMA, HIROAKI; MATSUO, YOSHIKAZU; HIGASHI, SHUTO; YAMAGUCHI, FUMIAKI
To: HONDA MOTOR CO., LTD.
Reel/Frame 057394/0153 →
Priority Claims (1)
JP 2020-092521 · May 27, 2020 · national
Continuity (1)
Related Publication 20210370867A1 · Dec 2, 2021
Cited By (1)
US 12,589,654