IP Library › Granted Patent US 12,454,273
Granted Patent B2
US 12,454,273 · App. 18/030,319 · Granted Oct 28, 2025

Information processing device and information processing method

Inventors: Yusuke Morita (Kanagawa, JP); Tomokazu Furuya (Kanagawa, JP)
Assignee: Nissan Motor Co., Ltd.
B60W50/0098B60K35/10B60W50/14B60K35/26B60K2360/149B60W2050/143B60W2050/146B60W2540/21B60W2540/225
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,454,273
App. No.
18/030,319
Granted
Oct 28, 2025
Kind
B2
Abstract

An information processing device and an information processing method each perform specifying a target apparatus to be operated from a plurality of apparatuses based on line-of-sight data pertaining to a user's line of sight direction. After the target apparatus is specified, voice data is acquired to generate a control command for the target apparatus to be operated during a predetermined time span. Finally, the target apparatus to be operated is controlled.

Claims (34)

1 . An information-processing device comprising:

a line-of-sight-detecting device including a camera;

a voice-recognizing device including a microphone; and

a controller connected to the line-of-sight detecting device and the voice-recognizing device,

the controller being configured to

receive line-of-sight data from the line-of-sight-detecting device, the line-of-sight data pertaining to a user's line of sight,

specify a target apparatus to be operated among a plurality of apparatuses based on the line-of-sight data,

determine whether voice data has been inputted from the voice-recognizing device during a predetermined time span after specifying the target apparatus to be operated,

upon determining that the voice data has been inputted, acquire the voice data to generate a control command directed at the target apparatus to be operated,

transmit the control command to the target apparatus to be operated,

determine whether a predetermined time span has elapsed since the target apparatus to be operated was specified, and

cancel the target apparatus to be operated upon determining that the predetermined time span has elapsed and the voice data has not been inputted.

2 . The information-processing device according to claim 1 , wherein

the controller is configured to specify the apparatus positioned in the line-of-sight direction as the target apparatus to be operated.

3 . The information-processing device according to claim 1 , wherein

the controller is configured to calculate a frequency with which the apparatus is positioned in the line-of-sight direction, and is configured to specify the target apparatus to be operated based on the frequency.

4 . The information-processing device according to claim 1 , wherein

the controller is configured to calculate a time span in which the apparatus is positioned in the line-of-sight direction, and is configured to specify the apparatus as the target apparatus to be operated based on the time span.

5 . The information-processing device according to claim 1 , wherein

the controller is configured to cancel the target apparatus to be operated when the voice data has been inputted but the control command cannot be generated based on the voice data during the predetermined time span.

6 . The information-processing device according to claim 1 , further comprising

a notification unit configured to issue a notification by sound or light during the predetermined time span, the notification unit including at least one of a speaker, a lamp, or a display.

7 . The information-processing device according to claim 1 , wherein

the target apparatus to be operated includes at least one of the following: a navigation apparatus, a door-lock-controlling apparatus, a window opening/closing control apparatus, a captured image display apparatus, a meter display apparatus, an air-conditioning device, a sunroof, a sunshade, and an audio device.

8 . The information-processing device according to claim 1 , wherein

the control command is to enlarge, reduce, rotate, or move an image displayed on the target apparatus to be operated, or to unlock or lock the target apparatus to be operated.

9 . The information-processing device according to claim 1 , wherein

the voice data is data used to enlarge, reduce, rotate, or move an image displayed on the target apparatus to be operated, or unlock or lock the target apparatus to be operated.

10 . An information-processing method comprising:

specifying a target apparatus to be operated among a plurality of apparatuses based on line-of-sight data pertaining to a user's line of sight direction that is acquired by a line-of-sight-detecting device including a camera;

determining whether a predetermined time span has elapsed since the target apparatus to be operated was specified;

acquiring voice data inputted to a voice-recognizing device including a microphone to generate a control command for the target apparatus to be operated during the predetermined time span;

transmitting the control command to the target apparatus to be operated; and

canceling the target apparatus to be operated upon determining that the predetermined time span has elapsed and the voice data has not been inputted.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE THE CITY OF THE RECEIVING PARTY PREVIOUSLY RECORDED AT REEL: 063227 FRAME: 0937. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 7, 2023
From: MORITA, YUSUKE; FURUYA, TOMOKAZU
To: NISSAN MOTOR CO., LTD.
Reel/Frame 063355/0138 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 5, 2023
From: MORITA, YUSUKE; FURUYA, TOMOKAZU
To: NISSAN MOTOR CO., LTD.
Reel/Frame 063227/0937 →
Continuity (1)
Related Publication 20230365141A1 · Nov 16, 2023
References Cited (14)
US 9824689B1 · Shapiro · 2017 [cited by examiner]
US 10185534B2 · Kanda et al. · 2019 [cited by applicant]
US 20160373269A1 · Okubo et al. · 2016 [cited by applicant]
JP 2015231518A · 2015 [cited by applicant]
JP 2017009867A · 2017 [cited by applicant]
JP 2017159692A · 2017 [cited by applicant]
WO WO2007105792A1 · 2007 [cited by examiner]
WO 2017072956A1 · 2017 [cited by applicant]
WO 2017081960A1 · 2017 [cited by applicant]
WO WO2019142295A1 · 2019 [cited by examiner]
English translation of WO 2007105792 A1 (Year: 2007). [cited by examiner]
English translation of WO 2019142295 A1 (Year: 2019). [cited by examiner]
Japanese Office Action of Mar. 26, 2024 of corresponding Japanese Patent Application No. 2022-557210. [cited by applicant]
Extended European Search Report of Nov. 17, 2023 of corresponding European Patent Application No. 20958583.5. [cited by applicant]