IP Library Granted Patent US 12,659,691
Granted Patent B2
US 12,659,691 · App. 18/480,065 · Granted Jun 16, 2026

Information processing device for restricting operation of application by operator

Inventors: Hideki Kobayashi (Miyoshi, JP); Yasuhiro Miura (Owariasahi, JP); Kuka Ishiyama (Musashino, JP); Koji Aikawa (Nagoya, JP); Tadahiro Nishikawa (Nisshin, JP); Yuji Ota (Kariya, JP); Motoki Maekawa (Nagakute, JP); Yasuhiro Ishiguro (Nisshin, JP)
Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
H04W4/025B60W50/14B60W60/001G06V10/70G06V20/593B60K35/29B60K35/80B60K2360/195B60K2360/33B60K2360/569B60W2050/146B60W2540/227
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,659,691
App. No.
18/480,065
Granted
Jun 16, 2026
Kind
B2
Abstract

The mobile device is provided with an operation restriction unit, and the operation restriction unit determines which seat of the vehicle is being operated from the captured image of the back camera. When determining that the captured image is captured by the driver's seat, the operation restriction unit restricts the operation of the process execution unit. Accordingly, in the mobile device, it is possible to prevent the mobile device from being operated in the driver's seat, which is appropriately restricted from being operated in the driver's seat in a vehicle or the like.

Claims (50)

1 . An information processing device comprising:

a processor provided in a housing;

a display configured to receive an operation of application software by an operator; and

a camera disposed in the housing and configured to capture first images of an area surrounding the housing,

wherein the processor is configured to

execute a process of the application software in response to the received operation,

cause the display to display a second image associated with the executed process,

determine whether the operator sits on a driver's seat of a vehicle based on the first images based on a model trained using machine learning with features extracted from the first images, the features including respective components in a vehicle cabin of the vehicle, positions of the respective components, and directions of the respective components, and

restrict the process of the application software in a case where the processor determines that the operator sits on the driver's seat based on the first images;

a first sensor configured to detect a movement speed of the information processing device that moves,

wherein:

the display is further configured to display the second image as content of the application software; and

the process of the application software is executed by acquiring the movement speed of the information processing device from the first sensor and by changing the second image in accordance with the movement speed of the information processing device.

2 . The information processing device according to claim 1 , wherein:

the display is a touch panel attached to one surface of the housing, the touch panel including an operation surface and a display surface; and

the camera is configured to capture the first images in a direction opposite to a direction of the one surface of the housing.

3 . The information processing device according to claim 1 , wherein the process of the application software is restricted by restricting the display of the second image on the display.

4 . The information processing device according to claim 1 , wherein the process of the application software is restricted by stopping reception of the operation on the display.

5 . The information processing device according to claim 4 , wherein:

the display includes a second sensor configured to detect a touch operation by the operator on the display;

the processor is further configured to acquire a signal of the touch operation from the second sensor; and

the process of the application software is restricted by stopping reading the signal.

6 . The information processing device according to claim 1 , wherein:

the display is configured to display the second image by transmitting light of a backlight; and

the process of the application software is restricted by turning OFF the backlight of the display.

7 . The information processing device according to claim 1 , further comprising a first sensor configured to detect a movement speed of the information processing device that moves,

wherein the processor is further configured to

acquire the movement speed of the information processing device from the first sensor,

determine whether the movement speed of the information processing device is less than a preset threshold value, and

continue to execute the process of the application software in a case where the processor determines that the movement speed of the information processing device is less than the preset threshold value.

8 . The information processing device according to claim 1 , wherein:

the vehicle is configured to perform autonomous driving in which the vehicle is controlled to travel without a driving operation of an occupant; and

the processor is further configured to

determine whether the vehicle is performing the autonomous driving, and

continue to execute the process of the application software in a case where the processor determines that the vehicle is performing the autonomous driving.

9 . The information processing device according to claim 1 , wherein the information processing device is a smart phone.

10 . The information processing device according to claim 1 , wherein the second image is content of the application software.

11 . The information processing device according to claim 4 , wherein the processor is further configured to pause the execution of the process of the application software.

12 . An information processing device comprising:

a processor provided in a housing;

a display configured to receive an operation of application software by an operator; and

a camera disposed in the housing and configured to capture first images of an area surrounding the housing,

wherein the processor is configured to

execute a process of the application software in response to the received operation,

cause the display to display a second image associated with the executed process,

determine whether the operator sits on a driver's seat of a vehicle based on the first images based on a model trained using machine learning with features extracted from the first images, the features including respective components in a vehicle cabin of the vehicle, positions of the respective components, and directions of the respective components, and

restrict the process of the application software in a case where the processor determines that the operator sits on the driver's seat based on the first images;

a first sensor configured to detect a movement speed of the information processing device that moves; and

a speaker configured to output sound as content of the application software,

wherein the process of the application software is executed by acquiring the movement speed of the information processing device from the first sensor and by changing the sound in accordance with the movement speed of the information processing device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2023
From: KOBAYASHI, HIDEKI; MIURA, YASUHIRO; ISHIYAMA, KUKA; AIKAWA, KOJI; NISHIKAWA, TADAHIRO; OTA, YUJI; MAEKAWA, MOTOKI; ISHIGURO, YASUHIRO
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 065107/0432 →
Priority Claims (1)
JP 2023-003749 · Jan 13, 2023 · national
Continuity (1)
Related Publication 20240239192A1 · Jul 18, 2024
References Cited (33)
US 11393238B1 · Kentley-Klay · 2022 [cited by examiner]
US 11801858B1 · Kuehnle · 2023 [cited by examiner]
US 20060209072A1 · Jairam · 2006 [cited by examiner]
US 20070185644A1 · Hirose · 2007 [cited by examiner]
US 20080133122A1 · Mashitani · 2008 [cited by examiner]
US 20140256303A1 · Jones · 2014 [cited by examiner]
US 20170083777A1 · Arata · 2017 [cited by examiner]
US 20180319407A1 · Lisseman · 2018 [cited by examiner]
US 20190192055A1 · Mizobuchi · 2019 [cited by examiner]
US 20190299895A1 · Herbert · 2019 [cited by examiner]
US 20190329791A1 · Oba · 2019 [cited by examiner]
US 20200059550A1 · Nomura et al. · 2020 [cited by applicant]
US 20200098128A1 · Fujii · 2020 [cited by examiner]
US 20210053440A1 · Okuma · 2021 [cited by examiner]
US 20210188289A1 · Oba · 2021 [cited by examiner]
US 20210188324A1 · Kim · 2021 [cited by examiner]
US 20210286357A1 · Oba · 2021 [cited by examiner]
US 20220219717A1 · Lv · 2022 [cited by examiner]
US 20220289250A1 · Oba · 2022 [cited by examiner]
US 20230001948A1 · Hayashi · 2023 [cited by examiner]
US 20230018303A1 · Itou · 2023 [cited by examiner]
US 20230030288A1 · Matsumoto · 2023 [cited by examiner]
US 20230100504A1 · Kuzu · 2023 [cited by examiner]
US 20230252117A1 · Guo · 2023 [cited by examiner]
US 20240034362A1 · Oba · 2024 [cited by examiner]
US 20240369867A1 · Moll · 2024 [cited by examiner]
JP 2016509763A · 2016 [cited by applicant]
JP 2019182013A · 2019 [cited by applicant]
JP 2022044602A · 2022 [cited by applicant]
JP 2022051084A · 2022 [cited by applicant]
WO 2014074544A1 · 2014 [cited by applicant]
WO 2017154208A1 · 2017 [cited by applicant]
WO 2018220852A1 · 2018 [cited by applicant]