IP Library Granted Patent US 12686402
Granted Patent B2
US 12686402 · App. 18/253,733 · Granted Jul 21, 2026

Information processing device, information processing system, and information processing method

Inventors: Yifu Tang (Tokyo, JP); Shinichiro Tsuda (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
B60W50/14B60W40/08B60W2050/143B60W2050/146B60W2556/45
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12686402
App. No.
18/253,733
Granted
Jul 21, 2026
Kind
B2
Abstract

Provided is a control unit that acquires an automated driving level-corresponding allowable activity list in which the automated driving level and the allowable activity are associated with each other from an external server or a storage unit, refers to the automated driving level-corresponding allowable activity list, acquires the allowable activity corresponding to the automated driving level, and notifies the driver of the acquired allowable activity. Furthermore, in a case where the automated driving level of the mobile device is changed, a difference between the allowable activities according to the change of the automated driving level is analyzed, and in a case where there is a difference, notification of difference information is provided.

Claims (84)

1 . An information processing device, comprising:

a control unit configured to:

acquire a first automated driving level of an automated driving process executed by a mobile device, wherein

the first automated driving level corresponds to a first set of allowable activities associated with a driver of the mobile device;

control output of a first notification to the driver based on the acquired first automated driving level, wherein the first notification indicates the first set of allowable activities;

detect a change of the first automated driving level to a second automated driving level, wherein

the second automated driving level corresponds to a second set of allowable activities different from the first set of allowable activities;

determine a difference between the first set of allowable activities and the second set of allowable activities based on the change of the first automated driving level to the second automated driving level; and

control output of a second notification, to the driver, based on the difference.

2 . The information processing device according to claim 1 , wherein the control unit is further configured to control one of

a display unit to display the first set of allowable activities, or

a voice output unit to output voice associated with the first set of allowable activities.

3 . The information processing device according to claim 1 , wherein

the control unit is further configured to acquire the first set of allowable activities based on an automated driving level-corresponding allowable activity list,

the automated driving level-corresponding allowable activity list includes a plurality of automated driving levels and a plurality of allowable activities,

the plurality of automated driving levels includes the first automated driving level and the second automated driving level,

the plurality of allowable activities includes the first set of allowable activities and the second set of allowable activities, and

each of the plurality of automated driving levels corresponds to a respective set of allowable activities of the plurality of allowable activities.

4 . The information processing device according to claim 3 , wherein the control unit is further configured to:

acquire, from one of an external server or a storage unit, the first set of allowable activities based on the automated driving level-corresponding allowable activity list; and

control the output of the first notification to the driver based on the acquired first set of allowable activities.

5 . The information processing device according to claim 1 , wherein the control unit is further configured to:

generate display data that includes the difference information; and

control a display unit to output the display data.

6 . The information processing device according to claim 1 , wherein the control unit is further configured to:

determine difference information based on the difference between the first set of allowable activities and the second set ofallowable activities;

detect a decrement of the first automated driving level to a third automated driving level;

delete, based on the decrement, a specific allowable activity from the first set of allowable activities;

generate display data that indicates the deletion of the specific allowable activity from the first set of allowable activities; and

control a display unit to output the display data.

7 . The information processing device according to claim 1 , wherein the control unit is further configured to:

determine, based on the first notification, one of a presence of a check response from the driver or an absence of the check response from the driver; and

execute an emergency response process based on the absence of the check response from the driver.

8 . The information processing device according to claim 7 , wherein the control unit is further configured to stop the mobile device in the emergency response process.

9 . The information processing device according to claim 1 , wherein the control unit is further configured to:

determine an activity of the driver based on sensor detection information;

determine the determined activity of the driver is different from the first set of allowable activities; and

execute an emergency response process based on the determination that the determined activity of the driver is different from the first set of allowable activities.

10 . The information processing device according to claim 9 , wherein the control unit is further configured to stop the mobile device in the emergency response process.

11 . The information processing device according to claim 1 , wherein the control unit is further configured to:

acquire specific information from at least one of a storage unit, a sensor of the mobile device, an external server, a base station, or a roadside communication unit; and

specify the first automated driving level based on the acquired specific information.

12 . The information processing device according to claim 1 , wherein the control unit is further configured to:

acquire map information from a map information provision server:

determine, based on the map information, automated driving allowable level information for each road section of a plurality of road sections; and

specify the first automated driving level based on the automated driving allowable level information.

13 . The information processing device according to claim 1 , wherein the control unit is further configured to:

acquire, from the driver, a request that indicates a specific action; and

control output of a third notification to the driver, wherein the third notification indicates one of

the specific action corresponds to an allowable activity of the first set of allowable activities, or

the specific action is different from the first set of allowable activities.

14 . The information processing device according to claim 1 , wherein the control unit is further configured to:

determine a duration for which the mobile device executes the first automated driving level;

determine a non-recommended activity based on the determined duration; and

control output of a third notification, to the driver, that indicates the determined non-recommended activity.

15 . The information processing device according to claim 1 , wherein the control unit is further configured to:

determine a duration for which the mobile device executes the first automated driving level;

determine at least one of a recommended activity or a non-recommended activity based on the determined duration; and

control output of a third notification, to the driver, that indicates the at least one of the recommended activity or the non-recommended activity.

16 . An information processing system, comprising:

a mobile device configured to:

execute an automated driving process; and

acquire a first automated driving level of the automated driving process; and

a control device configured to:

provide an automated driving level-corresponding allowable activity list to the mobile device, wherein the automated driving level-corresponding allowable activity list includes a plurality of automated driving levels and a plurality of allowable activities;

acquire a first set of allowable activities of the plurality of allowable activities corresponding to the first automated driving level of the mobile device, wherein

the first set of allowable activities is associated with a driver of the mobile device, and

the plurality of automated driving levels includes the first automated driving level; and

control output of a first notification to the driver based on the acquired first automated driving level, wherein the first notification indicates the first set of allowable activities;

detect a change of the first automated driving level to a second automated driving level of the plurality of automated driving levels, wherein

the second automated driving level corresponds to a second set of allowable activities of the plurality of allowable activities, and

the second set of allowable activities is different from the first set of allowable activities;

determine a difference between the first set of allowable activities and the second set of allowable activities based on the change of the first automated driving level to the second automated driving level; and

control output of a second notification, to the driver, based on the difference.

17 . The information processing system according to claim 16 , wherein the mobile device is further configured to acquire the first automated driving level from the control device.

18 . An information processing method comprising:

in an information processing device:

acquiring a first automated driving level of an automated driving process executed by a mobile device, wherein

the first automated driving level corresponds to a first set of allowable activities associated with a driver of the mobile device:

controlling output of a first notification to the driver based on the acquired first automated driving level, wherein the first notification indicates the first set of allowable activities;

detecting a change of the first automated driving level to a second automated driving level, wherein

the second automated driving level corresponds to a second set of allowable activities different from the first set of allowable activities;

determining a difference between the first set of allowable activities and the second set of allowable activities based on the change of the first automated driving level to the second automated driving level; and

controlling output of a second notification, to the driver, based on the difference.