IP Library Granted Patent US 12,728,869
Granted Patent B2
US 12,728,869 · App. 18/016,008 · Granted Sep 8, 2026

Information processing that excludes personal information from metadata

Inventors: Atsuro Kobayashi (Kanagawa, JP); Eiji Oba (Tokyo, JP)
Assignee: Sony Semiconductor Solutions Corporation
B60W40/08B60W60/0015B60W60/0059B60W2540/043
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,728,869
App. No.
18/016,008
Filed
Jan 13, 2023
Granted
Sep 8, 2026
Kind
B2
Art Unit
3662
USPC
701/1
Abstract

Information processing that protects personal information is disclosed. In one example, an information processing apparatus includes a metadata generation unit that generates metadata from information indicating a state of an occupant riding in a mobile body, the information being obtained from a sensor provided in the mobile body. A first encryption unit encrypts the generated metadata, and a first recording unit stores the encrypted metadata.

Claims (48)

1 . An information processing apparatus comprising:

a memory storing a program, and

at least one processor configured to execute the program to perform operations comprising:

generating metadata by electronically processing sensor-obtained information indicating a state of an occupant riding a mobile body, the metadata being generated by abstracting the information to include an action of the occupant and exclude personal information of the occupant;

performing a first encryption that encrypts the generated metadata using a first common key associated with the occupant; and

storing the metadata encrypted using the first common key;

wherein the information includes at least a moving image of the occupant;

wherein the metadata includes information for generation of at least one of a moving image of an avatar or a moving image of a skeleton model while omitting personal identifiers of the occupant; and

performing a second encryption to encrypt the sensor-obtained information using both the first common key and a second common key supplied by the occupant, such that the encrypted sensor-obtained information is accessible only upon provision of both the first common key and the second common key.

2 . The information processing apparatus according to claim 1 , wherein the first common key includes at least one of information of a driver's license associated with the occupant, identification information associated with the occupant, identification information associated with a terminal carried by the occupant, or biological information of the occupant.

3 . The information processing apparatus according to claim 1 , wherein the operations further comprise receiving an input of the second common key from the occupant.

4 . The information processing apparatus according to claim 1 , wherein the operations further comprise:

outputting data in association with at least one of data identification information, occupant identification information, or date and time information.

5 . The information processing apparatus according to claim 1 , wherein a steering mode of the mobile body is switchable between an automatic driving mode and a manual driving mode by a driver.

6 . The information processing apparatus according to claim 5 , wherein the information includes at least one of information of a position, a posture, an action, a line of sight, an arousal level, or an alcohol level of the occupant.

7 . The information processing apparatus according to claim 6 , wherein the operations further comprise:

determining an automatic driving level allowed for the mobile body; and

outputting data in association with a determination result.

8 . The information processing apparatus according to claim 7 , wherein the operations further comprise:

determining the automatic driving level based on at least one of flight design area information, a local dynamic map, performance information of the mobile body, weather, or surrounding information of the mobile body.

9 . The information processing apparatus according to claim 1 , wherein the metadata includes information for generation of the moving image of the avatar, and a face of the occupant in the avatar is obscured in a display of the avatar.

10 . The information processing apparatus according to claim 1 , wherein the operations further comprise:

performing machine learning to develop a model that correlates actions to violations, and to apply the information that includes the action of the occupant to determine a violation probability for the occupant; and

prompting a notification to the occupant regarding the violation probability.

11 . A non-transitory computer readable medium storing a program, the program being executable by at least one processor to perform operations comprising:

generating metadata by electronically processing sensor-obtained information indicating a state of an occupant riding a mobile body, the metadata being generated by abstracting the information to include an action of the occupant and exclude personal information of the occupant;

performing a first encryption that encrypts the generated metadata using a first common key associated with the occupant; and

storing the metadata encrypted using the first common key:

wherein the information includes at least a moving image of the occupant;

wherein the metadata includes information for generation of at least one of a moving image of an avatar or a moving image of a skeleton model while omitting personal identifiers of the occupant; and

performing a second encryption to encrypt the sensor-obtained information using both the first common key and a second common key supplied by the occupant, such that the encrypted sensor-obtained information is accessible only upon provision of both the first common key and the second common key.

12 . The non-transitory computer readable medium according to claim 11 , wherein the operations further comprise:

receiving an input of the second common key from the occupant.

13 . The non-transitory computer readable medium according to claim 11 ,

wherein the operations further comprise:

performing machine learning to develop a model that correlates actions to violations, and to apply the information that includes the action of the occupant to determine a violation probability for the occupant; and

notifying the occupant regarding the violation probability.

14 . The non-transitory computer readable medium according to claim 11 , wherein the first common key includes at least one of information of a driver's license associated with the occupant, identification information associated with the occupant, identification information associated with a terminal carried by the occupant, or biological information of the occupant.

15 . The non-transitory computer readable medium according to claim 11 , wherein the operations further comprise:

outputting data in association with at least one of data identification information, occupant identification information, or date and time information.

16 . The non-transitory computer readable medium according to claim 11 , wherein a steering mode of the mobile body is switchable between an automatic driving mode and a manual driving mode by a driver.

17 . The non-transitory computer readable medium according to claim 11 , wherein the information includes at least one of information of a position, a posture, an action, a line of sight, an arousal level, or an alcohol level of the occupant.

18 . The non-transitory computer readable medium according to claim 17 , wherein the operations further comprise:

determining an automatic driving level allowed for the mobile body; and

outputting data in association with a determination result.

19 . The non-transitory computer readable medium according to claim 18 , wherein the operations further comprise:

determining the automatic driving level based on at least one of flight design area information, a local dynamic map, performance information of the mobile body, weather, or surrounding information of the mobile body.

20 . The non-transitory computer readable medium according to claim 11 , wherein the metadata includes information for generation of the moving image of the avatar, and a face of the occupant in the avatar is obscured in a display of the avatar.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2023
From: KOBAYASHI, ATSURO; OBA, EIJI
To: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
Reel/Frame 062369/0324 →
Priority Claims (1)
JP 2020-149908 · Sep 7, 2020 · national
Continuity (1)
Related Publication 20230182747A1 · Jun 15, 2023
References Cited (20)
US 9242619B2 · Choi · 2016 [cited by examiner]
US 10607027B1 · Ben Naim · 2020 [cited by examiner]
US 10630648B1 · Borunda · 2020 [cited by examiner]
US 11854274B2 · Fukuhara · 2023 [cited by examiner]
US 20120047365A1 · Mercer · 2012 [cited by examiner]
US 20140032089A1 · Aoude · 2014 [cited by examiner]
US 20150172056A1 · Meunier · 2015 [cited by examiner]
US 20180218452A1 · Guensler · 2018 [cited by examiner]
US 20190012755A1 · Williams · 2019 [cited by examiner]
US 20190086916A1 · Choi · 2019 [cited by examiner]
US 20190165949A1 · Ramos · 2019 [cited by examiner]
US 20200043326A1 · Tao · 2020 [cited by examiner]
US 20210370879A1 · Julian · 2021 [cited by examiner]
US 20220027501A1 · Kusko · 2022 [cited by examiner]
CN 111145389A · 2020 [cited by examiner]
JP 2017174111A · 2017 [cited by applicant]
JP 2019197342A · 2019 [cited by applicant]
Zajic; Goran et al., Video-based Assistance for Autonomous Driving, 2020, 2020 Zooming Innovation in Consumer Technologies, IEEE, pp. 151-154 (Year: 2020). [cited by examiner]
International Search Report (PCT/ISA/210), International Application No. PCT/JP2021/030810, dated Nov. 22, 2021. [cited by applicant]
Zajic Goran et al: “Video-based Assistance for Autonomous Driving”, 2020 Zooming Innovation in Consumer Technologies Conference (ZINC), IEEE, May 26, 2020 (May 26, 2020), pp. 151-154, XP033802387. [cited by applicant]