IP Library › Granted Patent US 12,407,661
Granted Patent B2
US 12,407,661 · App. 18/247,688 · Granted Sep 2, 2025

Information processing device, mobile device, and communication system

Inventors: Takashi Miyamoto (Kanagawa, JP); Hiroo Takahashi (Kanagawa, JP)
Assignee: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
H04L63/0485G06T7/0002H04L43/10H04L43/16H04L65/1069H04L65/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,407,661
App. No.
18/247,688
Filed
Apr 3, 2023
Granted
Sep 2, 2025
Kind
B2
Art Unit
2184
USPC
710/66
Abstract

The present disclosure relates to an information processing device, a mobile device, and a communication system for enabling further enhancement of safety. When communication is performed with another information processing device to perform high-speed data transmission of transmitting data of a frame including image data, an extended packet including an extended packet header and packet data, and a unique message capable of notifying that at least one of an information processing device, the another information processing device, or the image data is in a state different from a normal time or a usual time are transmitted to the another information processing device or received from the another information processing device, a session key is derived and at least one of generation, verification, or decryption of protection data of the unique message is executed, the image data is stored in the packet data, and the image data and the unique message are transmitted at different timings via a part or whole of a common communication path regarding the communication. The present technology can be applied to, for example, a communication system conforming to an MIPI standard.

Claims (98)

1. An information processing device, comprising:

a communication unit configured to one of:

transmit transmitting data of a frame to an another information processing device; or

receive the transmitting data from the another information processing device based on communication with the another information processing device to perform high-speed data transmission of the transmitting data, wherein the transmitting data includes:

image data in a specific direction between the information processing device and the another information processing device,

an extended packet including an extended packet header and packet data, and

a unique message that notifies at least one of the information processing device or the another information processing device that the image data is in a state different from a normal time or a usual time; and

a protection unit configured to:

derive a session key; and

execute at least one of generation, verification, or decryption of protection data of the unique message, wherein

the image data is stored in the packet data, and

the image data and the unique message are transmitted at different timings through one of a part or whole of a communication path regarding the communication.

2. The information processing device according to claim 1 , wherein

the communication unit is further configured to one of transmit or receive low-speed command transmission in a reverse direction to the specific direction regarding the high-speed data transmission,

the high-speed data transmission is faster than the low-speed command transmission,

at least one of a transmission of a frame start indicating that the frame is started or a transmission of a frame end indicating that the frame is ended is performed,

a plurality of the frames is continuously and periodically transmittable, and

the frame includes frame blanking in which the image data is not transmitted between the frame end and the frame start.

3. The information processing device according to claim 2 , wherein

the low-speed command transmission includes transmission of a write instruction and a read instruction,

the write instruction requests one of the information processing device or the another information processing device to write information,

the read instruction requests one of the information processing device or the another information processing device to read information, or a read response based on the read instruction, and

the unique message is transmitted as one of the write instruction, the read instruction, or the read response within a period of the frame blanking.

4. The information processing device according to claim 2 , wherein

the frame includes embedded data that is transmitted by the high-speed data transmission within a period between the frame start and the frame end,

the embedded data includes metadata related to the image data, and

the unique message is stored in the embedded data.

5. The information processing device according to claim 2 , wherein

the low-speed command transmission includes transmission of a write instruction and a read instruction,

the write instruction requests one of the information processing device or the another information processing device to write information,

the read instruction requests one of the information processing device or the another information processing device to read information, or a read response based on the read instruction,

the frame includes line blanking in which the image data is not transmitted between the frame start and the frame end, and

the unique message is transmitted as one of the write instruction, the read instruction, or the read response within a period of the line blanking.

6. The information processing device according to claim 2 , wherein the unique message is stored inside the frame start or inside the frame end.

7. The information processing device according to claim 1 , wherein

the frame includes data of a second virtual channel different from the image data that is a first virtual channel, and

the unique message is stored in the data of the second virtual channel.

8. The information processing device according to claim 1 , wherein

the extended packet further includes an extended packet footer,

the unique message is stored in the extended packet header in the extended packet in which the image data is stored, and

the protection data is stored in the extended packet footer in the extended packet in which the image data is stored.

9. The information processing device according to claim 1 , wherein

the communication unit includes transmission or reception of a HEARTBEAT request or a pseudo-HEARTBEAT request,

the reception or the transmission of a HEARTBEAT_ACK response or a pseudo-HEARTBEAT_ACK response within a specific time is based on the HEARTBEAT request or the pseudo-HEARTBEAT request, and

one of the information processing device or the another information processing device transmits the unique message to a partner of the communication within the specific time.

10. The information processing device according to claim 1 , wherein

the communication unit includes transmission or reception of a HEARTBEAT request or a pseudo-HEARTBEAT request,

the reception or the transmission of a HEARTBEAT_ACK response or a pseudo-HEARTBEAT_ACK response within a specific time is based on the HEARTBEAT request or the pseudo-HEARTBEAT request, and

the communication unit is further configured to stop the transmission of the HEARTBEAT_ACK response or the pseudo-HEARTBEAT_ACK response based on the HEARTBEAT request or the pseudo-HEARTBEAT request is not normally received.

11. The information processing device according to claim 10 , wherein

a bit flag indicates non-support of the HEARTBEAT request,

the HEARTBEAT_ACK response is set in at least one of the information processing device or the another information processing device, and

the communication unit includes:

the transmission or the reception of the pseudo-HEARTBEAT request, and

the reception or the transmission of the pseudo-HEARTBEAT_ACK response within the specific time is based on the pseudo-HEARTBEAT request.

12. The information processing device according to claim 1 , further comprising:

a pixel configured to capture or display the image data; and

an interference detection unit configured to detect one of presence or absence of an interference or a possibility of the interference with the pixel or the image data, wherein the unique message is a message related to a detection result of the interference detection unit.

13. The information processing device according to claim 1 , further comprising

an obstacle detection unit configured to detect one of presence or absence of an obstacle or a possibility of the obstacle with respect to the communication path, wherein the unique message is a message related to a detection result of the obstacle detection unit.

14. The information processing device according to claim 1 , further comprising

an invasion detection unit configured to detect one of presence or absence of an invasion or a possibility of the invasion with respect to the protection unit, wherein the unique message is a message related to a detection result of the invasion detection unit.

15. The information processing device according to claim 1 , further comprising

a temperature detection unit configured to detect an internal temperature of the information processing device, wherein the unique message is a message related to a detection result of the temperature detection unit.

16. The information processing device according to claim 1 , wherein the high-speed data transmission is stopped by the information processing device after the unique message satisfies a specific stop condition.

17. The information processing device according to claim 1 , wherein

the information processing device and the another information processing device are a part of a propulsion device including a propulsion unit that directly or indirectly controls propulsion as necessary based on the image data, and

the high-speed data transmission is stopped by the propulsion device after the propulsion device satisfies a predetermined stop condition.

18. The information processing device according to claim 1 , wherein

the information processing device and the another information processing device are a part of a propulsion device including a propulsion unit that directly or indirectly controls propulsion based on the image data,

the propulsion device has a processing configuration that acquires or displays another data different from the image data, and

the propulsion unit controls propulsion based on the another data and the unique message is received.

19. A mobile device, comprising:

an information processing device including:

a communication unit configured to one of:

transmit transmitting data of a frame to an another information processing device, or

receive the transmitting data from the another information processing device based on communication with the another information processing device to perform high-speed data transmission of the transmitting data, wherein the transmitting data includes:

image data in a specific direction between the information processing device and the another information processing device,

an extended packet including an extended packet header and packet data, and

a unique message that notifies at least one of the information processing device or the another information processing device that the image data is in a state different from a normal time or a usual time; and

a protection unit configured to:

derive a session key; and

execute at least one of generation, verification, or decryption of protection data of the unique message, wherein

the image data is stored in the packet data, and

the image data and the unique message are transmitted at different timings through one of a part or whole of a communication path regarding the communication.

20. A communication system, comprising:

an information processing device including:

a communication unit configured to one of:

transmit transmitting data of a frame to an another information processing device; or

receive the transmitting data from the another information processing device based on communication with the another information processing device to perform high-speed data transmission of the transmitting data, wherein the transmitting data includes:

image data in a specific direction between the information processing device and the another information processing device,

an extended packet including an extended packet header and packet data, and

a unique message that notifies at least one of the information processing device or the another information processing device that the image data is in a state different from a normal time or a usual time; and

a protection unit configured to:

derive a session key; and

execute at least one of generation, verification, or decryption of protection data of the unique message, wherein

the image data is stored in the packet data, and

the image data and the unique message are transmitted at different timings through one of a part or whole of a communication path regarding the communication.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 3, 2023
From: MIYAMOTO, TAKASHI; TAKAHASHI, HIROO
To: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
Reel/Frame 063205/0694 →
Priority Claims (1)
JP 2020-170968 · Oct 9, 2020 · national
Continuity (1)
Related Publication 20230412575A1 · Dec 21, 2023
References Cited (17)
US 20030041221A1 · Okada · 2003 [cited by examiner]
US 20150372991A1 · Katz · 2015 [cited by examiner]
US 20190026029A1 · Lee · 2019 [cited by applicant]
US 20190149751A1 · Wise · 2019 [cited by applicant]
CN 1925386A · 2007 [cited by examiner]
CN 110445809A · 2019 [cited by examiner]
JP 11220495A · 1999 [cited by applicant]
JP 2004064181A · 2004 [cited by applicant]
JP 2006276093A · 2006 [cited by applicant]
JP 2010253327A · 2010 [cited by examiner]
TW 202029002A · 2020 [cited by applicant]
WO 2020129685A1 · 2020 [cited by applicant]
Translation of CN-110445809-A (Year: 2019). [cited by examiner]
Translation of CN-1925386-A (Year: 2007). [cited by examiner]
Translation of JP-2010253327-A (Year: 2010). [cited by examiner]
International Search Report and Written Opinion of PCT Application No. PCT/JP2021/034953, issued on Nov. 22, 2021, 09 pages of ISRWO. [cited by applicant]
“Draft MIPI Alliance Specification for Camera Serial Interface 2 (CSI-2)”, In: “Draft MIPI Alliance Specification for Camera Serial Interface 2 (CSI-2)”, Apr. 2, 2009 (Apr. 2, 2009), XP055165978, p. 46. [cited by applicant]