IP Library Granted Patent US 12,212,429
Granted Patent B2
US 12,212,429 · App. 18/025,476 · Granted Jan 28, 2025

System and method for determining one or more codes of Can bus messages based partly on camera captured images

Inventors: Liran Zwickel (Or Yehuda, IL); Avi Bitton (Yavne, IL); Eyal Kamir (Ganei Tikva, IL); Alexander Fok (Rehovot, IL); Ralph Diamond (Nesher, IL)
Assignee: ENIGMATOS LTD.
H04L12/40G06V30/19H04L2012/40215H04L2012/40273
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,212,429
App. No.
18/025,476
Granted
Jan 28, 2025
Kind
B2
Abstract

A method for determining codes of vehicle's Can-bus messages. The method can include sequentially generating, by a message generator, on the Can-bus different message codes selected from a reduced space defined from within a Message-ID and a plurality of data fields of the Can-bus messages as defined by the Can-bus protocol; storing, by a message storage, each generated message code together with a respective timestamp; storing, by an images storage, images that are captured by a camera in synchronization with each said generated message code, each image together with a respective timestamp; comparing, by a processor, each captured image with a latest previously captured image within the images storage; and upon finding, by the processor, a difference between any captured image and a latest captured image and based on the respective timestamp, associating the captured image having a later timestamp with the generated message code of the respective message.

Claims (46)

1. A method for determining codes of vehicle's Can-bus messages, comprising:

sequentially generating, by a message generator, on the Can-bus different message codes selected from a reduced space defined from within a Message-ID and a plurality of data fields of the Can-bus messages as defined by the Can-bus protocol;

storing, by a message storage, each generated message code together with a respective timestamp;

storing, by an images storage, images that are captured by a camera in synchronization with each said generated message code, each image together with a respective timestamp;

comparing, by a processor, each captured image with a latest previously captured image within the images storage;

upon finding, by the processor, a difference between any captured image and a latest captured image and based on the respective timestamp, associating the captured image having a later timestamp with the generated message code of the respective generated message in said message storage having the same timestamp; and

scanning and converting, by an OCR, readable characters of each captured image having the later timestamp in which said difference was found and associating said readable characters with said respective image and the generated message code of the generated message.

2. The method of claim 1 , wherein said reduced space assumes only a single value of “1” within the plurality of data fields of each generated message.

3. The method of claim 1 , further comprising:

during a preliminary stage, determining all the different message IDs that are used within the Can-bus; and

limiting said reduced space only to those determined message IDs within the message ID.

4. The method of claim 1 , further comprising:

an initial step of preparing a database containing all symbol-type notifications, a respective location of each said symbol-type notification, and a respective description for each said notification; and

upon determining of a difference in each said last captured image, and based on (i) the location of the observed difference within the last captured image; and (ii) said database, associating the description of the issued notification with said respective last captured image and the associated code of the generated message code.

5. The method of claim 1 , further comprising:

applying a microphone to determine the generated message code of each Can-bus message which activates sound.

6. A system for determining codes of vehicle's Can-bus messages, each said message being associated with a notification, comprising:

a message generator configured to sequentially generate on the Can-bus different message codes selected from a reduced space defined from within a Message-ID and a plurality of data fields of the Can-bus messages as defined by a Can-bus protocol;

a message storage for storing each generated message code, together with a respective timestamp;

a camera in synchronization with each said generated message code;

an images storage for storing images that are captured by said camera, each image together with its respective timestamp; and

a processor which is configured to (a) compare each captured image with a latest previously captured image within the images storage; (b) when a difference is found between any captured image and a latest captured image, and based on the respective timestamp, associate the captured image having a later timestamp with the generated message code of the generated message code of the respective generated message in said message storage having the same timestamp.

7. The system of claim 6 , wherein said reduced space assumes only a single value of “1” within the plurality of data fields of each generated message.

8. The system of claim 6 , wherein said message generator is configured to determine from the Can-bus, in a preliminary stage, all the different message IDs that are used within the Can-bus, and wherein said reduced space is limited to only those determined message IDs within the message ID.

9. The system of claim 6 , further comprising an OCR which is configured to scan and convert to readable characters each last image in which said difference was observed, and to further associate said readable characters with said respective image and the associated code of the generated message.

10. The system of claim 6 , further comprising:

a database containing all symbol-type notifications, a location of each said symbol-type notification, and a respective description for each said notification; and

said processor which is further configured to (c) determine from (i) a location of the observed difference between said two compared images; and (ii) said database; a description of the issued notification; and (d) associate said determined description with said respective image and the associated code of the generated message.

11. The system of claim 6 , further comprising a microphone, for determining the message code of each Can-bus message that activated sound.

12. A method for determining codes of vehicle's Can-bus messages that are associated with notifications, comprising:

providing a message generator for sequentially generating on the Can-bus different message codes selected from a reduced space defined from within the Message-ID and the plurality of data fields of the Can-bus messages as defined by the Can-bus protocol;

storing each generated message code within a message storage, together with its respective timestamp;

in synchronization with each said message generation, capturing by a camera an image;

storing all said captured images within images storage, together with their respective timestamps;

comparing each captured image with a latest stored previously captured image; and

upon observation of a difference between a last captured image and a latest previously captured image, and based on the later image timestamp, associating said last captured image with the respective code of the generated message having the same timestamp within said message storage.

13. The method of claim 12 , wherein said reduced space assumes only a single value of “1” within the plurality of data fields of each generated message.

14. The method of claim 12 , further comprising:

during a preliminary stage, determining all the different message IDs that are used within the Can-bus; and

limiting said reduced space only to those determined message IDs within the message ID.

15. The method of claim 12 , further applying an OCR to scan and convert to readable characters each last image in which said difference was observed, and further associating said readable characters with said respective last image and the associated code of the generated message.

16. The method of claim 12 , further comprising:

an initial step of preparing a database containing all symbol-type notifications, a respective location of each said symbol-type notification, and a respective description for each said notification; and

upon determining of a difference in each said last image, and based on (i) the location of the observed difference within the last captured image; and (ii) said database; associating the description of the issued notification with said respective last image and the associated code of the generated message.

17. The method of claim 12 , further comprising:

applying a microphone to determine the code of each Can-bus message which activates sound.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2024
From: ZWICKEL, LIRAN; BITTON, AVI; KAMIR, EYAL; FOK, ALEXANDER; DIAMOND, RALPH
To: ENIGMATOS LTD.
Reel/Frame 069641/0518 →
SECURITY INTEREST Recorded Nov 16, 2023
From: ENIGMATOS LTD.
To: SHAYKE AVIZARIM UMAARACHOT STERIO LARECHEV LTD.
Reel/Frame 065590/0016 →
Continuity (2)
Provisional Application 63077633 · Sep 13, 2020
Related Publication 20230344670A1 · Oct 26, 2023
References Cited (7)
US 10379932B2 · Tee et al. · 2019 [cited by applicant]
US 20100123564A1 · Grunhold · 2010 [cited by examiner]
US 20170274820A1 · Goudy · 2017 [cited by examiner]
CN 111130937A · 2020 [cited by applicant]
EP 2789127A1 · 2014 [cited by applicant]
Freiberger et al.: “Reverse Engineering Technologies for Remanufacturing of Automotive Systems Communicating via CAN Bus”, Journal of Remanufacturing, Dec. 7, 2011;1 (1): 1-4 <https://link.springer.com/article/10.1186/2… [cited by applicant]
International Search Report and Written Opinion dated Apr. 21, 2021 in PCT International Patent Application No. PCT/IL2021/050148, 11 pages. [cited by applicant]