IP Library › Granted Patent US 12,428,013
Granted Patent B2
US 12,428,013 · App. 18/229,769 · Granted Sep 30, 2025

Vehicle electronic device and method for providing notification related to parking environment based on image reading

Inventors: Hae Jun Jung (Seongnam-si, KR); Hyeon Seok Oh (Seongnam-si, KR)
Assignee: THINKWARE CORPORATION
B60W50/14G06T5/70G06T7/10G06V10/26G06V10/34G06V10/44G06V20/56
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,428,013
App. No.
18/229,769
Granted
Sep 30, 2025
Kind
B2
Abstract

The disclosure proposes a method and device for providing notification regarding vehicle state based on image processing/reading, in relation to a method for notifying vehicle state based on GPS and acceleration sensors or G sensors, and a device using the method.

Claims (34)

1. A method performed by a vehicular electronic device in a vehicle comprising:

performing an image processing procedure on an image acquired by the vehicular electronic device, the image processing procedure including obtaining an image subtraction;

determining a state of the vehicle based on the image processing procedure, the state of the vehicle being one of a towing state, a driving state, and a parking state; and

providing notification for the determined state of the vehicle,

wherein the image processing procedure includes generating a plurality of cells based on grid-type image segmentation on the acquired image, and

wherein the vehicular electronic device determines the state of the vehicle based on the plurality of cells.

2. The method of claim 1 , wherein the grid-type image segmentation includes assigning a cell weight to at least one cell among the plurality of cells, and

wherein the cell weight for the at least one cell is determined based on at least one of the state of the vehicle, an angle of view of the image, and a location for capturing the image.

3. The method of claim 1 , wherein the vehicular electronic device determines an unused cell among the plurality of cells is, the unused cell being not to be used to determine the state of the vehicle, and

wherein the vehicular electronic device performs at least one of image blurring and image smoothing on the unused cell.

4. The method of claim 1 , wherein the image processing procedure includes detecting a contour in the image acquired by the vehicular electronic device, and

wherein the vehicular electronic device determines the state of the vehicle based on the contour.

5. The method of claim 4 , wherein the detecting the contour includes extracting a bounding box for an object included in the image acquired by the vehicular electronic device.

6. The method of claim 5 , wherein the extracting the bounding box includes generating a bounding box in at least one area within the contour included in the image subtraction, the at least one area being larger than a predetermined size.

7. The method of claim 1 , wherein the image subtraction is determined based on image downsizing of the image acquired by the vehicular electronic device and based on at least two adjacent frames among a plurality of frames included in the downsized image.

8. The method of claim 1 , wherein the image subtraction indicates white pixels, the presence of which is based on an amount of the movement of the vehicle, the vehicular electronic device determines the amount of the movement of the vehicle based on the number of the white pixels, and the vehicular electronic device determines the state of the vehicle based on the amount of the movement of the vehicle.

9. The method of claim 8 , wherein the vehicular electronic device determines an average movement, wherein the average movement is determined based on an amount of change between the amount of the movement of the vehicle at time t and the amount of the movement of the vehicle at time t−1.

10. A vehicular electronic device in a vehicle comprising:

a camera configured to capture an image;

a processor configured to perform an image processing procedure on the image acquired by the vehicular electronic device, the image processing procedure including obtaining an image subtraction, to determine a state of the vehicle based on the image processing procedure, the state being one of a towing state, a driving state and a parking state, and to generate a notification regarding the determined state of the vehicle; and

a communication module configured to transmit the notification,

wherein the image processing procedure includes generating a plurality of cells based on grid-type image segmentation on the acquired image, and

wherein the vehicular electronic device determines the state of the vehicle based on the plurality of cells.

11. The vehicular electronic device of claim 10 , wherein the processor is further configured such that the grid-type image segmentation includes assigning a cell weight to at least one cell among the plurality of cells, and

wherein the cell weight for the at least one cell is determined based on at least one of the state of the vehicle, an angle of view of the image, and a location for capturing the image.

12. The vehicular electronic device of claim 10 , wherein the processor is further configured to determine an unused cell among the plurality of cells is, the unused cell being not to be used to determine the state of the vehicle, and

wherein the processor is further configured to perform at least one of image blurring and image smoothing on the unused cell.

13. The vehicular electronic device of claim 10 , wherein the image processing procedure includes detecting a contour in the image acquired by the vehicular electronic device, and

wherein the vehicular electronic device determines the state of the vehicle based on the contour.

14. The vehicular electronic device of claim 13 , wherein the detecting the contour includes extracting a bounding box for an object included in the image acquired by the vehicular electronic device.

15. The vehicular electronic device of claim 14 , wherein the processor is further configured such that the extracting the bounding box includes generating a bounding box in at least one area within the contour included in the image subtraction, the at least one area being larger than a predetermined size.

16. The vehicular electronic device of claim 10 , wherein the image subtraction is determined based on image downsizing of the image acquired by the vehicular electronic device and based on at least two adjacent frames among a plurality of frames included in the downsized image.

17. The vehicular electronic device of claim 10 , wherein the image subtraction indicates white pixels, the presence of which is based on an amount of the movement of the vehicle, the vehicular electronic device determines the amount of the movement of the vehicle based on the number of the white pixels, and the vehicular electronic device determines the state of the vehicle based on the amount of the movement of the vehicle.

18. The vehicular electronic device of claim 17 , wherein the processor is further configured to determine an average movement, wherein the average movement is determined based on an amount of change between the amount of the movement of the vehicle at time t and the amount of the movement of the vehicle at time t−1.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2023
From: JUNG, HAE JUN; OH, HYEON SEOK
To: THINKWARE CORPORATION
Reel/Frame 064481/0036 →
Priority Claims (2)
KR 10-2022-0096686 · Aug 3, 2022 · national
KR 10-2023-0101565 · Aug 3, 2023 · national
Continuity (1)
Related Publication 20240157959A1 · May 16, 2024
References Cited (6)
US 20170235307A1 · Asakura · 2017 [cited by examiner]
US 20180330475A1 · Tokatyan · 2018 [cited by examiner]
US 20200265654A1 · Kapadia · 2020 [cited by examiner]
US 20210263513A1 · Liu · 2021 [cited by examiner]
US 20220340136A1 · Nobutani · 2022 [cited by examiner]
US 20230339280A1 · Dudar · 2023 [cited by examiner]