IP Library › Granted Patent US 12,444,077
Granted Patent B2
US 12,444,077 · App. 18/743,162 · Granted Oct 14, 2025

Driving environment monitoring system and driving environment monitoring method thereof

Inventors: Chih-Yuan Chuang (Taipei, TW); Hao-Min Chang (Taipei, TW); Jiun-Shiung Chen (Taipei, TW); Kun-Hung Lin (Taipei, TW)
Assignee: LITE-ON TECHNOLOGY CORPORATION
G06T7/73G06V10/44G06V20/58G06T2207/20076G06T2207/30252G06T2207/30268
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,444,077
App. No.
18/743,162
Granted
Oct 14, 2025
Kind
B2
Abstract

A driving environment monitoring system includes a line-of-sight analysis module, an environment analysis module and a processor. The line-of-sight analysis module captures an eye image of a driver; and analyzes the eye image to obtain a plurality of line-of-sight probabilities that a line-of-sight of the eye image is located in a plurality of partitions. The environment analysis module is configured to capture an environment image around the mobile vehicle; and analyze the environment image to obtain a plurality of object probabilities that at least one object of the environment image is located in the partitions. The processor is configured to obtain an integration probability of the line-of-sight probability and the object probability in each partition; obtain a forward direction of the mobile vehicle; and send a reminder signal based on the integration probability of the partition where the forward direction is located being greater than a preset probability.

Claims (44)

1. A driving environment monitoring system, configured to be disposed on a mobile vehicle, and comprising:

a line-of-sight analysis module configured to:

capture an eye image of a driver; and

analyze the eye image to obtain a plurality of line-of-sight probabilities that a line-of-sight of the eye image is located in a plurality of partitions;

an environment analysis module configured to:

capture an environment image around the mobile vehicle; and

analyze the environment image to obtain a plurality of object probabilities for at least one object of the environment image located in the partitions; and

a processor configured to:

obtain an integration probability of the line-of-sight probability and the object probability in each partition;

obtain a forward direction of the mobile vehicle; and

send a reminder signal based on the integration probability of the partition where the forward direction is located being greater than a preset probability.

2. The driving environment monitoring system according to claim 1 , wherein the processor is further configured to:

obtain a difference between the object probability and the line-of-sight probability in each partition, and use the difference as the integration probability.

3. The driving environment monitoring system according to claim 1 , wherein the environment analysis module is further configured to:

analyze the environment image to obtain an object frame of each of at least one object of the environment image;

obtain a characteristic coordinate of the object frame; and

determine the partition where the characteristic coordinate is located according to the characteristic coordinate.

4. The driving environment monitoring system according to claim 3 , wherein the object frame has a bottom edge, and the characteristic coordinate is the coordinate of a midpoint of the bottom edge.

5. The driving environment monitoring system according to claim 1 , wherein the environment analysis module comprises:

a plurality of environmental cameras disposed on a plurality of outer surfaces of the mobile vehicle, wherein each environmental camera is configured to capture the environment image, and each environment image comprises the corresponding at least one object;

an object analyzer configured to:

analyze the at least one object in each environment image to determine that the at least one object in each environment image is the same object.

6. The driving environment monitoring system according to claim 1 , wherein each partition has a central angle, and the sum of the central angles is 360 degrees.

7. The driving environment monitoring system according to claim 1 , wherein each partition has a central angle, and each central angle is equal.

8. A driving environment monitoring method, comprising:

capturing, by a line-of-sight analysis module, an eye image of a driver;

analyzing, by the line-of-sight analysis module, the eye image to obtain a plurality of line-of-sight probabilities that a line-of-sight of the eye image is located in a plurality of partitions;

capturing, by an environment analysis module, an environment image around a mobile vehicle;

analyzing, by the environmental analysis module, the environment image to obtain a plurality of object probabilities for at least one object of the environment image located in the partitions;

obtaining, by a processor, an integration probability of the line-of-sight probability and the object probability in each partition;

obtaining, by the processor, a forward direction of the mobile vehicle; and

sending a reminder signal, by the processor, based on the integration probability of the partition where the forward direction is located being greater than a preset probability.

9. The driving environment monitoring method according to claim 8 , further comprising:

obtaining, by the processor, a difference between the line-of-sight probability and the object probability in each partition, and using the difference as the integration probability.

10. The driving environment monitoring method according to claim 8 , further comprising:

analyzing, by the processor, the environment image to obtain an object frame of each of the at least one object of the environment image;

obtaining, by the processor, a characteristic coordinate of the object frame; and

determining, by the processor, the partition where the characteristic coordinate is located according to the characteristic coordinate.

11. The driving environment monitoring method according to claim 10 , wherein the object frame has a bottom edge, and the characteristic coordinate is the coordinate of a midpoint of the bottom edge.

12. The driving environment monitoring method according to claim 8 , further comprising:

capturing, by the environment analysis module, a plurality of environment images, wherein each environment image comprises the corresponding at least one object;

analyzing, by the environment analysis module, the at least one object in each environment image to determine that the at least one object in each environment image is the same object.

13. The driving environment monitoring method according to claim 8 , wherein each partition has a central angle, and the sum of the central angles is 360 degrees.

14. The driving environment monitoring method according to claim 8 , wherein each partition has a central angle, and each central angle is equal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2024
From: CHUANG, CHIH-YUAN; CHANG, HAO-MIN; CHEN, JIUN-SHIUNG; LIN, KUN-HUNG
To: LITE-ON TECHNOLOGY CORPORATION
Reel/Frame 067726/0408 →
Priority Claims (1)
CN 202410366216.3 · Mar 28, 2024 · national
Continuity (2)
Provisional Application 63523400 · Jun 27, 2023
Related Publication 20250005788A1 · Jan 2, 2025
References Cited (5)
US 10137893B2 · Hanna · 2018 [cited by examiner]
US 10486593B2 · Ohta · 2019 [cited by examiner]
US 10746987B2 · Lewis · 2020 [cited by examiner]
US 11423674B2 · Lee · 2022 [cited by examiner]
US 20210339678A1 · Kudo · 2021 [cited by examiner]