Granted Patent B2

US 12,479,362 · App. 18/541,335 · Granted Nov 25, 2025

Inventor: Joseph Burtch (Lake Orion, MI)

Assignee: Continental Autonomous Mobility US, LLC

B60Q9/00G06V20/58G06V40/11G06V40/28H04N7/188

Abstract

Claims (57)

1 . A method for alerting a driver to objects left on a vehicle roof, the method comprising:

obtaining image data of an environment surrounding the vehicle, the image data comprising a sequence of images captured by a camera;

detecting a person in the image data;

determining whether the person raised at least one arm above the vehicle roof, based on the image data; and

generating a notification based on determining that the person raised at least one arm above the vehicle roof.

2 . The method of claim 1 , wherein determining whether the person raised at least one arm above the vehicle roof comprises detecting that the person's arm moves out of a field of view of the camera.

3 . The method of claim 1 , wherein determining whether the person raised at least one arm above the vehicle roof comprises

identifying the person's hands within the image data, and

tracking position of the person's hands across the sequence of images.

4 . The method of claim 1 , wherein determining whether the person raised at least one arm above the vehicle roof comprises

recognizing keypoints of a skeletal structure of the person within the image data, and

tracking positions of at least one of the recognized keypoints across the sequence of images.

5 . The method of claim 1 , further comprising:

detecting presence of an object in at least one of the person's hands within a frame of the image data when the person's hands were moving towards the vehicle roof;

detecting absence of the object in the person's hands within a further frame of the image data when the person's hands were moving away from the vehicle roof, wherein the further frame is subsequent to the frame; and

generating the notification further based on the detection of presence of the object followed by the subsequent detection of absence of the object.

6 . The method of claim 1 , further comprising:

detecting communication between a key fob and the vehicle, and

wherein at least one of obtaining image data of the environment and detecting movement of the person's hands, is initiated based on detection of the communication.

7 . The method of claim 6 , further comprising at least one of:

turning on the camera based on detection of the communication; and

detecting absence of communication between the key fob and the vehicle and stopping at least one of obtaining image data of the environment and determining whether the person raised at least one arm above the vehicle roof, based on detection of absence of the communication.

8 . The method of claim 1 , further comprising:

detecting power down of the vehicle propulsion system;

wherein at least one of obtaining image data of the environment and determining whether the person raised at least one arm above the vehicle roof, is initiated based on detection of the power down of the vehicle propulsion system.

9 . The method of claim 8 , further comprising:

detecting opening of the vehicle doors after detection of the power down of the vehicle propulsion system,

wherein at least one of obtaining image data of the environment and determining whether the person raised at least one arm above the vehicle roof, is initiated based on both the detection of the power down of the vehicle propulsion system and the detection of the opening of the vehicle doors.

10 . The method of claim 8 , further comprising:

detecting power on of the vehicle propulsion system; and

stop at least one of obtaining image data of the environment and determining whether the person raised at least one arm above the vehicle roof, based on detection of the power on of the vehicle propulsion system.

11 . An alert system for alerting a driver to objects left on the vehicle roof, the alert system comprising:

a processor configured to obtain image data of an environment surrounding the vehicle, the image data comprising a sequence of images,

wherein the processor is further configured to detect a person within the image data,

wherein the processor is further configured to determine whether the person raised at least one arm above the vehicle roof, based on the image data; and

a notification generator configured to generate a notification based on the processor determining that the person raised at least one arm above the vehicle roof.

12 . The alert system of claim 11 , further comprising:

a camera configured to capture the image data of the environment surrounding the vehicle.

13 . The alert system of claim 11 , wherein the processor is configured to determine whether the person raised at least one arm above the vehicle roof by at least one of:

(a) identifying the person's hands within the image data, and tracking position of the person's hands across the sequence of images, and

(b) recognizing keypoints of a skeletal structure of the person within the image data, and tracking positions of at least one of the recognized keypoints across the sequence of images.

14 . The alert system of claim 11 , wherein the processor is further configured to detect presence of an object in at least one of the person's hands within a frame of the image data when the person's hands were moving towards the vehicle roof, and

wherein the processor is further configured to detect absence of the object in the person's hands within a further frame of the image data when the person's hands were moving away from the vehicle roof, the further frame being subsequent to the frame, and

wherein the notification generator is configured to generate the notification further based on the detection of presence of the object followed by the subsequent detection of absence of the object.

15 . The alert system of claim 11 , further comprising:

a transceiver configured to detect communication between a key fob and the vehicle, and

a controller configured to control the processor to initiate at least one of obtaining image data of the environment and detecting movement of the person's hands, based on detection of the communication by the transceiver.

16 . The alert system of claim 15 , wherein the controller is further configured to turn on the camera based on detection of the communication by the transceiver.

17 . The alert system of claim 15 , wherein the transceiver is further configured to detect absence of communication between the key fob and the vehicle, and

wherein the controller is further configured to control the processor to stop at least one of obtaining image data of the environment and determining whether the person raised at least one arm above the vehicle roof, based on detection of absence of the communication by the transceiver.

18 . The alert system of claim 11 , further comprising:

a power sensor configured to detect power down of the vehicle propulsion system; and

a controller configured to control the processor to initiate at least one of obtaining image data of the environment and determining whether the person raised at least one arm above the vehicle roof, based on detection of the power down of the vehicle propulsion system by the power sensor.

19 . The alert system of claim 18 , further comprising:

a door sensor configured to detect opening of the vehicle doors after detection of the power down of the vehicle propulsion system by the power sensor,

wherein the controller is configured to control the processor to initiate at least one of obtaining image data of the environment and determining whether the person raised at least one arm above the vehicle roof, based on both the detection of the power down of the vehicle propulsion system and the detection of the opening of the vehicle doors.

20 . The alert system of claim 18 , wherein the power sensor is further configured to detect power on of the vehicle propulsion system, and wherein the controller is further configured to control the processor to stop at least one of obtaining image data of the environment and determining whether the person raised at least one arm above the vehicle roof, based on detection of the power on of the vehicle propulsion system by the power sensor.

Assignments (2)

Continuity (1)

References Cited (16)