Granted Patent B2

US 12,450,286 · App. 17/195,723 · Granted Oct 21, 2025

Inventors: Mikael Pendse (Lund, SE); Adam Jalkemo (Lund, SE)

Assignee: Axis AB

G06F16/745G06V20/49G06V40/171

Abstract

Claims (42)

1. A video camera for analyzing a video stream, the video camera comprising:

an image sensor configured to capture image data of image frames of the video stream;

an image buffer configured to buffer image data of the image frames; and

circuitry configured to:

receive first sensor data from a sensor, wherein the sensor is at least one of a RADAR sensor, a LIDAR sensor a PIR sensor and/or a microphone,

perform a first evaluation on a subset of the image frames in the video stream by temporally correlating the first sensor data with the subset of the image frames in the video stream, wherein the first evaluation generates a corresponding first evaluation result and has an evaluation time larger than 1/fps for the video stream;

for each image frame in the subset, mark the image frame as being under evaluation to form marked image frames,

delete image frames temporally preceding the marked image frames from the image buffer,

selectively perform a second evaluation on the image data of each of the image frames in the subset based on the corresponding first evaluation result, wherein the second evaluation generates a corresponding second evaluation result,

delete the marked image frames from the image buffer in response to outputting the corresponding second evaluation result.

2. The video camera according to claim 1 , wherein the sensor is external to the video camera.

3. The video camera according to claim 1 , wherein the sensor is integrally formed with the video camera.

4. The video camera according to claim 1 , wherein the first evaluation comprises one or more of: an object detection function, a motion detection function, a change detection function, and an image segmentation function.

5. The video camera according to claim 1 , wherein the second evaluation comprises one or more of: an object identification function and an object classification function.

6. The video camera according to claim 1 , wherein the corresponding first evaluation result comprises an identification of a region of the image data to be evaluated by the second evaluation.

7. The video camera according to claim 1 , wherein the marked image frames are marked by adding data to a header of the marked image frames.

8. The video camera according to claim 1 , wherein the marked image frames are marked by updating a register.

9. A method for analyzing a video stream, the method comprising:

capturing the video stream, wherein the video stream comprises image data from a plurality of image frames;

storing the image data from the plurality of image frames in an image buffer;

receiving first sensor data from a sensor, wherein the sensor is at least one of a RADAR sensor, a LIDAR sensor a PIR sensor and/or a microphone,

performing a first evaluation on a subset of the plurality of image frames by temporally correlating the first sensor data with the subset of the image frames in the video stream wherein the first evaluation generates a corresponding first evaluation result and has an evaluation time larger than 1/fps for the video stream;

for each image frame in the subset, marking the image frame as being under evaluation to form marked image frames;

deleting, from the image buffer, one or more image frames among the plurality of images frames that temporally proceed the marked image frames;

selectively performing a second evaluation on the image data of each of the image frames in the subset based on the corresponding first evaluation result, wherein the second evaluation generates a corresponding second evaluation result;

outputting the corresponding second evaluation result; and

deleting the marked image frames from the image buffer in response to the outputting.

10. A non-transitory computer-readable storage medium having stored thereon instructions for analyzing a video stream, the instruction when executed by a processor cause the processor to perform a method comprising:

capturing the video stream, wherein the video stream comprises image data from a plurality of image frames;

storing the image data from the plurality of image frames in an image buffer;

receiving first sensor data from a sensor, wherein the sensor is at least one of a RADAR sensor, a LIDAR sensor a PIR sensor and/or a microphone,

performing a first evaluation on a subset of the plurality of image frames by temporally correlating the first sensor data with the subset of the image frames in the video stream wherein the first evaluation generates a corresponding first evaluation result and has an evaluation time larger than 1/fps for the video stream;

for each image frame in the subset, marking the image frame as being under evaluation to form marked image frames;

deleting, from the image buffer, one or more image frames among the plurality of images frames that temporally proceed the marked image frames;

selectively performing a second evaluation on the image data of each of the image frames in the subset based on the corresponding first evaluation result, wherein the second evaluation generates a corresponding second evaluation result;

outputting the corresponding second evaluation result; and

deleting the marked image frames from the image buffer in response to the outputting.

11. The video camera of claim 1 , wherein the sensor is the RADAR sensor.

12. The video camera of claim 1 , wherein the sensor is the LIDAR sensor.

13. The video camera of claim 1 , wherein the sensor is the PIR sensor.

14. The video camera of claim 1 , wherein the sensor is the microphone.

15. The video camera of claim 1 , wherein the circuitry includes a processor that is configured by executing program code stored in a memory.

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (24)