IP Library › Granted Patent US 12,200,397
Granted Patent B2
US 12,200,397 · App. 18/184,264 · Granted Jan 14, 2025

Management of video playback speed based on objects of interest in the video data

Inventor: Amit Kumar (Menlo Park, CA)
Assignee: DRAGONFRUIT AI, INC
H04N7/013G06F18/40G06T7/20G06V20/46G06V40/10G11B27/005G11B27/031H04N5/91H04N7/183H04N23/80G06T2207/10016G06T2207/30242G06V2201/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,200,397
App. No.
18/184,264
Granted
Jan 14, 2025
Kind
B2
Abstract

Systems, methods, and software described herein manage the playback speed of video data based on processing objects in the video data. In one example, a video processing service obtains video data from a video source and identifies objects of interest in the video data. The video processing service further determines complexity in frames of the video data related to the objects of interest and updates playback speeds for segments of the video data based on the complexity of the frames.

Claims (45)

1. A method comprising:

obtaining video data from a video source, wherein a playback speed is designated for the video data, wherein the playback speed indicates a rate at which the video data is displayed at a user interface;

identifying objects of interest in the video data; and

allocating different playback speeds to different segments of the video data based on a physical proximity between at least two of the objects of interest captured in frames of the different segments, wherein a different playback speed of the different playback speeds indicates a different rate relative to the rate of the playback speed at which a corresponding video segment of the different segments is displayed at the user interface.

2. The method of claim 1 , wherein the video source comprises video storage or a video camera.

3. The method of claim 1 , wherein allocating the different playback speeds comprises;

assigning a first playback speed of the different playback speeds to a first segment of the different segments having the at least two of the objects of interest in closer proximity than the at least two of the objects of interest are in a second segment of the different segments, wherein the second segment is assigned a second playback speed of the different playback speeds that is faster than the first playback speed.

4. The method of claim 1 , wherein the different playback speeds are further allocated based on an amount of movement of the objects of interest in the frames.

5. The method of claim 3 , wherein a portion of video frames for the second segment are dropped during playback to increase the second playback speed relative to the first playback speed.

6. The method of claim 1 , wherein identifying the objects of interest in the video data comprises:

receiving a selection of one or more attributes associated with the objects of interest; and

identifying the objects of interest in the video data with the one or more attributes.

7. The method of claim 6 , wherein the one or more attributes comprise one or more object types, one or more object colors, or one or more object shapes.

8. The method of claim 1 , wherein the at least two of the objects of interest comprise one or more vehicles or one or more people.

9. The method of claim 1 further comprising:

identifying one or more objects that are not the objects of interest to be removed from the video data; and

removing the one or more objects from the video data.

10. A computing apparatus comprising:

a storage system;

a processing system operatively coupled to the storage system; and

program instructions stored on the storage system that, when executed by the processing system, direct the computing apparatus to:

obtain video data from a video source, wherein a playback speed is designated for the video data, wherein the playback speed indicates a rate at which the video data is displayed at a user interface;

identify objects of interest in the video data; and

allocate different playback speeds to different segments of the video data based on a physical proximity between at least two of the objects of interest captured in frames of the different segments, wherein a different playback speed of the different playback speeds indicates a different rate relative to the rate of the playback speed at which a corresponding video segment of the different segments is displayed at the user interface.

11. The computing apparatus of claim 10 , wherein the video source comprises video storage or a video camera.

12. The computing apparatus of claim 10 , wherein to allocate the different playback speeds, the program instructions direct the computing apparatus to:

assign a first playback speed of the different playback speeds to a first segment of the different segments having the at least two of the objects of interest in closer proximity than the at least two of the objects of interest are in a second segment of the different segments, wherein the second segment is assigned a second playback speed of the different playback speeds that is faster than the first playback speed.

13. The computing apparatus of claim 10 , wherein the different playback speeds are further allocated based on an amount of movement of the objects of interest in the frames.

14. The computing apparatus of claim 12 , wherein a portion of video frames for the second segment are dropped during playback to increase the second playback speed relative to the first playback speed.

15. The computing apparatus of claim 10 , wherein to identify the objects of interest in the video data, the program instructions direct the computing apparatus to:

receive a selection of one or more attributes associated with the objects of interest; and

identify the objects of interest in the video data with the one or more attributes.

16. The computing apparatus of claim 15 , wherein the one or more attributes comprise one or more object types, one or more object colors, or one or more object shapes.

17. The computing apparatus of claim 10 , wherein the at least two of the objects of interest comprise one or more vehicles or one or more people.

18. The computing apparatus of claim 10 , wherein the program instructions further direct the computing apparatus to:

identify one or more objects that are not the objects of interest to be removed from the video data; and

remove the one or more objects from the video data.

19. An apparatus comprising:

one or more non-transitory computer readable storage media; and

program instructions stored on the one or more non-transitory computer readable storage media that, when executed by at least one processor, direct the at least one processor to:

obtain video data from a video source, wherein a playback speed is designated for the video data, wherein the playback speed indicates a rate at which the video data is displayed at a user interface;

identify objects of interest in the video data; and

allocate different playback speeds to different segments of the video data based on a physical proximity between at least two of the objects of interest captured in frames of the different segments, wherein a different playback speed of the different playback speeds indicates a different rate relative to the rate of the playback speed at which a corresponding video segment of the different segments is displayed at the user interface.

20. The apparatus of claim 19 , wherein to allocate the different playback speeds, the program instructions direct the at least one processor to:

assign a first playback speed of the different playback speeds to a first segment of the different segments having the at least two of the objects of interest in closer proximity than the at least two of the objects of interest are in a second segment of the different segments, wherein the second segment is assigned a second playback speed of the different playback speeds that is faster than the first playback speed.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 15, 2023
From: KUMAR, AMIT
To: DRAGONFRUIT AI, INC.
Reel/Frame 062990/0144 →
Continuity (2)
Continuation 17112108 · Dec 4, 2020
Related Publication 20230215464A1 · Jul 6, 2023
References Cited (8)
US 11611719B2 · Kumar · 2023 [cited by examiner]
US 20070201817A1 · Peker · 2007 [cited by applicant]
US 20100322594A1 · Cheng · 2010 [cited by examiner]
US 20160171669A1 · Abdollahian · 2016 [cited by examiner]
US 20180182435A1 · Lee · 2018 [cited by examiner]
US 20200098147A1 · Ha · 2020 [cited by examiner]
US 20200284604A1 · Kim · 2020 [cited by examiner]
US 20200284607A1 · Mangal · 2020 [cited by examiner]