IP Library Granted Patent US 11,120,273
Granted Patent B2
US 11,120,273 · App. 16/905,728 · Granted Sep 14, 2021

Adaptive content classification of a video content item

Inventors: Richard Rabbat (Palo Alto, CA); Ernestine Fu (Northridge, CA)
Assignee: Gfycat, Inc.
G06K9/00765G06K9/6254G06K9/685G06T11/00G06K2009/6864
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,120,273
App. No.
16/905,728
Granted
Sep 14, 2021
Kind
B2
Abstract

In a method for performing adaptive content classification of a video content item, frames of a video content item are analyzed at a sampling rate for a type of content, wherein the sampling rate dictates a frequency at which frames of the video content item are analyzed. Responsive to identifying content within at least one frame indicative of the type of content, the sampling rate of the frames is increased. Responsive to not identifying content within at least one frame indicative of the type of content, the sampling rate of the frames is decreased. It is determined whether the video content item includes the type of content based on the analyzing the frames.

Claims (47)

1. A method for performing adaptive content classification of a video content item, the method comprising:

analyzing frames of a video content item at a sampling rate for a type of content, wherein the sampling rate dictates a frequency at which frames of the video content item are analyzed, the analyzing the frames comprising:

responsive to identifying content within at least one frame indicative of the type of content, increasing the sampling rate of the frames, and

responsive to not identifying content within at least one frame indicative of the type of content, decreasing the sampling rate of the frames; and

determining whether the video content item comprises the type of content based on the analyzing the frames.

2. The method of claim 1 , wherein the analyzing the frames comprises:

combining a plurality of frames of the video content item into a single image comprising a collage of frames for analysis.

3. The method of claim 2 , wherein the analyzing the frames comprises:

collectively analyzing the plurality of frames of the video content item of the single image.

4. The method of claim 2 , wherein the single image comprises a two by two collage of frames.

5. The method of claim 2 , wherein the single image comprises a three by three collage of frames.

6. The method of claim 1 , wherein the analyzing the frames comprises:

applying at least one classifier to the frames of the video content item, wherein the at least one classifier is configured to automatically identify a particular type of content.

7. The method of claim 1 , wherein the analyzing the frames comprises:

applying a plurality of classifiers to the frames of the video content item, wherein each classifier of the plurality of classifiers is configured to automatically identify a particular type of content.

8. The method of claim 7 , wherein the frames of the video content item are sequentially applied to the plurality of classifiers.

9. The method of claim 7 , wherein the frames of the video content item are concurrently applied to the plurality of classifiers.

10. The method of claim 1 , wherein the type of content comprises not safe for work (NSFW) content.

11. The method of claim 1 , wherein the determining whether the video content item comprises the type of content based on the analyzing the frames comprises:

provided a determination is made that it is inconclusive that the video content item comprises the type of content, forwarding the video content item for human review.

12. A non-transitory computer readable storage medium having computer readable program code stored thereon for causing a computer system to perform a method for performing adaptive content classification of a video content item, the method comprising:

analyzing frames of a video content item at a sampling rate for a type of content, wherein the sampling rate dictates a frequency at which frames of the video content item are analyzed, the analyzing the frames comprising:

responsive to identifying content within at least one frame indicative of the type of content, increasing the sampling rate of the frames, and

responsive to not identifying content within at least one frame indicative of the type of content, decreasing the sampling rate of the frames; and

determining whether the video content item comprises the type of content based on the analyzing the frames.

13. The non-transitory computer readable storage medium of claim 12 , wherein the analyzing the frames comprises:

combining a plurality of frames of the video content item into a single image comprising a collage of frames for analysis.

14. The non-transitory computer readable storage medium of claim 13 , wherein the analyzing the frames comprises:

collectively analyzing the plurality of frames of the video content item of the single image.

15. The non-transitory computer readable storage medium of claim 12 , wherein the analyzing the frames comprises:

applying at least one classifier to the frames of the video content item, wherein the at least one classifier is configured to automatically identify a particular type of content.

16. The non-transitory computer readable storage medium of claim 12 , wherein the analyzing the frames comprises:

applying a plurality of classifiers to the frames of the video content item, wherein each classifier of the plurality of classifiers is configured to automatically identify a particular type of content.

17. The non-transitory computer readable storage medium of claim 12 , wherein the determining whether the video content item comprises the type of content based on the analyzing the frames comprises:

provided a determination is made that it is inconclusive that the video content item comprises the type of content, forwarding the video content item for human review.

18. A computer system comprising:

a data storage unit; and

a processor coupled with the data storage unit, the processor configured to:

analyze frames of a video content item at a sampling rate for a type of content, wherein the sampling rate dictates a frequency at which frames of the video content item are analyzed, wherein analyzing the frames comprises:

increasing the sampling rate of the frames responsive to identifying content within at least one frame indicative of the type of content, and

decreasing the sampling rate of the frames responsive to not identifying content within at least one frame indicative of the type of content; and

determine whether the video content item comprises the type of content based on analysis of the frames.

19. The computer system of claim 18 , wherein the processor is further configured to:

combine a plurality of frames of the video content item into a single image comprising a collage of frames for analysis; and

collectively analyze the plurality of frames of the video content item of the single image.

20. The computer system of claim 18 , wherein the processor is further configured to:

apply at least one classifier to the frames of the video content item, wherein the at least one classifier is configured to automatically identify a particular type of content.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 3, 2022
From: GFYCAT, INC.
To: SNAP INC.
Reel/Frame 061963/0865 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 18, 2020
From: RABBAT, RICHARD; FU, ERNESTINE
To: GFYCAT, INC.
Reel/Frame 052982/0766 →
Continuity (2)
Provisional Application 62865037 · Jun 21, 2019
Related Publication 20200401813A1 · Dec 24, 2020