IP Library Granted Patent US 10,373,461
Granted Patent B2
US 10,373,461 · App. 15/092,544 · Granted Aug 6, 2019

System and method for video preview

Inventors: Feng Li (Shanghai, CN); Lili Zhao (Shanghai, CN)
Assignee: SHANGHAI XIAOYI TECHNOLOGY CO., LTD.
G08B13/19691G06K9/00744G08B13/1961G08B13/19602G08B13/19682G11B27/06G06K2009/00738
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,373,461
App. No.
15/092,544
Granted
Aug 6, 2019
Kind
B2
Abstract

A method for presenting a preview of a video includes receiving a plurality of video preview frames and information relating to a special event detected in the video. The plurality of video preview frames are extracted from the video. The special event is identified from an analysis of the video, and includes at least one of an object, a moving object, or a sound detected in the video. The method further includes displaying at least one of the received plurality of video preview frames, and displaying an indicator indicating the special event.

Claims (96)

1. A device for presenting a preview of a video, the device comprising:

a memory device configured to store instructions; and

one or more processors configured to execute the instructions to:

receive a plurality of video preview frames and information relating to a special event detected in the video, wherein

an identified feature is identified by determining whether a difference between a video frame and a preceding or subsequent video frame is equal to or exceeds a threshold, wherein the difference is a difference of pixel values or a difference of sound levels,

the special event is identified from an analysis of the video by comparing the identified feature with one or more object, motion, or sound models, and includes at least one of an object, a moving object, or a sound detected in the video, and

the plurality of video preview frames are extracted from the video, wherein a rate of extracting video frames increases upon identification of the special event;

wherein the one or more processors are further configured to skip a time period before extracting the plurality of video preview frames and after extracting the plurality of video preview frames based on whether the special event is detected in a previous time period, wherein the skipped time period before extracting the plurality of video preview frames is different from the skipped time period after extracting the plurality of video preview frames; and

a display in communication with the one or more processors configured to:

display at least one of the plurality of video preview frames, which were received, and

display an indicator indicating the special event.

2. The device of claim 1 , wherein the received information relating to the special event includes a category or alert level associated with the special event.

3. The device of claim 2 , wherein:

the indicator is color coded, and

a color of the indicator represents the category or alert level associated with the special event.

4. The device of claim 1 , wherein:

the information relating to the special event includes a time stamp associated with the special event;

the one or more processors are further configured to execute the instructions to receive, from a server or a camera, the video; and

the display is further configured to:

receive, from a user, one or more inputs; and

play, in response to the one or more inputs, a portion of the video around the time stamp associated with the special event.

5. The device of claim 1 , wherein the display is further configured to display two or more video preview frames, the two or more video preview frames appearing at different time points in the video.

6. The device of claim 1 , wherein the indicator has a length, the length representing a duration of the special event appearing in the video.

7. The device of claim 1 , wherein the one or more object, motion, or sound models includes at least one of: properties or characteristics of a portion of an image, properties or characteristics of a portion of a sound, a type of the object, a type of the motion, a type of the sound, an alert level associated with the object, motion, or sound, or a category associated with the object, motion, or sound.

8. A system for generating a plurality of video preview frames for a video, the system comprising:

a memory device that stores instructions; and

one or more processors that are configured to execute the instructions to:

generate or access one or more object, motion, or sound models;

receive a video;

analyze the video;

identify an identified feature by determining whether a difference between a video frame and a preceding or subsequent video frame is equal to or exceeds a threshold, wherein the difference is a difference of pixel values or a difference of sound levels;

identify a special event from an analysis of the video by comparing the identified feature with the one or more object, motion, or sound models, the special event including at least one of an object, a moving object, or a sound detected in the video;

obtain at least one video frame representing the special event, wherein a rate of obtaining video frames increases upon identification of the special event;

wherein the one or more processors are further configured to skip a time period before obtaining the plurality of video preview frames and after obtaining the plurality of video preview frames based on whether the special event is detected in a previous time period, wherein the skipped time period before obtaining the plurality of video preview frames is different from the skipped time period after obtaining the plurality of video preview frames; and

transmit, to a user, the at least one video frame representing the special event and information relating to the special event.

9. The system of claim 8 , wherein the one or more processors are further configured to:

obtain one or more video frames from the video;

detect an object from the one or more video frames; and

identify a first special event corresponding to the detected object.

10. The system of claim 9 , wherein the one or more processors are further configured to:

extract an audio signal from the video;

detect a sound included in the audio signal;

identify a second special event corresponding to the detected sound; and

associate the first and second special events if the first and second special events appear in the video around a same time.

11. The system of claim 9 , wherein the one or more processors are further configured to:

extract an audio signal from the video;

detect a sound included in the audio signal;

identify a special event corresponding to the detected sound.

12. The system of claim 8 , wherein the one or more object, motion, or sound models includes at least one of: properties or characteristics of a portion of an image, properties or characteristics of a portion of a sound, a type of the object, a type of the motion, a type of the sound, an alert level associated with the object, motion, or sound, or a category associated with the object, motion, or sound.

13. A method for presenting a preview of a video, the method comprising:

receiving a plurality of video preview frames and information relating to a special event detected in the video, wherein

an identified feature is identified by determining whether a difference between a video frame and a preceding or subsequent video frame is equal to or exceeds a threshold, wherein the difference is a difference of pixel values or a difference of sound levels,

the special event is identified from an analysis of the video by comparing an identified feature with one or more object, motion, or sound models, and includes at least one of an object, a moving object, or a sound detected in the video, and

the plurality of video preview frames are extracted from the video, wherein a rate of extracting video frames increases upon identification of the special event;

a time period is skipped before extracting the plurality of video preview frames and after extracting the plurality of video preview frames based on whether the special event is detected in a previous time period, wherein the skipped time period before extracting the plurality of video preview frames is different from the skipped time period after extracting the plurality of video preview frames;

displaying at least one of the plurality of video preview frames, which were received; and

displaying an indicator indicating the special event.

14. The method of claim 13 , wherein the received information relating to the special event includes a category or alert level associated with the special event.

15. The method of claim 14 , wherein:

the indicator is color coded, and

a color of the indicator represents the category or alert level associated with the special event.

16. The method of claim 13 , further comprising:

receiving, from a server or a camera, the video;

receiving, from a user, one or more inputs; and

playing, in response to the one or more inputs, a portion of the video around a time stamp associated with the special event.

17. The method of claim 13 , further comprising displaying two or more video preview frames, the two or more video preview frames appearing at different time points in the video.

18. The method of claim 13 , wherein the indicator has a length, the length representing a duration of the special event appearing in the video.

19. The method of claim 13 , wherein the one or more object, motion, or sound models includes at least one of: properties or characteristics of a portion of an image, properties or characteristics of a portion of a sound, a type of the object, a type of the motion, a type of the sound, an alert level associated with the object, motion, or sound, or a category associated with the object, motion, or sound.

20. A method for generating a plurality of video preview frames for a video, comprising:

generating or accessing one or more object, motion, or sound models;

receiving a video;

analyzing the video;

identifying an identified feature by determining whether a difference between a video frame and a preceding or subsequent video frame is equal to or exceeds a threshold, wherein the difference is a difference of pixel values or a difference of sound levels;

identifying a special event from an analysis of the video by comparing the identified feature with the one or more object, motion, or sound models, the special event including at least one of an object, a moving object, or a sound detected in the video;

obtaining at least one video frame representing the special event, wherein a rate of obtaining video frames increases upon identification of the special event;

skipping a time period before obtaining the plurality of video preview frames and after obtaining the plurality of video preview frames based on whether the special event is detected in a previous time period, wherein the skipped time period before obtaining the plurality of video preview frames is different from the skipped time period after obtaining the plurality of video preview frames; and

transmitting, to a user, the at least one video frame representing the special event and information relating to the special event.

21. The method of claim 20 , further comprising:

obtaining one or more video frames from the video;

detecting an object from the one or more video frames; and

identifying a first special event corresponding to the detected object.

22. The method of claim 21 , further comprising:

extracting an audio signal from the video;

detecting a sound included in the audio signal;

identifying a second special event corresponding to the detected sound; and

associating the first and second special events if the first and second special events appear in the video around a same time.

23. The method of claim 20 , wherein the one or more object, motion, or sound models includes at least one of: properties or characteristics of a portion of an image, properties or characteristics of a portion of a sound, a type of the object, a type of the motion, a type of the sound, an alert level associated with the object, motion, or sound, or a category associated with the object, motion, or sound.

24. A non-transitory computer readable medium embodying a computer program product, the computer program product comprising instructions configured to cause a computing device to:

receive a plurality of video preview frames and information relating to a special event detected in the video, wherein

an identified feature is identified by determining whether a difference between a video frame and a preceding or subsequent video frame is equal to or exceeds a threshold, wherein the difference is a difference of pixel values or a difference of sound levels,

the special event is identified from an analysis of the video by comparing the identified feature with one or more object, motion, or sound models, and includes at least one of an object, a moving object, or a sound detected in the video,

the plurality of video preview frames are extracted from the video, wherein a rate of extracting video frames increases upon identification of the special event,

wherein time period is skipped before extracting the plurality of video preview frames and after extracting the plurality of video preview frames based on whether the special event is detected in a previous time period, wherein the skipped time period before extracting the plurality of video preview frames is different from the skipped time period after extracting the plurality of video preview frames;

display at least one of the plurality of video preview frames, which were received; and

display an indicator indicating the special event.

25. The non-transitory computer readable medium of claim 24 , wherein the one or more object, motion, or sound models includes at least one of: properties or characteristics of a portion of an image, properties or characteristics of a portion of a sound, a type of the object, a type of the motion, a type of the sound, an alert level associated with the object, motion, or sound, or a category associated with the object, motion, or sound.

Assignments (5)
RELEASE OF SECURITY INTEREST Recorded Nov 5, 2024
From: EAST WEST BANK
To: KAMI VISION INCORPORATED
Reel/Frame 070792/0551 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 28, 2022
From: KAMI VISION INCORPORATED
To: EAST WEST BANK
Reel/Frame 059512/0101 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2022
From: SHANGHAI XIAOYI TECHNOLOGY CO., LTD.
To: KAMI VISION INC.
Reel/Frame 059275/0652 →
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY'S NAME TO "SHANGHAI XIAOYI TECHNOLOGY CO., LTD".ASSIGNORS CONFIRM THE ASSIGNMENT. PREVIOUSLY RECORDED ON REEL 038210 FRAME 0991. ASSIGNOR(S) HEREBY CONFIRMS THE RECEIVING PARTY DATA "XIAOYI TECHNOLOGY CO., LTD".. Recorded May 31, 2018
From: LI, FENG; ZHAO, LILI
To: SHANGHAI XIAOYI TECHNOLOGY CO., LTD.
Reel/Frame 047110/0769 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 6, 2016
From: LI, FENG; ZHAO, LILI
To: XIAOYI TECHNOLOGY CO., LTD.
Reel/Frame 038210/0991 →
Priority Claims (1)
CN 2016 1 0029095 · Jan 15, 2016 · national
Continuity (1)
Related Publication 20170206761A1 · Jul 20, 2017