IP Library Granted Patent US 10,795,635
Granted Patent B2
US 10,795,635 · App. 15/991,518 · Granted Oct 6, 2020

Systems and methods for spatial and temporal highlighting of changes to streaming image data

Inventors: Alexander Smith (North Salt Lake, UT); Natalie McMullen (Salt Lake City, UT); Kevin Crandell (Salt Lake City, UT)
Assignee: Forcepoint LLC
G06F3/1462G06F3/048G06F9/452H04L65/604
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,795,635
App. No.
15/991,518
Granted
Oct 6, 2020
Kind
B2
Abstract

A method, system, and computer-usable medium are disclosed for receiving a video stream of image frames, determining changes in one or more portions of the video stream, and presenting: (i) the video stream to a video display device, including an overlay indicating the one or more portions of the video stream wherein the changes occur; and/or (ii) a temporal change indicator to the video display device, indicating temporal portions of the video stream in which changes occur within the video stream.

Claims (50)

1. A computer-implementable method comprising:

receiving a video stream of image frames;

accessing information indicative of changes in one or more portions of the video stream;

generating a video stream display for a video display device, wherein the video stream display includes:

the video stream; and

an overlay indicating the one or more portions of the video stream wherein the changes occur; and

generating a temporal change indicator to the video display device, indicating temporal portions of the video stream in which changes occur within the video stream;

wherein the information indicative of changes comprises pixel information received from a browser plugin and wherein the pixel information is indicative of changes occurring in one or more pixels between two successive image frames of the video stream display;

wherein the temporal change indicator indicates a percentage of pixels that change to between the two successive image frames of the video stream versus a time associated with the video stream;

wherein the percentage of pixels that change comprises a percentage of pixels within a particular area of the video stream that changed during a particular period of time.

2. The method of claim 1 , wherein the information indicative of changes in one or more portions of the video stream comprises information indicative of one or more areas of the video stream that have changed within a predetermined number of trailing image frames of the video stream relative to a currently displayed image frame of the video stream.

3. The method of claim 1 , wherein the information indicative of changes in one or more portions of the video stream comprises information indicative of one or more areas of the video stream that have changed within a predetermined trailing period of time of the video stream relative to a currently displayed image frame of the video stream.

4. The method of claim 1 , wherein the overlay is transparent.

5. The method of claim 1 , wherein generating the video stream display comprises generating the overlay substantially contemporaneously as to when changes to the video stream occur.

6. The method of claim 1 , wherein generating the video stream display comprises generating overlay over an area of the video stream for a period of time prior to when changes occur in such area.

7. The method of claim 1 , wherein generating the video stream display comprises generating overlay over an area of the video stream for a period of time after changes occur in such area.

8. The method of claim 1 , wherein generating the video stream display comprises generating overlay with a minimum size independent of an area of the video stream in which changes occur.

9. A computer-implementable method comprising:

receiving a video stream of image frames;

accessing information indicative of changes in one or more portions of the video stream; and

generating a video stream display for a video display device wherein the video stream display includes:

the video stream; and

presenting a temporal change indicator indicating temporal portions of the video stream in which changes occur within the video stream;

wherein the information indicative of changes comprises pixel information received from a browser plugin and wherein the pixel information is indicative of changes occurring in one or more pixels between two successive image frames of the video stream; and

wherein the temporal change indicator indicates a percentage of pixels that change between two successive image frames of the video stream versus a time associated with the video stream and wherein the percentage of pixels that change comprises a percentage of pixels within an area of the video stream that changed during a particular period of time.

10. A non-transitory, computer-readable storage medium embodying computer program code, the computer program code comprising computer executable instructions configured for:

receiving a video stream of image frames;

accessing information indicative of changes in one or more portions of the video stream; and

generating a video stream display for a video display device, wherein the video stream display includes:

the video stream;

an overlay indicating the one or more portions of the video stream wherein the changes occur; and

a temporal change indicator indicating temporal portions of the video stream in which changes occur within the video stream;

wherein the information indicative of changes comprises pixel information received from a browser plugin and wherein the pixel information is indicative of changes occurring in one or more pixels between two successive image frames of the video stream;

wherein the temporal change indicator indicates a percentage of pixels that change to between two successive image frames of the video stream versus a time associated with the video stream;

wherein the percentage of pixels that change comprises a percentage of pixels within an area of the video stream that changed during a particular period of time.

11. The storage medium of claim 10 , wherein the information indicative of changes in one or more portions of the video stream comprises information indicative of one or more areas of the video stream that have changed within a predetermined number of trailing image frames of the video stream relative to a currently displayed image frame of the video stream.

12. The storage medium of claim 10 , wherein the information indicative of changes in one or more portions of the video stream comprises the information indicative of one or more areas of the video stream that have changed within a predetermined trailing period of time of the video stream relative to a currently displayed image frame of the video stream.

13. The storage medium of claim 10 , wherein the overlay is transparent.

14. The storage medium of claim 10 , wherein generating the video stream display comprises generating the overlay substantially contemporaneously as to when changes to the video stream occur.

15. The storage medium of claim 10 , wherein generating the video stream display comprises generating the overlay over an area of the video stream for a period of time prior to when changes occur in such area.

16. The storage medium of claim 10 , wherein generating the video stream display includes generating the overlay over an area of the video stream for a period of time after changes occur in such area.

17. The storage medium of claim 10 , wherein generating the video stream display includes generating the overlay with a minimum size independent of an area of the video stream in which changes occur.

18. A non-transitory, computer-readable storage medium embodying computer program code, the computer program code comprising computer executable instructions configured for:

receiving a video stream of image frames;

accessing information indicative of changes in one or more portions of the video stream; and

generating a video stream display for a video display device wherein the video stream display includes:

the video stream; and

a temporal change indicator indicating temporal portions of the video stream in which changes occur within the video stream;

wherein the information indicative of changes comprises pixel information received from a browser plugin and wherein the pixel information is indicative of changes occurring in one or more pixels between two successive image frames of the video stream; and

wherein the temporal change indicator indicates a percentage of pixels that change between two successive image frames of the video stream versus a time associated with the video stream and wherein the percentage of pixels that change comprises a percentage of pixels within an area of the video stream that changed during a particular period of time.

Assignments (12)
RELEASE OF SECURITY INTEREST Recorded Apr 2, 2025
From: UBS AG, STAMFORD BRANCH
To: FORCEPOINT, LLC; BITGLASS, LLC
Reel/Frame 070706/0263 →
CHANGE OF NAME Recorded Feb 13, 2024
From: FORCEPOINT FEDERAL HOLDINGS LLC
To: EVERFOX HOLDINGS LLC
Reel/Frame 066582/0531 →
PARTIAL PATENT RELEASE AND REASSIGNMENT AT REEL/FRAME 055052/0302 Recorded Oct 3, 2023
From: CREDIT SUISSE, AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
To: FORCEPOINT FEDERAL HOLDINGS LLC (F/K/A FORCEPOINT LLC)
Reel/Frame 065103/0147 →
SECURITY INTEREST Recorded Sep 29, 2023
From: FORCEPOINT FEDERAL HOLDINGS LLC
To: APOLLO ADMINISTRATIVE AGENCY LLC, AS COLLATERAL AGENT
Reel/Frame 065086/0822 →
CHANGE OF NAME Recorded May 12, 2021
From: FORCEPOINT LLC
To: FORCEPOINT FEDERAL HOLDINGS LLC
Reel/Frame 056216/0309 →
PATENT SECURITY AGREEMENT Recorded Jan 20, 2021
From: REDOWL ANALYTICS, INC.; FORCEPOINT LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 055052/0302 →
RELEASE OF SECURITY INTEREST IN PATENTS Recorded Jan 8, 2021
From: RAYTHEON COMPANY
To: FORCEPOINT LLC
Reel/Frame 055479/0676 →
RELEASE OF SECURITY INTEREST IN PATENTS Recorded Jan 8, 2021
From: RAYTHEON COMPANY
To: FORCEPOINT LLC
Reel/Frame 055492/0266 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Mar 15, 2019
From: FORCEPOINT LLC
To: RAYTHEON COMPANY
Reel/Frame 048613/0636 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jul 6, 2018
From: FORCEPOINT LLC
To: RAYTHEON COMPANY
Reel/Frame 046495/0561 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 29, 2018
From: MCMULLEN, NATALIE; CRANDELL, KEVIN
To: FORCEPOINT LLC
Reel/Frame 045923/0920 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 29, 2018
From: SMITH, ALEXANDER
To: FORCEPOINT LLC
Reel/Frame 045923/0837 →
Continuity (1)
Related Publication 20190369945A1 · Dec 5, 2019