IP Library Granted Patent US 10,742,923
Granted Patent B2
US 10,742,923 · App. 16/170,466 · Granted Aug 11, 2020

Detection of photosensitive triggers in video content

Inventors: Istvan Rechner (Budapest, HU); Zoltan Ponekker (Monor, HU); Patrik Egyed (Budapest, HU)
Assignee: International Business Machines Corporation
H04N5/57G06K9/00744G06K9/4647A61B5/4094
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,742,923
App. No.
16/170,466
Granted
Aug 11, 2020
Kind
B2
Abstract

Techniques for detecting epileptic triggers in video content by storing a first sequence of frames of a video stream in a first buffer. The technique can further comprise generating a second sequence of subframes and storing the second sequence of subframes in a second buffer. The technique can further comprise generating average intensity values for the second sequence of subframes in the second buffer and calculating intensity changes between consecutive subframes in the second sequence of subframes based on the average intensity values. The technique can further comprise determining that a number of intensity changes between consecutive subframes in the second sequence of subframes exceeds an oscillation threshold and tagging the frames in the first buffer corresponding to the subframes in the second buffer as hazardous.

Claims (47)

1. A computer-implemented method comprising:

storing a first sequence of frames of a video stream in a first buffer;

generating a second sequence of subframes corresponding to a first portion of respective frames in the first sequence of frames;

storing the second sequence of subframes in a second buffer;

generating average intensity values for respective subframes in the second sequence of subframes;

calculating intensity changes between consecutive subframes in the second sequence of subframes based on the average intensity values;

determining that a number of intensity changes between consecutive subframes in the second sequence of subframes exceeds an oscillation threshold, wherein respective intensity changes in the number of intensity changes exceed an amplitude threshold; and

tagging frames in the first sequence of frames as containing an epileptic trigger in response to determining that the number of intensity changes between consecutive subframes in the second sequence of subframes exceeds the oscillation threshold.

2. The method according to claim 1 , further comprising:

generating a third sequence of subframes corresponding to a second portion of respective frames in the first sequence of frames.

3. The method according to claim 2 , wherein the second portion partially overlaps the first portion.

4. The method according to claim 2 , wherein the second portion is equal in size to the first portion.

5. The method according to claim 1 , wherein the first portion comprises between 25% and 50%, inclusive, of an area of a respective frame in the first sequence of frames.

6. The method according to claim 1 , further comprising:

removing respective borders of respective frames in the first sequence of frames.

7. The method according to claim 1 , wherein the average intensity values comprise average luma values for respective subframes in the second sequence of subframes.

8. The method according to claim 7 , wherein a first average luma value is based on luma values of a majority of pixels in a first subframe of the second sequence of subframes.

9. The method according to claim 1 , wherein the average intensity values comprise average hue values, average saturation values, and average luminance values for respective subframes in the second sequence of subframes.

10. The method according to claim 1 , further comprising:

modifying respective frames in the first sequence of frames to mitigate the epileptic trigger; and

outputting a modified video stream in response to modifying respective frames in the first sequence of frames.

11. The method according to claim 10 , wherein modifying respective frames in the first sequence of frames comprises overwriting luma values of pixels in the first portion of respective frames in the first sequence of frames.

12. The method according to claim 10 , wherein modifying respective frames in the first sequence of frames comprises overwriting a characteristic of respective frames in the first sequence of frames, wherein the characteristic is selected from the group consisting of: hue, saturation, and luminance.

13. The method according to claim 1 , wherein an intensity change comprises a change in average brightness between consecutive subframes in the second sequence of subframes.

14. The method according to claim 1 , wherein an intensity change comprises a change in average saturation between consecutive subframes in the second sequence of subframes.

15. The method according to claim 1 , wherein the second sequence of subframes comprises between 3 seconds and 8 seconds of the video stream, inclusive.

16. The method according to claim 1 , wherein the second sequence of subframes comprises between 100 subframes and 200 subframes, inclusive.

17. The method according to claim 1 , wherein the oscillation threshold is between 5 and 20, inclusive, wherein average intensity values are between 0 and 1, inclusive, and wherein the amplitude threshold is between 0.65 and 0.95, inclusive.

18. A system comprising:

a processor; and

a non-transitory computer-readable storage medium communicatively coupled to the processor and storing program instructions, which, when executed by the processor, are configured to cause the processor to perform a method comprising:

storing a first sequence of frames of a video stream in a first buffer;

generating a second sequence of subframes corresponding to a first portion of respective frames in the first sequence of frames;

storing the second sequence of subframes in a second buffer;

generating average intensity values for respective subframes in the second sequence of subframes;

calculating intensity changes between consecutive subframes in the second sequence of subframes based on the average intensity values;

determining that a number of intensity changes between consecutive subframes in the second sequence of subframes exceeds an oscillation threshold, wherein respective intensity changes in the number of intensity changes exceed an amplitude threshold; and

tagging frames in the first sequence of frames as containing an epileptic trigger in response to determining that the number of intensity changes between consecutive subframes in the second sequence of subframes exceeds the oscillation threshold.

19. A computer program product comprising a computer-readable storage medium storing program instructions, wherein the computer-readable storage medium is not a transitory signal per se, wherein the program instructions are executable by a processor to cause the processor to perform a method comprising:

storing a first sequence of frames of a video stream in a first buffer;

generating a second sequence of subframes corresponding to a first portion of respective frames in the first sequence of frames;

storing the second sequence of subframes in a second buffer;

generating average intensity values for respective subframes in the second sequence of subframes;

calculating intensity changes between consecutive subframes in the second sequence of subframes based on the average intensity values;

determining that a number of intensity changes between consecutive subframes in the second sequence of subframes exceeds an oscillation threshold, wherein respective intensity changes in the number of intensity changes exceed an amplitude threshold; and

tagging frames in the first sequence of frames as containing an epileptic trigger in response to determining that the number of intensity changes between consecutive subframes in the second sequence of subframes exceeds the oscillation threshold.

20. The computer program product according to claim 19 , wherein the instructions are stored in a computer-readable storage medium in a server data processing system, and wherein the instructions are downloaded over a network to a remote data processing system for use in a computer readable storage medium with the remote system.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2018
From: RECHNER, ISTVAN; PONEKKER, ZOLTAN; EGYED, PATRIK
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 047310/0639 →
Continuity (1)
Related Publication 20200137347A1 · Apr 30, 2020
Cited By (1)
US 12,327,637