IP Library Granted Patent US 9,489,596
Granted Patent B1
US 9,489,596 · App. 14/565,094 · Granted Nov 8, 2016

Optimal rapid serial visual presentation (RSVP) spacing and fusion for electroencephalography (EEG)-based brain computer interface (BCI)

Inventors: Deepak Khosla (Camarillo, CA); Matthew S. Keegan (Santa Monica, CA); Kevin R. Martin (Oak Park, CA)
Assignee: HRL Laboratories, LLC
G06K9/6263
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,489,596
App. No.
14/565,094
Granted
Nov 8, 2016
Kind
B1
Abstract

Described is system for optimizing rapid serial visual presentation (RSVP) spacing and fusion. The system receives a sequence of a plurality of rapid serial visual presentation (RSVP) image chips. The plurality of RSVP image chips are generated from an image via a pre-processing step and have a high probability of containing a target of interest. The system alters the order of the sequence of the plurality of RSVP image chips to increase the probability of detection of a true target of interest when presented to a human subject.

Claims (47)

1. A system for rapid serial visual presentation (RSVP) spacing and fusion, the system comprising:

one or more processors and a non-transitory computer-readable medium having executable instructions encoded thereon such that when executed, the one or more processors perform operations of:

receiving a sequence of a plurality of rapid serial visual presentation (RSVP) image chips having an order, wherein the plurality of RSVP image chips are generated from an image via a pre-processing step and have a high probability of containing a target of interest; and

altering the order of the sequence of the plurality of RSVP image chips to increase the probability of detection of a true target of interest when presented to a human subject.

2. The system as set forth in claim 1 , wherein if a posterior probability of a RSVP image chip containing a target of interest is known, then the one or more processors further perform an operation of removing the RSVP image chip from the sequence of the plurality of RSVP image chips if the posterior probability of the RSVP chip is equal to or above a predetermined threshold.

3. The system as set forth in claim 2 , wherein the predetermined threshold is set according to a permissible false positive rate.

4. The system as set forth in claim 1 , wherein the one or more processors further perform operations of:

performing N staggered raster scans of the image to generate N sequences of RSVP image chips; and

concatenating the N sequences of RSVP image chips.

5. The system as set forth in claim 1 , wherein the one or more processors further perform operations of:

removing a RSVP image chip from the sequence of the plurality of RSVP image chips if a posterior probability of the RSVP chip is equal to or above a predetermined threshold, thereby generating a plurality of remaining RSVP image chips;

performing N staggered raster scans of the image to generate N sequences of RSVP image chips from the remaining RSVP image chips; and

concatenating the N sequences of RSVP image chips.

6. The system as set forth in claim 1 , wherein if a likelihood of the presence of a target of interest in one or more RSVP image chips is above a predetermined percentile, then the one or more processors perform an operation of spacing the one or more RSVP image chips that are above the predetermined percentile between a plurality of RSVP image chips that are below the predetermined percentile.

7. A computer-implemented method for rapid serial visual presentation (RSVP) spacing and fusion, comprising:

an act of causing one or more processors to execute instructions stored on a non-transitory memory such that upon execution, the one or more processors perform operations of:

receiving a sequence of a plurality of rapid serial visual presentation (RSVP) image chips having an order, wherein the plurality of RSVP image chips are generated from an image via a pre-processing step and have a high probability of containing a target of interest; and

altering the order of the sequence of the plurality of RSVP image chips to increase the probability of detection of a true target of interest when presented to a human subject.

8. The method as set forth in claim 7 , wherein if a posterior probability of a RSVP image chip containing a target of interest is known, then the one or more processors further perform an operation of removing the RSVP image chip from the sequence of the plurality of RSVP image chips if the posterior probability of the RSVP chip is equal to or above a predetermined threshold.

9. The method as set forth in claim 8 , wherein the predetermined threshold is set according to a permissible false positive rate.

10. The method as set forth in claim 7 , wherein the one or more processors further perform operations of:

performing N staggered raster scans of the image to generate N sequences of RSVP image chips; and

concatenating the N sequences of RSVP image chips.

11. The method as set forth in claim 7 , wherein the one or more processors further perform operations of:

removing a RSVP image chip from the sequence of the plurality of RSVP image chips if a posterior probability of the RSVP chip is equal to or above a predetermined threshold, thereby generating a plurality of remaining RSVP image chips;

performing N staggered raster scans of the image to generate N sequences of RSVP image chips from the remaining RSVP image chips; and

concatenating the N sequences of RSVP image chips.

12. The method as set forth in claim 7 , wherein if a likelihood of the presence of a target of interest in one or more RSVP image chips is above a predetermined percentile, then the one or more processors perform an operation of spacing the one or more RSVP image chips that are above the predetermined percentile between a plurality of RSVP image chips that are below the predetermined percentile.

13. A computer program product for rapid serial visual presentation (RSVP) spacing and fusion, the computer program product comprising computer-readable instructions stored on a non-transitory computer-readable medium that are executable by a computer having a processor for causing the processor to perform operations of:

receiving a sequence of a plurality of rapid serial visual presentation (RSVP) image chips having an order, wherein the plurality of RSVP image chips are generated from an image via a pre-processing step and have a high probability of containing a target of interest; and

altering the order of the sequence of the plurality of RSVP image chips to increase the probability of detection of a true target of interest when presented to a human subject.

14. The computer program product as set forth in claim 13 , wherein if a posterior probability of a RSVP image chip containing a target of interest is known, then the one or more processors further perform an operation of removing the RSVP image chip from the sequence of the plurality of RSVP image chips if the posterior probability of the RSVP chip is equal to or above a predetermined threshold.

15. The computer program product as set forth in claim 14 , wherein the predetermined threshold is set according to a permissible false positive rate.

16. The computer program product as set forth in claim 13 , further comprising instructions for causing the processor to perform operations of:

performing N staggered raster scans of the image to generate N sequences of RSVP image chips; and

concatenating the N sequences of RSVP image chips.

17. The computer program product as set forth in claim 13 , further comprising instructions for causing the processor to perform operations of:

removing a RSVP image chip from the sequence of the plurality of RSVP image chips if a posterior probability of the RSVP chip is equal to or above a predetermined threshold, thereby generating a plurality of remaining RSVP image chips;

performing N staggered raster scans of the image to generate N sequences of RSVP image chips from the remaining RSVP image chips; and

concatenating the N sequences of RSVP image chips.

18. The computer program product as set forth in claim 13 , wherein if a likelihood of the presence of a target of interest in one or more RSVP image chips is above a predetermined percentile, then the one or more processors perform an operation of spacing the one or more RSVP image chips that are above the predetermined percentile between a plurality of RSVP image chips that are below the predetermined percentile.

19. A rapid serial visual presentation (RSVP) system, the system comprising:

one or more processors and a non-transitory computer-readable medium having executable instructions encoded thereon such that when executed, the one or more processors perform operations of:

receiving a sequence of a plurality of rapid serial visual presentation (RSVP) image chips having an order, wherein the plurality of RSVP image chips are generated from an image via a pre-processing step and have a high probability of containing a target of interest; and

altering the order of the sequence of the plurality of RSVP image chips to increase the probability of detection of a true target of interest when presented to a human subject;

a visual display for presenting the plurality of RSVP image chips to the human subject; and

at least one electoencephalography (EEG) sensor for measuring brain activity of the human subject.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 24, 2014
From: KHOSLA, DEEPAK; KEEGAN, MATTHEW S.; MARTIN, KEVIN R.
To: HRL LABORATORIES, LLC
Reel/Frame 034585/0463 →
Continuity (5)
Continuation In Part 14185908 · Feb 20, 2014
Division 12975352 · Dec 21, 2010
Division 14565094
Continuation In Part 14206421 · Mar 12, 2014
Provisional Application 61779258 · Mar 13, 2013