IP Library Granted Patent US 10,402,985
Granted Patent B2
US 10,402,985 · App. 15/590,258 · Granted Sep 3, 2019

Collision prediction

Inventors: Gang Luo (Lexington, MA); Eliezer Peli (Boston, MA); Shrinivas Pundlik (Arlington, MA)
Assignee: The Schepens Eye Research Institute, Inc.
G06T7/207G06T7/246B60R21/013B60R2300/8093G06K9/00369G06K9/00805G06K9/00825G06T2207/10016G06T2207/20076G06T2207/30248G06T2207/30252G06T2207/30261G06T2210/21G06T2219/2016G08G1/16G08G9/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,402,985
App. No.
15/590,258
Granted
Sep 3, 2019
Kind
B2
Abstract

In some implementations, there is provided a method. The method may include receiving data characterizing a plurality of digital video frames; detecting a plurality of features in each of the plurality of digital video frames; determining, from the detected features, a local scale change and a translational motion of one or more groups of features between at least a pair of the plurality of digital video frames; and calculating a likelihood of collision. Related apparatus, systems, techniques, and articles are also described.

Claims (44)

1. A method comprising:

determining, using detected features in a plurality of digital video frames and between at least a pair of the plurality of digital video frames, an inter-frame rate of expansion in an area characterized by at least one group of features;

determining, based on the detected features and between at least the pair of the plurality of digital video frames, an average of an inter-frame difference in pixel position of at least two features in the at least one group of features;

calculating a likelihood of collision, wherein the likelihood of collision includes a ratio between the determined inter-frame rate of expansion and the determined average of inter-frame difference in pixel position;

comparing the likelihood of collision to a threshold; and

generating, in response to the likelihood of collision exceeding the threshold, an alarm that causes a vehicle to turn and/or causes the vehicle to slow down;

wherein at least one of the receiving, the detecting, the determining the inter-frame rate of expansion, the determining the average inter-frame difference in pixel position, the calculating, the comparing, and the generating is performed by at least one data processor.

2. The method of claim 1 , wherein the inter-frame rate of expansion characterizes a difference in an area defined by a convex hull of the at least one group of features.

3. The method of claim 1 , further comprising:

receiving data characterizing the plurality of digital video frames; and

detecting the plurality of features in the plurality of digital video frames.

4. The method of claim 1 , further comprising:

compensating, based on received data, the average inter-frame difference in pixel position, wherein the received data characterizes a motion of a camera, the motion being associated with the plurality of digital video frames.

5. The method of claim 1 , further comprising:

classifying the at least one group of features as being on a collision trajectory by at least comparing a collision point with a predetermined value defining a safety envelope around a camera.

6. A non-transitory computer readable storage medium comprising executable instructions which when executed by at least one processor provides operations comprising:

determining, using detected features in a plurality of digital video frames and between at least a pair of the plurality of digital video frames, an inter-frame rate of expansion in an area characterized by at least one group of features;

determining, based on the detected features and between at least the pair of the plurality of digital video frames, an average of an inter-frame difference in pixel position of at least two features in the at least one group of features;

calculating a likelihood of collision, wherein the likelihood of collision includes a ratio between the determined inter-frame rate of expansion and the determined average inter-frame difference in pixel position;

comparing the likelihood of collision to a threshold; and

generating, in response to the likelihood of collision exceeding the threshold, an alarm that causes a vehicle to turn and/or causes the vehicle to slow down.

7. The non-transitory computer readable storage medium of claim 6 , further comprising:

receiving data characterizing the plurality of digital video frames; and

detecting the plurality of features in the plurality of digital video frames.

8. The non-transitory computer readable storage medium of claim 6 , further comprising:

compensating, based on received data, the average inter-frame difference in pixel position, wherein the received data characterizes a motion of a camera, the motion being associated with the plurality of digital video frames.

9. The non-transitory computer readable storage medium of claim 6 , further comprising:

classifying the at least one group of features as being on a collision trajectory by at least comparing a collision point with a predetermined value defining a safety envelope around a camera.

10. A system comprising:

at least one processor circuitry;

at least one memory storing instructions which, when executed by the at least one processor circuitry, causes operations comprising:

determining, using detected features in a plurality of digital video frames and between at least a pair of the plurality of digital video frames, an inter-frame rate of expansion in an area characterized by at least one group of features;

determining, based on the detected features and between at least the pair of the plurality of digital video frames, an average of an inter-frame difference in pixel position of at least two features in the at least one group of features;

calculating a likelihood of collision, wherein the likelihood of collision includes a ratio between the determined inter-frame rate of expansion and the determined average inter-frame difference in pixel position;

comparing the likelihood of collision to a threshold; and

generating, in response to the likelihood of collision exceeding the threshold, an alarm that causes a vehicle to turn and/or causes the vehicle to slow down.

11. The system of claim 10 , wherein the inter-frame rate of expansion characterizes a difference in an area defined by a convex hull of the at least one group of features.

12. The system of claim 10 , wherein the operations further comprise:

receiving data characterizing the plurality of digital video frames; and

detecting the plurality of features in the plurality of digital video frames.

13. The system of claim 10 , wherein the operations further comprise:

compensating, based on received data, the average inter-frame difference in pixel position, wherein the received data characterizes a motion of a camera, the motion being associated with the plurality of digital video frames.

14. The system of claim 10 , wherein the operations further comprise:

classifying the at least one group of features as being on a collision trajectory by comparing a collision point with a predetermined value defining a safety envelope around a camera.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 1, 2017
From: LUO, GANG; PELI, ELIEZER; PUNDLIK, SHRINIVAS
To: THE SCHEPENS EYE RESEARCH INSTITUTE, INC.
Reel/Frame 043392/0744 →
Continuity (3)
Continuation 14430108
Provisional Application 61704410 · Sep 21, 2012
Related Publication 20170323451A1 · Nov 9, 2017