IP Library › Granted Patent US 9,846,961
Granted Patent B2
US 9,846,961 · App. 14/909,660 · Granted Dec 19, 2017

System and method of limiting processing by a 3D reconstruction system of an environment in a 3D reconstruction of an event occurring in an event space

Inventors: Oren Haimovitch-Yogev (Tel Aviv, IL); Matteo Shapira (Tel Aviv, IL); Aviv Shapira (Tel Aviv, IL); Diego Prilusky (Tel Aviv, IL); Yaniv Ben Zvi (Tel Aviv, IL); Adi Gilat (Tel Aviv, IL)
Assignee: Intel Corporation
G06T15/205G06T7/0051G06T7/0081G06T11/003H04N13/0203G06T2207/20144G06T2210/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,846,961
App. No.
14/909,660
Granted
Dec 19, 2017
Kind
B2
Abstract

A method of limiting processing by a 3D reconstruction system of an environment in a 3D reconstruction of an event includes dividing by the subdivision module the volume into sub-volumes; projecting from each camera each of the sub-volumes to create a set of sub-volumes masks relative to each camera; creating an imaging mask for each camera; comparing for each camera by the subdivision module the respective imaging mask to the respective sub-volume mask and extracting at least one feature from at least one imaging mask; saving by the subdivision module the at least one feature to a subspace division mask; cropping the at least one feature from the imaging frames using the subspace division mask; and processing only the at least one feature for a 3D reconstruction. The system includes cameras for recording the event in imaging frames; and a subdivision module for dividing the volume into sub-volumes.

Claims (39)

1. A method of limiting processing by a 3D reconstruction system of an environment in a 3D reconstruction of an event occurring in an event space; the method comprising the steps of:

(a) determining by a user a volume of the event space;

(b) defining by a user the volume for a system, the system comprising a subdivision module and a plurality of cameras, the plurality of cameras for recording the event in a plurality of imaging frames;

(c) dividing by the subdivision module the volume into a plurality of sub-volumes, the volume comprising the plurality of sub-volumes;

(d) projecting from each camera by the subdivision module each of the sub-volumes to create a plurality of sub-volume masks relative to each camera;

(e) recording the event by the system;

(f) creating by the subdivision module an imaging mask for each camera;

(g) comparing for each camera by the subdivision module the respective imaging mask to the respective sub-volume mask and extracting by the subdivision module at least one feature from at least one imaging mask, the at least one feature related to the event;

(h) saving by the subdivision module the at least one feature to a subspace division mask;

(i) cropping by the system of the at least one feature from the imaging frames using the subspace division mask; and

(j) processing by the system only the at least one feature for a 3D reconstruction.

2. The method of claim 1 , wherein

the system further comprises a server associated with the plurality of cameras;

the method further comprises between steps (d) and (e) the step of

storing by the subdivision module each of the sub-volume masks in a memory of the server.

3. The method of claim 1 , wherein

the system further comprises a plurality of servers, each server associated with a respective camera of the plurality of cameras;

the method further comprises between steps (d) and (e) the step of

storing by the subdivision module the sub-volume mask associated with the respective camera in a memory of the server associated with that respective camera.

4. The method of claim 1 , further comprising before step (j) the step of

storing for each camera by the subspace division module a listing of all sub-volumes having at least one feature in a matrix.

5. The method of claim 4 , wherein step (j) is performed by processing by the system only the at least one feature in a sub-volume listed in the matrix.

6. A system for limiting processing of an environment in a 3D reconstruction of an event occurring in an event space, the event space comprising a volume, the system comprising:

a plurality of cameras, the plurality of cameras for recording the event in a plurality of imaging frames;

a subdivision module

dividing the volume into a plurality of sub-volumes, the volume comprising the plurality of sub-volumes;

projecting from each camera by the subdivision module each of the sub-volumes to create a plurality of sub-volume masks relative to each camera;

recording the event by the system;

creating by the subdivision module an imaging mask for each camera;

comparing for each camera by the subdivision module the respective imaging mask to the respective sub-volume mask and extracting by the subdivision module at least one feature from at least one imaging mask, the at least one feature related to the event;

saving by the subdivision module the at least one feature to a subspace division mask;

cropping by the system of the at least one feature from the imaging frames using the subspace division mask; and

wherein the system processes only the at least one feature for a 3D reconstruction.

7. The system of claim 6 , further comprising a server associated with the plurality of cameras;

wherein the subdivision module stores each of the sub-volume masks in a memory of the server.

8. The system of claim 6 , further comprises a plurality of servers, each server associated with a respective camera of the plurality of cameras;

wherein the subdivision module stores the sub-volume mask associated with the respective camera in a memory of the server associated with that respective camera.

9. The system of claim 6 , wherein the subdivision module stores for each camera by the subspace division module a listing of all sub-volumes having at least one feature in a matrix.

10. The system of claim 9 , wherein the system processes only the at least one feature in a sub-volume listed in the matrix.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 30, 2016
From: REPLAY TECHNOLOGIES, INC.
To: INTEL CORPORATION
Reel/Frame 040811/0358 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 31, 2016
From: GILAT, ADI
To: REPLAY TECHNOLOGIES INC.
Reel/Frame 038163/0494 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 23, 2016
From: REPLAY VIDEO TECHNOLOGIES LTD.
To: REPLAY TECHNOLOGIES INC.
Reel/Frame 037793/0188 →
Continuity (4)
Provisional Application 61986439 · Apr 30, 2014
Provisional Application 62071943 · Oct 31, 2014
Provisional Application 62073596 · Oct 31, 2014
Related Publication 20160189421A1 · Jun 30, 2016