IP Library › Granted Patent US 10,921,885
Granted Patent B2
US 10,921,885 · App. 16/855,181 · Granted Feb 16, 2021

Occupant supports and virtual visualization and navigation

Inventor: Arjuna Indraeswaran Rajasingham (Bethesda, MD)
G06F3/013G02B27/017G06F3/04815G06F3/04842G06T15/205G06T19/003H04L67/38H04N5/23238H04N7/183H04N7/185H04N13/218H04N13/221H04N13/243H04N13/344H04R1/08G02B2027/0138G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,921,885
App. No.
16/855,181
Granted
Feb 16, 2021
Kind
B2
Abstract

Apparatus and method for using light fields for virtual visualization and virtual navigation.

Claims (35)

1. A system for virtual visualization of a real space comprising:

a User Member with a user interface comprising a display, wherein said User Member is connected to an Active Network hosted by computing resources to enable a real time virtual visualization infrastructure for a real space comprising a plurality of Sources, wherein said infrastructure is enabled by an internet with at least one digital communications protocol;

a plurality of Source Members, each comprising at least one of said Sources each comprising one or more cameras configured to provide visual stimuli to the User:

wherein one or more of said cameras on at least one Source Member are enabled to construct a Light Field between available Sources;

wherein each of the Sources are at Source Points;

wherein said Source Points are configured to move;

wherein the Network derives Source physical location information through their respective Source Members in the Network;

wherein locations of each of said Sources is determined by the Active Network;

wherein said system is configured to deconstruct said light fields of Sources and reconstruct light fields for Source Points between available Sources to at least one of: interpolate to construct at least one view at a location of a interpolated Source Point distinct from a location of any of the Sources; construct a 3D visualization; and construct a field of view of a selected Source with reconstructed occluded regions;

Wherein said Active Network is configured to provide interpolation processing;

Wherein said Active network generates at least one Plenoptic Function across an aggregate light field from said cameras located at each of said Source points configured to generate light fields from one or more of said Sources.

2. A system for virtual visualization as in claim 1 , wherein the at least one Source Member Light Field comprises a light field constructed by the motion of the one or more cameras.

3. A system for virtual visualization as in claim 1 , wherein the at least one Source Member Light Field comprises a plurality of Source Light Fields generated by a plurality of Sources attached to said Source Member of said plurality of Source Members.

4. A system for virtual visualization as in claim 1 , wherein at least one of said Sources are configured to move relative to its Source Member.

5. A system for virtual visualization as in claim 1 , wherein at least one of said Source Members is a Machine Source Member (MCM).

6. A system for virtual visualization as in claim 1 , wherein at least one of said Sources are mounted on a Source Vehicle of said Source controlled by its Source Member.

7. A system for virtual visualization as in claim 6 , wherein a plurality of said Sources mounted on their Source Vehicles fly in swarms, wherein each of their flight paths are controlled by their Source Member.

8. A system for virtual visualization as in claim 6 , wherein the Active Network controls the flight path of said Source vehicles.

9. A system for virtual visualization as in claim 8 , wherein at least one of said Users instruct the Active Network on desired at least one of Synthetic Source Points, 3D visualizations, reconstruction of occluded regions, thereby defining the required light field density in a local region of said Aggregate Light Field.

10. A system for virtual visualization as in claim 9 , wherein the constituent parts of the Aggregate light field used for the construction of the at least one of Synthetic Source Points, 3D visualizations, reconstruction of occluded regions, uses real time light fields in the region when the field of view is changing over time and include previously saved time lagged light field components in the local region which used in combination increase the clarity of the visualization.

11. A system for virtual visualization as in claim 1 , wherein one or both of: a plurality of cameras are configured to have distinct focal lengths; and at least one camera is configured to have a plurality of focal lengths at a sequence of times, thereby capture different slices in the Fourier domain of the 4-D light fields and enabling refocusing ex-post.

12. A system for virtual visualization as in claim 1 , wherein a plurality of cameras constitute a cluster camera.

13. A system for virtual visualization as in claim 12 , wherein a cluster camera is one or more of a wide angle camera, a rectangular array, an elliptical array.

14. A system for virtual visualization as in claim 13 , wherein said cluster camera is a 360 degree view camera.

15. A system for virtual visualization as in claim 6 , wherein one or more of said Source Vehicles are configured to have electromagnetic field sensors to detect EM fields in a neighborhood of a flight path, and have landing gear for parking to park in the vicinity of said EM field as detected by said electro-magnetic field sensors, and inductive coupling coils which are configured to couple to the EM field to charge a vehicle battery.

16. A system for virtual visualization as in claim 15 , wherein a swarm of Source vehicles communicate to share among each other, EM charging opportunities.

17. A system for virtual visualization as in claim 1 , wherein the generated Aggregate Light Field is archived to generate a history of Aggregate Light Fields to construct Real Maps to enable documentaries of the past with one or both of video and static images.

18. A system for virtual visualization as in claim 1 , further configured for virtual navigation of a real space:

wherein a first field of view of one of the at least one Source of the plurality of Source Members comprises a plurality of icons representing locations of other Sources for selection of said Sources;

wherein selection of the locations of said icons available for selection in said first field of view of one of the at least one Source of the plurality of Source Members, is the selection of the locations of their corresponding Sources;

wherein virtual navigation of the User Member comprises changing the display of the first field of view of one of the at least one Source of the plurality of Source Members to the display of a desired second field of view of one of the at least one Source of the plurality of Source Members, which is enabled by said User Member selecting an icon of the plurality of icons displayed in said first field of view of one of the at least one Source of the plurality of Source Members wherein said selected icon is at the location of the desired one of the at least one Source of the plurality of Source Members, at the time of presence of said Source at the location of the Source Point corresponding to the second field of view;

wherein the User Member is enabled to select a starting point at one of: a location comprising a native real environment of the User; and a menu of selection options from a choice of Sources;

wherein upon selection of the starting point it is displayed as the first field of view, that comprises a plurality of icons that represent locations of other Sources available for selection and navigation thereto.

19. A System for Virtual Visualization as in claim 1 , wherein User-Sources are User devices with Sources, wherein one or more of said Sources of User-Sources are mobile phones and are supported by their Source Members that are configured to be supported by a human user wherein said support is configured to redirect the light field incident on mirrors thereby directing it to the Source cameras while allowing the human User to view the screen of the mobile phone as a User of the Navigation system.

20. A system for virtual navigation as in claim 18 , further comprising block chain nodes at each of said Sources and Users, wherein a Block Chain Transaction comprises a plurality of: a Source Start Time, a Source End Time, a Source Start Location, a Source End Location, a Summary Statistic of Data communicated from Source to User, and wherein a series of transactions generate a block chain, and wherein inspection of replicated databases of the blockchain on the nodes provides a verifiable history of virtual navigation of the User.

Continuity (87)
Continuation In Part 16430061 · Jun 3, 2019
Continuation In Part 16138998 · Sep 22, 2018
Continuation In Part 15878488 · Jan 24, 2018
Continuation In Part 15878488
Continuation In Part 15872108 · Jan 16, 2018
Continuation In Part 15872108
Continuation In Part PCTUS2017064626 · Dec 5, 2017
Continuation In Part 15203882 · Jul 7, 2016
Continuation In Part 15203882
Continuation In Part 15203882
Continuation In Part 15143168 · Apr 29, 2016
Continuation In Part 15143168
Continuation In Part 15143168
Continuation In Part 14903573
Continuation In Part 14852593 · Sep 13, 2015
Continuation In Part 14848575 · Sep 9, 2015
Continuation In Part 14726170 · May 29, 2015
Continuation In Part 14708584 · May 11, 2015
Continuation In Part 14600932 · Jan 20, 2015
Continuation In Part 14461395 · Aug 16, 2014
Continuation In Part 14375673
Continuation In Part 14210413 · Mar 13, 2014
Continuation In Part 14210413
Continuation In Part 14203088 · Mar 10, 2014
Continuation In Part 14203088
Continuation In Part 13820510
Continuation In Part 13694996 · Jan 24, 2013
Continuation In Part 13694996
Continuation In Part 13507149 · Jun 9, 2012
Continuation In Part 13507149
Continuation In Part 13138183
Continuation In Part 13138183
Continuation In Part 13138183
Continuation In Part 12735146
Continuation 12451317
Continuation In Part 11730161 · Mar 29, 2007
Continuation 11730161
Continuation In Part 11639088 · Dec 14, 2006
Continuation In Part 11639088
Continuation In Part 10790151 · Mar 2, 2004
Provisional Application 62480071 · Mar 31, 2017
Provisional Application 62430910 · Dec 6, 2016
Provisional Application 61961367 · Oct 12, 2013
Provisional Application 61961092 · Oct 4, 2013
Provisional Application 61959598 · Aug 28, 2013
Provisional Application 61957635 · Jul 8, 2013
Provisional Application 61848724 · Jan 10, 2013
Provisional Application 61797639 · Dec 12, 2012
Provisional Application 61797175 · Dec 1, 2012
Provisional Application 61744431 · Sep 26, 2012
Provisional Application 61688855 · May 23, 2012
Provisional Application 61688591 · May 17, 2012
Provisional Application 61686316 · Apr 3, 2012
Provisional Application 61685537 · Mar 20, 2012
Provisional Application 61632797 · Jan 31, 2012
Provisional Application 61465160 · Mar 15, 2011
Provisional Application 61460266 · Dec 29, 2010
Provisional Application 61459689 · Dec 16, 2010
Provisional Application 61458997 · Dec 3, 2010
Provisional Application 61404335 · Oct 1, 2010
Provisional Application 61402751 · Sep 3, 2010
Provisional Application 61276298 · Sep 9, 2009
Provisional Application 61270808 · Jul 14, 2009
Provisional Application 61215559 · May 7, 2009
Provisional Application 61214672 · Apr 27, 2009
Provisional Application 61211191 · Mar 27, 2009
Provisional Application 61208445 · Feb 24, 2009
Provisional Application 61206205 · Jan 28, 2009
Provisional Application 61198541 · Nov 6, 2008
Provisional Application 61191309 · Sep 8, 2008
Provisional Application 61188175 · Aug 7, 2008
Provisional Application 61123345 · Apr 8, 2008
Provisional Application 61072495 · Mar 31, 2008
Provisional Application 61072241 · Mar 28, 2008
Provisional Application 61066372 · Feb 20, 2008
Provisional Application 61062002 · Jan 23, 2008
Provisional Application 61006074 · Dec 17, 2007
Provisional Application 60960620 · Oct 5, 2007
Provisional Application 60960067 · Sep 13, 2007
Provisional Application 60962077 · Jul 26, 2007
Provisional Application 60928040 · May 7, 2007
Provisional Application 60849685 · Oct 5, 2006
Provisional Application 60848804 · Sep 29, 2006
Provisional Application 60787444 · Mar 30, 2006
Provisional Application 60751305 · Dec 19, 2005
Provisional Application 60450682 · Mar 3, 2003
Related Publication 20200272233A1 · Aug 27, 2020