IP Library Granted Patent US 10,516,878
Granted Patent B1
US 10,516,878 · App. 15/995,678 · Granted Dec 24, 2019

Stereoscopic viewer

Inventors: Brad Hitchcock (Encinitas, CA); Vachara Tatar Nusso (San Clemente, CA); Robert Murray Pardridge (San Marcos, CA); Kenneth Austin Abeloe (Carlsbad, CA); Benjamin L. Ochoa (Carlsbad, CA)
Assignee: Centauri, LLC
H04N13/341H04N13/117H04N13/122H04N13/167H04N13/398
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,516,878
App. No.
15/995,678
Granted
Dec 24, 2019
Kind
B1
Abstract

Features for a lightweight stereoscopic viewing client are described. The client can generate accurate ground point coordinates from selections within the lightweight viewer by accumulating the transformations from original image sources to the images used to render the stereoscopic scene to accurately predict error for a point selection. The viewer may also be decoupled from a permanent image store allowing on-demand retrieval of images via a network for stereoscopic viewing.

Claims (56)

1. A non-transitory computer readable medium storing a client application plugin for rendering a stereoscopic scene in a web-browser on a client device in communication with a server device, the client application plugin comprising:

a client application interface configured to receive messages to:

initialize the client application plugin for rendering a stereoscopic scene;

identify a display area in the web-browser for presenting a stereoscopic scene;

identify an interaction within the display area, the interaction associated with: (i) a first coordinate within the display area of the interaction with a first view of the stereoscopic scene, and (ii) a second coordinate within the display area of the interaction with a second view of the stereoscopic scene;

generate a set of coordinates for a location identified by the interaction based at least in part on a user specified parallax, the set of coordinates including:

a viewport coordinate identifying the location using coordinates within the first view and the second view;

a rectified coordinate identifying the location within rectified versions of a first image and a second image using the viewport coordinate, wherein the first image forms at least a part of the first view, and wherein the second image forms at least a part of the second view;

an original image coordinate identifying the location within the at least one image and the at least one other image using the rectified coordinate; and

a spatial coordinate identifying the location as a geospatial location using the original image coordinate.

2. The non-transitory computer readable medium of claim 1 , wherein the client application interface is configured to:

generate a first viewport coordinate for the first view based at least in part on the first coordinate and the user specified parallax; and

generate a second viewport coordinate for the second view based at least in part on the second coordinate and the user specified parallax,

wherein the viewport coordinate included in the set of coordinates comprises one of the first viewport coordinate or the second viewport coordinate.

3. The non-transitory computer readable medium of claim 1 , wherein the client application interface is configured to:

generate a first rectified image coordinate based at least in part on a first viewport coordinate included in the set of coordinates, and at least one of: (i) a first scaling factor or (ii) a first translation applied to the at least one image shown in the first view; and

generate a second rectified image coordinate based at least in part on a second viewport coordinate included in the set of coordinates, and at least one of: (i) a second scaling factor or (ii) a second translation applied to the at least one other image shown in the second view,

wherein the rectified coordinate included in the set of coordinates comprises one of the first rectified image coordinate or the second rectified image coordinate.

4. The non-transitory computer readable medium of claim 1 , wherein the client application interface is configured to:

generate a first original image coordinate based at least in part on a first rectified image coordinate included in the set of coordinates and a first rectification applied to the at least one image shown in the first view; and

generate a second original image coordinate based at least in part on a second rectified image coordinate included in the set of coordinates and a second rectification applied to the at least one other image shown in the second view,

wherein the original image coordinate included in the set of coordinates comprises one of the first original image coordinate or the second original image coordinate.

5. The non-transitory computer readable medium of claim 1 , wherein the client application interface is configured to generate the spatial coordinate based at least in part on triangulation of a first original image coordinate and a second original image coordinate.

6. The non-transitory computer readable medium of claim 1 , wherein the spatial coordinate identifies a three dimensional location.

7. The non-transitory computer readable medium of claim 5 , wherein the client application interface is configured to:

generate an image point error estimate for the viewport coordinate by accumulating the errors from x-parallax, y-parallax in stereo space, from translation (x, y) and scale in rectified image space, and from a rectification process in original image space; and

generate the spatial coordinate using the image point error estimate generated by the client application interface.

8. The non-transitory computer readable medium of claim 7 , wherein the client application interface is configured to cause presentation of a perceivable indicator of the error estimate in conjunction with the stereoscopic scene.

9. The non-transitory computer readable medium of claim 8 , wherein the perceivable indicator comprises a color of a cursor displayed within the display area.

10. The non-transitory computer readable medium of claim 1 , wherein the client application interface is configured to:

determine that the interaction within the display area indicates a request to transmit a geospatial identifier for the location indicated by the interaction; and

cause transmission, via a network, of the spatial coordinates generated by the client application interface for the location indicated by the interaction.

11. A computer-implemented method for rendering a stereoscopic scene, the computer-implemented method comprising:

under control of one or more processing devices and via a client application plugin linked to a web-browser,

generating a stereoscopic scene including a left-eye view and a right-eye view for a specified location;

identifying a display area within the web-browser for presenting alternating views included in the stereoscopic scene based at least in part on a user specified parallax;

generating a left viewport coordinate identifying a location of a cursor in the display area using coordinates of the cursor in the left-eye view and the user specified parallax;

generating a right viewport coordinate identifying the location of the cursor using coordinates of the cursor in the right-eye view and the user specified parallax;

generating a left-view rectified coordinate identifying the location of the cursor within at least a portion of a first rectified image shown in the left-eye view using the left viewport coordinate;

generating a right-view rectified coordinate identifying the location of the cursor within at least a portion of a second rectified image shown in the right-eye view using the right viewport coordinate;

generating an original left image coordinate identifying the location of the cursor within the at least one image using the left-view rectified coordinate, the at least one image being a non-rectified version of the first rectified image;

generating an original right image coordinate identifying the location of the cursor within the at least one other image using the right-view rectified coordinate, the at least one other image being a non-rectified version of the second rectified image; and

generating a spatial coordinate identifying a geospatial location identified by the location of the cursor using the original left image coordinate and the original right image coordinate.

12. The computer-implemented method of claim 11 , wherein the left-view rectified coordinate is generated using the left viewport coordinate and at least one of: (i) a first scaling factor or (ii) a first translation applied to the first rectified image.

13. The computer-implemented method of claim 11 , wherein the left view coordinate is generated using the left-view rectified coordinate and a first rectification applied to the non-rectified version of the first rectified image.

14. The computer-implemented method of claim 11 , wherein the spatial coordinate is generated based at least in part on triangulation of the original left image coordinate and the original right image coordinate.

15. The computer-implemented method of claim 14 , further comprising:

generating an image point error estimate for the viewport coordinate by accumulating the errors from x-parallax, y-parallax in stereo space, from translation (x, y) and scale in rectified image space, and from a rectification process in original image space; and

generating the spatial coordinate using the image point error estimate.

16. The computer-implemented method of claim 15 , further comprising causing presentation of a perceivable indicator of the error estimate in conjunction with the stereoscopic scene.

17. The computer-implemented method of claim 16 , wherein the perceivable indicator comprises a color of a cursor displayed within the display area.

18. The computer-implemented method of claim 11 , wherein the spatial coordinate identifies a three dimensional location.

19. The computer-implemented method of claim 11 , further comprising:

determining that an interaction within the display area indicates a request to transmit a geospatial identifier for the location indicated by the cursor; and

causing transmission, via a network, of the spatial coordinates generated for the location indicated by the interaction.

20. The computer-implemented method of claim 11 , further comprising synchronizing alternating presentation of the left-eye view and the right-eye view with alternative activation of the left eye and the right eye of a stereoscopic viewing device based at least in part on a user specified parallax.

Assignments (5)
MERGER Recorded Jul 12, 2023
From: CENTAURI, LLC
To: KBR WYLE SERVICES, LLC
Reel/Frame 064228/0437 →
SECURITY INTEREST Recorded Jan 6, 2021
From: CENTAURI, LLC
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054827/0992 →
CONVERSION Recorded Oct 24, 2019
From: INTEGRITY APPLICATIONS INCORPORATED
To: IAI, LLC
Reel/Frame 050821/0510 →
CHANGE OF NAME Recorded Oct 24, 2019
From: IAI, LLC
To: CENTAURI, LLC
Reel/Frame 050821/0664 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 7, 2018
From: HITCHCOCK, BRAD; NUSSO, VACHARA TATAR; PARDRIDGE, ROBERT MURRAY; ABELOE, KENNETH AUSTIN; OCHOA, BENJAMIN L.
To: INTEGRITY APPLICATIONS INCORPORATED
Reel/Frame 046572/0007 →
Continuity (2)
Continuation 15658885 · Jul 25, 2017
Provisional Application 62372954 · Aug 10, 2016