IP Library Granted Patent US 11,003,305
Granted Patent B2
US 11,003,305 · App. 15/355,240 · Granted May 11, 2021

3D user interface

Inventors: Clifford S. Champion (San Jose, CA); Eduardo Baraf (Mountain View, CA); Alexandre R. Lelievre (Hollywood, CA); Jonathan J. Hosenpud (San Francisco, CA)
Assignee: ZSPACE, INC.
G06F3/04815G06F3/011G06F3/012G06F3/013G06F3/04842G06F3/04845G06F16/9577G06Q30/0242H04N1/00962H04N13/279H04N13/293H04N13/344H04N13/356
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,003,305
App. No.
15/355,240
Granted
May 11, 2021
Kind
B2
Abstract

Systems and methods for displaying a three-dimensional (3D) workspace, including a 3D internet browser, in addition to a traditional two-dimensional (2D) workspace and for browsing the internet in a 3D/virtual reality workspace and transforming and/or upconverting objects and/or visual media from the 2D workspace and/or 2D webpages to the 3D workspace as 3D objects and/or stereoscopic output for display in the 3D workspace.

Claims (96)

1. A non-transitory computer readable memory medium storing programming instructions executable by a processor to:

detect, within a web browser, at least one instance of three dimensional (3D) content in a two-dimensional (2D) webpage structure, wherein a 2D webpage associated with the 2D webpage structure is displayed within the web browser via at least one display in communication with the processor, wherein the web browser is rendered as a first portion of a 3D workspace, wherein the 3D workspace includes a second portion, wherein the second portion is representative of a 3D virtual printer, and wherein the at least one instance of 3D content is associated with at least a portion of content of the 2D webpage;

convert the at least one instance of 3D content to a 3D object;

select, responsive to first user input, the at least one instance of 3D content;

copy, from the 2D webpage, the at least one instance of 3D content; and

render, responsive to second user input, the at least one instance of 3D content within the second portion of the 3D workspace, wherein the at least one instance of 3D content is rendered within the second portion of the 3D workspace based, at least in part, on a location of the at least one instance of 3D content in the 2D webpage structure at the time of the first user input, an orientation of the at least one instance of 3D content in the 2D webpage structure, and a location and orientation of a user input device at the time of the second user input, and wherein rendering the at least one instance of 3D content within the second portion of the 3D workspace initiates 3D printing of the at least one instance of 3D content.

2. The non-transitory computer readable memory medium of claim 1 ,

wherein the 3D content comprises one or more of:

embedded JavaScript;

nested JavaScript;

one or more uniform resource locators; or

one or more plugin-based viewers.

3. The non-transitory computer readable memory medium of claim 1 ,

wherein the at least one instance of 3D content is rendered within the 3D workspace further based, at least in part, on one or more of:

a location of mesh data;

a location of texture and shader data;

a scale of mesh data; or

bounding box dimensions of mesh data.

4. The non-transitory computer readable memory medium of claim 1 ,

wherein the first user input and the second user input each comprise one or more of:

a detected gesture of a user; or

a detected selection via a virtual beam projected from a user input device.

5. The non-transitory computer readable memory medium of claim 1 ,

wherein the program instructions are further executable to:

receive third user input altering the rendering of the at least one instance of 3D content wherein the at least one instance of 3D content is an advertisement; and

wherein, when the at least one instance of 3D content is an advertisement, the program instructions are further executable to:

provide, to a server hosting the advertisement, feedback regarding the third user input, wherein the feedback is usable for metrics on advertisement interaction levels and efficacy.

6. The non-transitory computer readable memory medium of claim 1 ,

wherein, to initiate 3D printing of the at least one instance of 3D content, the program instructions are further executable to:

provide instructions to the 3D printer for printing of the at least one instance of 3D content.

7. The non-transitory computer readable memory medium of claim 1 ,

wherein the 3D content further comprises stereoscopic content, wherein the stereoscopic content is included in the 2D webpage structure via a non-natively stereoscopic format, and wherein the non-natively stereoscopic format comprises one of a side-by-side format, a top-bottom format, an interleaved format, and an anaglyph.

8. A three-dimensional (3D) stereoscopic display system comprising:

at least one processor;

one or more displays, coupled to the at least one processor; and

a memory coupled to the at least one processor, wherein the memory has stored thereon instructions executable by the at least one processor to:

detect, within a web browser, three dimensional (3D) content in a two-dimensional (2D) webpage structure, wherein the 3D content is associated with at least a portion of content of a 2D webpage associated with the 2D webpage structure, wherein the web browser is rendered as a first portion of a 3D workspace, wherein the 3D workspace includes a second portion, wherein the second portion is representative of a 3D virtual printer, and wherein the 3D content is embedded within a webpage structure of the 2D webpage;

render, in the web browser and via the one or more displays, the 2D webpage;

identify, based on a scan of the 2D webpage structure for 3D content, the 3D content, wherein the 3D content comprises a set of images and associated locations of the images within the 2D webpage structure, wherein the set of images include unordered images, and wherein, to render the set of images, the instructions are further executable to order the unordered images within the set of images;

select, responsive to first user input, the 3D content;

copy, from the 2D webpage, the 3D content; and

render, responsive to second user input, the 3D content within the second portion of the 3D workspace, wherein the 3D content is rendered within the second portion of the 3D workspace based, at least in part, on a location of the 3D content in the 2D webpage structure at the time of the first user input, an orientation of the 3D content in the 2D webpage structure, and a location and orientation of a user input device at the time of the second user input, and wherein rendering the 3D content within the second portion of the 3D workspace initiates 3D printing of the 3D content.

9. The 3D stereoscopic display system of claim 8 ,

wherein the 3D content comprises one or more of:

embedded JavaScript;

nested JavaScript;

one or more uniform resource locators; or

one or more plugin-based viewers.

10. The 3D stereoscopic display system of claim 8 ,

wherein the 3D content is rendered within the 3D workspace further based, at least in part, on one or more of:

a location of mesh data;

a location of texture and shader data;

a scale of mesh data; or

bounding box dimensions of mesh data.

11. The 3D stereoscopic display system of claim 8 ,

wherein the first user input and the second user input each comprise one or more of:

a detected gesture of a user; or

a detected selection via a virtual beam projected from a user input device.

12. The 3D stereoscopic display system of claim 8 ,

wherein the instructions are further executable to:

receive third user input altering the rendering of the 3D content, wherein the 3D content is an advertisement; and

wherein, when the 3D content is an advertisement, the instructions are further executable to:

provide, to a server hosting the advertisement, feedback regarding the third user input, wherein the feedback is usable for metrics on advertisement interaction levels and efficacy.

13. The 3D stereoscopic display system of claim 8 ,

wherein, to initiate 3D printing of the 3D content, the instructions are further executable by the at least one processor to:

provide instructions to the 3D printer for printing of the 3D content.

14. The 3D stereoscopic display system of claim 8 ,

wherein the 3D content further comprises stereoscopic content, wherein the stereoscopic content is included in the 2D webpage structure via a non-natively stereoscopic format, and wherein the non-natively stereoscopic format comprises one of a side-by-side format, a top-bottom format, an interleaved format, and an anaglyph.

15. A method for dragging an object from a webpage, comprising:

rendering a two-dimensional (2D) webpage, wherein the 2D webpage comprises 2D content and three-dimensional (3D) content, wherein the 3D content is embedded within a webpage structure of the 2D webpage, wherein the 2D webpage is rendered as a first portion of a 3D workspace, wherein the 3D workspace includes a second portion, wherein the second portion is representative of a 3D virtual printer;

identifying, based on a scan of the webpage structure for 3D content, the 3D content, wherein the 3D content comprises a set of images and associated locations of the images within the 2D webpage structure, wherein the set of images include unordered images, and wherein rendering the set of images comprises ordering the unordered images within the set of images;

selecting, responsive to first user input, the 3D content;

copying, from the 2D webpage, the 3D content; and

rendering, responsive to second user input, the 3D content within the second portion of the 3D workspace, wherein the 3D content is rendered within the second portion of the 3D workspace based, at least in part, on a location of the 3D content in the 2D webpage structure at the time of the first user input, an orientation of the 3D content in the 2D webpage structure, and a location and orientation of a user input device at the time of the second user input, and wherein rendering the 3D content within the second portion of the 3D workspace initiates 3D printing of the 3D content.

16. The method of claim 15 ,

wherein the 3D content comprises one or more of:

embedded JavaScript;

nested JavaScript;

one or more uniform resource locators; or

one or more plugin-based viewers.

17. The method of claim 15 ,

wherein the 3D content is rendered within the 3D workspace further based, at least in part, on one or more of:

a location of mesh data;

a location of texture and shader data;

a scale of mesh data; or

bounding box dimensions of mesh data.

18. The method of claim 15 ,

wherein the first user input and the second user input each comprise one or more of:

a detected gesture of a user; or

a detected selection via a virtual beam projected from a user input device.

19. The method of claim 15 , further comprising:

receiving third user input altering the rendering of the at least one instance of 3D content wherein the at least one instance of 3D content is an advertisement; and

providing, to a server hosting the advertisement, feedback regarding the third user input, wherein the feedback is usable for metrics on advertisement interaction levels and efficacy.

20. The method of claim 15 ,

wherein, to initiate 3D printing of the at least one instance of 3D content, the method further comprises:

providing instructions to the 3D printer for printing of the 3D content.

Assignments (8)
SECURITY INTEREST Recorded Apr 14, 2025
From: ZSPACE, INC.
To: 3I, L.P.
Reel/Frame 070826/0887 →
RELEASE OF PATENT SECURITY AGREEMENT Recorded Feb 6, 2023
From: EAST WEST BANK
To: ZSPACE, INC.
Reel/Frame 062640/0162 →
SECURITY INTEREST Recorded Sep 17, 2021
From: ZPACE, INC.
To: EAST WEST BANK
Reel/Frame 057651/0222 →
SECURITY INTEREST Recorded May 22, 2019
From: ZSPACE, INC.
To: BSPACE INVESTMENTS LIMITED
Reel/Frame 049259/0533 →
RELEASE OF SECURITY INTEREST Recorded May 8, 2019
From: RUNWAY GROWTH CREDIT FUND INC.
To: ZSPACE, INC. (F/K/A INFINITE Z, INC.)
Reel/Frame 049113/0898 →
SECURITY INTEREST Recorded Jan 2, 2018
From: ZSPACE, INC. (F/K/A INFINITE Z, INC.)
To: RUNWAY GROWTH CREDIT FUND INC.
Reel/Frame 044985/0721 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 5, 2017
From: HOSENPUD, JONATHAN J.
To: ZSPACE, INC.
Reel/Frame 044299/0141 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2016
From: CHAMPION, CLIFFORD S.; BARAF, EDUARDO; LELIEVRE, ALEXANDRE R.
To: ZSPACE, INC.
Reel/Frame 040366/0356 →
Continuity (1)
Related Publication 20180143757A1 · May 24, 2018