IP Library Granted Patent US 10,321,126
Granted Patent B2
US 10,321,126 · App. 14/792,844 · Granted Jun 11, 2019

User input device camera

Inventors: Jonathan J. Hosenpud (San Francisco, CA); Arthur L. Berman (San Jose, CA); Jerome C. Tu (Saratoga, CA); Kevin D. Morishige (Los Altos Hills, CA); David A. Chavez (San Jose, CA)
Assignee: zSpace, Inc.
H04N13/398H04N13/334H04N13/337H04N13/366
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,321,126
App. No.
14/792,844
Granted
Jun 11, 2019
Kind
B2
Abstract

Systems and methods for capturing a two dimensional (2D) image of a portion of a three dimensional (3D) scene may include a computer rendering a 3D scene on a display from a user's point of view (POV). A camera mode may be activated in response to user input and a POV of a camera may be determined. The POV of the camera may be specified by position and orientation of a user input device coupled to the computer, and may be independent of the user's POV. A 2D frame of the 3D scene based on the POV of the camera may be determined and the 2D image based on the 2D frame may be captured in response to user input. The 2D image may be stored locally or on a server of a network.

Claims (64)

1. A computer-implemented method for capturing a virtual two dimensional (2D) image of a portion of a virtual three dimensional (3D) scene, comprising:

a computer performing:

rendering a virtual 3D scene on a display from a user's point of view (POV);

activating a camera mode in response to first user input via a user input device in communication with the computer, wherein the user input device comprises a stylus, wherein the camera mode enables the user input device to trigger the computer to capture virtual images within the virtual 3D scene based on a POV of the user input device;

determining the POV of the user input device, wherein the POV of the user input device is independent of the user's POV;

determining a virtual 2D frame of the virtual 3D scene based on the POV of the user input device;

capturing the virtual 2D image based on the virtual 2D frame and in response to second user input via the user input device; and

storing the virtual 2D image.

2. A non-transitory computer readable memory medium storing programming instructions executable by a processor to:

render a virtual three dimensional (3D) scene on a display;

activate a camera mode in response to first user input via a user input device, wherein the user input device comprises a handheld pointing device, wherein the camera mode enables the user input device to trigger capture of virtual two dimensional (2D) images within the virtual 3D scene based on a point of view (POV) of the user input device;

determine the POV of the user input device based on a position and orientation of the user input device;

determine a virtual 2D frame on the display based on the POV of the user input device;

capture a virtual 2D image based on the virtual 2D frame and in response to second user input via the user input device; and

store the virtual 2D image.

3. A system comprising:

at least one display;

at least one user input device comprising at least one accelerometer and at least one gyroscope; and

a processor coupled to the at least one display and the at least one user input device, wherein the processor is configured to:

render a virtual three dimensional (3D) scene on the at least one display;

activate a camera mode in response to first user input, wherein the camera mode enables the at least one user input device to trigger capture of virtual two dimensional (2D) images within the virtual 3D scene based on a point of view (POV) of the at least one user input device;

determine the POV of the at least one user input device based on a position and orientation of the at least one user input device;

determine a 2D virtual frame on the display based on the POV of the at least one user input device;

capture a virtual 2D image based on the 2D virtual frame and in response to second user input via the user input device; and

store the virtual 2D image.

4. The computer-implemented method of claim 1 ,

wherein the first user input comprises a button click on the user input device.

5. The computer-implemented method of claim 1 ,

wherein capturing the virtual 2D image comprises capturing a sequence of virtual 2D images; and

wherein storing the virtual 2D image comprises storing the sequence of virtual 2D images.

6. The computer-implemented method of claim 5 ,

wherein the POV of the user input device is an initial POV;

wherein capturing the sequence of virtual 2D images comprises dynamically changing the initial POV based on a user specified path, thereby generating a set of POVs based on the user specified path.

7. The computer-implemented method of claim 6 ,

wherein the user specified path is based on a path of the user input device through the 3D scene.

8. The computer-implemented method of claim 6 ,

wherein the user further specifies a direction of the set of POVs with respect to the user specified path.

9. The computer-implemented method of claim 6 ,

wherein the user specified path comprises a path of an object of interest.

10. The computer-implemented method of claim 1 ,

wherein capturing the virtual 2D image comprises capturing one or more virtual 2D images based on a user specified schedule.

11. The non-transitory computer readable memory medium of claim 2 ,

wherein to capture the virtual 2D image, the program instructions are further executable to capture a sequence of virtual 2D images; and

wherein to store the virtual 2D image, the program instructions are further executable to store the sequence of virtual 2D images.

12. The non-transitory computer readable memory medium of claim 11 ,

wherein the POV of the user input device is an initial POV;

wherein to capture the sequence of virtual 2D images, the program instructions are further executable to dynamically change the initial POV based on a user specified path, thereby generating a set of POVs based on the user specified path.

13. The non-transitory computer readable memory medium of claim 12 ,

wherein the user specified path is based on a path of the user input device through the 3D scene.

14. The non-transitory computer readable memory medium of claim 12 ,

wherein the user further specifies a direction of the set of POVs with respect to the user specified path.

15. The non-transitory computer readable memory medium of claim 12 ,

wherein the user specified path comprises a path of an object of interest.

16. The non-transitory computer readable memory medium of claim 2 ,

wherein to capture the virtual 2D image, the program instructions are further executable to capture one or more virtual 2D images based on a user specified schedule.

17. The system of claim 3 ,

wherein the POV of the user input device is an initial POV;

wherein to capture the sequence of virtual 2D images, the processor is further configured to dynamically change the initial POV based on a user specified path, thereby generating a set of POVs based on the user specified path.

18. The system of claim 17 ,

wherein the user specified path is based on a path of the user input device through the 3D scene.

19. The system of claim 17 ,

wherein the user specified path comprises a path of an object of interest.

20. The system of claim 3 ,

wherein to capture the virtual 2D image, the processor is further configured to capture one or more virtual 2D images based on a user specified schedule.

Assignments (7)
SECURITY INTEREST Recorded Apr 14, 2025
From: ZSPACE, INC.
To: 3I, L.P.
Reel/Frame 070826/0887 →
RELEASE OF PATENT SECURITY AGREEMENT Recorded Feb 6, 2023
From: EAST WEST BANK
To: ZSPACE, INC.
Reel/Frame 062640/0162 →
SECURITY INTEREST Recorded Sep 17, 2021
From: ZPACE, INC.
To: EAST WEST BANK
Reel/Frame 057651/0222 →
SECURITY INTEREST Recorded May 22, 2019
From: ZSPACE, INC.
To: BSPACE INVESTMENTS LIMITED
Reel/Frame 049259/0533 →
RELEASE OF SECURITY INTEREST Recorded May 8, 2019
From: RUNWAY GROWTH CREDIT FUND INC.
To: ZSPACE, INC. (F/K/A INFINITE Z, INC.)
Reel/Frame 049113/0898 →
SECURITY INTEREST Recorded Jan 2, 2018
From: ZSPACE, INC. (F/K/A INFINITE Z, INC.)
To: RUNWAY GROWTH CREDIT FUND INC.
Reel/Frame 044985/0721 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 18, 2016
From: HOSENPUD, JONATHAN J.; BERMAN, ARTHUR L.; TU, JEROME C.; CHAVEZ, DAVID A.; MORISHIGE, KEVIN D.
To: ZSPACE, INC.
Reel/Frame 037510/0415 →
Continuity (2)
Provisional Application 62022014 · Jul 8, 2014
Related Publication 20160014391A1 · Jan 14, 2016