IP Library Granted Patent US 9,681,122
Granted Patent B2
US 9,681,122 · App. 14/257,105 · Granted Jun 13, 2017

Modifying displayed images in the coupled zone of a stereoscopic display based on user comfort

Inventors: Mark P. Wilson (San Jose, CA); Douglas C. Twilleager (Campbell, CA); David J. Borel (Sunnyvale, CA)
Assignee: zSpace, Inc.
H04N13/0468G06F3/012H04N13/0022
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,681,122
App. No.
14/257,105
Granted
Jun 13, 2017
Kind
B2
Abstract

Systems and methods for enhancement of a coupled zone of a 3D stereoscopic display. The method may include determining a size and a shape of the coupled zone. The coupled zone may include a physical volume specified by the user's visual depth of field with respect to screen position of the 3D stereoscopic display and the user's point of view. Content may be displayed at a first position with a virtual 3D space and the first position may correspond to a position within the coupled zone. It may be determined that the content is not contained in the coupled zone or is within a specified distance from a boundary of the coupled zone and, in response, display of the content may be adjusted such that the content has a second position in the virtual 3D space that corresponds to another position within the coupled zone.

Claims (110)

1. A method for presenting three dimensional (3D) virtual content via a 3D stereoscopic display, comprising:

determining a size and a shape of a coupled zone of a 3D stereoscopic display, wherein the 3D stereoscopic display presents a virtual 3D space to a user, and wherein the coupled zone comprises a physical volume specified by the user's visual depth of field with respect to screen position of the 3D stereoscopic display and a point of view (POV) of the user, wherein the physical volume corresponds to at least a portion of the virtual 3D space;

displaying the 3D virtual content at a first position in the virtual 3D space relative to the POV of the user in the virtual 3D space, wherein the first position corresponds to a position within the coupled zone;

determining that the 3D virtual content is not contained in the coupled zone or is within a specified distance from a boundary of the coupled zone, comprising determining that the 3D virtual content is moving within the coupled zone at a rate; and

adjusting, in response to said determining, display of the 3D virtual content in the virtual 3D space such that the 3D virtual content has a second position in the virtual 3D space that corresponds to another position within the coupled zone, comprising:

adjusting size of images rendered in one or more regions of the 3D virtual content; and

limiting the rate at which the 3D virtual content is moving with the coupled zone, thereby limiting a rate at which disparity changes within the coupled zone.

2. The method of claim 1 , wherein the coupled zone is a first coupled zone, wherein the POV of the user is a first POV of the user, wherein the method further comprises:

detecting position and movements of the user's head via a head tracking system;

determining a second POV of the user based on said detecting;

determining a size and a shape of a second coupled zone of the 3D stereoscopic display; and

wherein said determining that the 3D virtual content is not contained in the coupled zone further comprises:

determining that the 3D virtual content is not contained in the second coupled zone or is within a specified distance from a boundary of the second coupled zone; and

wherein said adjusting further comprises:

adjusting display of the 3D virtual content in the virtual 3D space such that the second position in the virtual 3D space corresponds to a position within the second coupled zone.

3. The method of claim 1 , wherein said adjusting further comprises:

adjusting disparity of one or more regions of the 3D virtual content.

4. The method of claim 1 , wherein said adjusting further comprises:

adjusting perspective of the images rendered in the one or more regions.

5. The method of claim 1 , wherein said adjusting comprises:

clamping disparity in a first region of the coupled zone; and

adjusting disparity in a second region of the coupled zone.

6. The method of claim 1 , wherein the 3D virtual content comprises a region of interest and a background, wherein said adjusting further comprises:

blurring one or more of:

the region of interest of the 3D virtual content; or

the background of the 3D virtual content.

7. The method of claim 1 , wherein said adjusting further comprises:

blurring approximately all of the 3D virtual content.

8. The method of claim 1 , wherein the 3D virtual content comprises a region of interest and a background, wherein said adjusting further comprises:

adjusting the brightness of one or more of:

the region of interest of the 3D virtual content; or

the background of the 3D virtual content.

9. The method of claim 1 , wherein the 3D virtual content comprises a region of interest and a background, wherein said adjusting further comprises:

adjusting the contrast of one or more of:

the region of interest of the 3D virtual content; or

the background of the 3D virtual content.

10. The method of claim 1 , wherein said adjusting further comprises:

clipping a region of the 3D virtual content that extends beyond the boundary of the coupled zone.

11. The method of claim 1 , wherein said determining that the 3D virtual content is moving further comprises determining that the 3D virtual content is moving in response to one or more of:

user input manipulating the 3D virtual content; or

programmatic control of position of the 3D virtual content in the virtual 3D space.

12. The method of claim 1 , wherein said adjusting further comprises:

partitioning the coupled zone into a plurality of regions, wherein each region of the plurality of regions has a corresponding maximum disparity value; and

limiting the disparity of each region to the corresponding maximum disparity value.

13. A non-transitory computer readable memory medium storing programming instructions executable by a processor to:

determine a size and a shape of a coupled zone of a three dimensional (3D) stereoscopic display, wherein the 3D stereoscopic display presents a virtual 3D space to a user, and wherein the coupled zone comprises a physical volume specified by the user's visual depth of field with respect to screen position of the 3D stereoscopic display and a point of view (POV) of the user, wherein the physical volume corresponds to at least a portion of the virtual 3D space;

display 3D virtual content at a first position in the virtual 3D space relative to the POV of the user in the virtual 3D space, wherein the first position corresponds to a position within the coupled zone;

determine that the 3D virtual content is not contained in the coupled zone or is within a specified distance from a boundary of the coupled zone, wherein to determine that the 3D virtual content is not contained in the coupled zone or is within a specified distance from a boundary of the coupled zone, the programming instructions are further executable by the processor to determine that the 3D virtual content is moving within the coupled zone at a rate; and

adjust, in response to said determining, display of the 3D virtual content in the virtual 3D space such that the 3D virtual content has a second position in the virtual 3D space that corresponds to another position within the coupled zone, wherein to adjust display of the 3D virtual content, the programming instructions are executable by the processor to limit the rate at which the 3D virtual content is moving, thereby limiting a rate at which disparity changes.

14. The non-transitory computer readable memory medium of claim 13 , wherein the coupled zone is a first coupled zone, wherein the POV of the user is a first POV of the user, wherein the programming instructions are further executable by a processor to:

detect position and movements of the user's head via a head tracking system;

determine a second POV of the user based on said detecting;

determine a size and a shape of a second coupled zone of the 3D stereoscopic display;

wherein to determine that the 3D virtual content is not contained in the coupled zone, the programming instructions are further executable by a processor to:

determine that the 3D virtual content is not contained in the second coupled zone or is within a specified distance from a boundary of the second coupled zone; and

wherein to adjust the display of the 3D virtual content, the programming instructions are further executable by a processor to:

adjust display of the 3D virtual content in the virtual 3D space such that the second position in the virtual 3D space corresponds to a position within the second coupled zone.

15. The non-transitory computer readable memory medium of claim 13 , wherein to adjust display of the 3D virtual content, the programming instructions are further executable by a processor to:

adjust disparity of one or more regions of the 3D virtual content.

16. The non-transitory computer readable memory medium of claim 13 , wherein to adjust display of the 3D virtual content, the programming instructions are further executable by a processor to:

adjust perspective of the images rendered in the one or more regions.

17. The non-transitory computer readable memory medium of claim 13 , wherein to adjust display of the 3D virtual content, the programming instructions are further executable by a processor to:

clamp disparity in a first region of the coupled zone; and

adjust disparity in a second region of the coupled zone.

18. The non-transitory computer readable memory medium of claim 13 , wherein the 3D virtual content comprises a region of interest and a background, wherein to adjust display of the 3D virtual content, the programming instructions are further executable by a processor to:

blurring one or more of:

the region of interest of the 3D virtual content; or

the background of the 3D virtual content.

19. The non-transitory computer readable memory medium of claim 13 , wherein to adjust display of the 3D virtual content, the programming instructions are further executable by a processor to:

blur approximately all of the 3D virtual content.

20. The non-transitory computer readable memory medium of claim 13 , wherein the 3D virtual content comprises a region of interest and a background, wherein to adjust display of the 3D virtual content, the programming instructions are further executable by a processor to:

adjust the brightness of one or more of:

the region of interest of the 3D virtual content; or

the background of the 3D virtual content.

21. The non-transitory computer readable memory medium of claim 13 , wherein the 3D virtual content comprises a region of interest and a background, wherein to adjust display of the 3D virtual content, the programming instructions are further executable by a processor to:

adjust the contrast of one or more of:

the region of interest of the 3D virtual content; or

the background of the 3D virtual content.

22. The non-transitory computer readable memory medium of claim 13 , wherein to adjust display of the 3D virtual content, the programming instructions are further executable by a processor to:

clip a region of the 3D virtual content that extends beyond the boundary of the coupled zone.

23. The non-transitory computer readable memory medium of claim 13 , wherein to determine that the 3D virtual content is moving, the programming instructions are further executable by a processor to determine that the 3D virtual content is moving in response to one or more of:

user input manipulating the 3D virtual content; or

programmatic control of position of the 3D virtual content in the virtual 3D space.

24. The non-transitory computer readable memory medium of claim 13 , wherein to adjust display of the 3D virtual content, the programming instructions are further executable by a processor to:

partition the coupled zone into a plurality of regions, wherein each region of the plurality of regions has a corresponding maximum disparity value; and

limit the disparity of each region to the corresponding maximum disparity value.

25. A system for presenting three dimensional (3D) virtual content via a 3D stereoscopic display, comprising:

a 3D stereoscopic display, comprising:

at least one display; and

at least one functional unit coupled to the at least one display and configured to:

determine a size and a shape of a coupled zone of a 3D stereoscopic display, wherein the 3D stereoscopic display presents a virtual 3D space to a user, and wherein the coupled zone comprises a physical volume specified by the user's visual depth of field with respect to screen position of the 3D stereoscopic display and a point of view (POV) of the user, wherein the physical volume corresponds to at least a portion of the virtual 3D space;

display 3D virtual content at a first position in the virtual 3D space relative to the POV of the user in the virtual 3D space, wherein the first position corresponds to a position within the coupled zone;

determine that the 3D virtual content is not contained in the coupled zone or is within a specified distance from a boundary of the coupled zone, wherein to determine that the 3D virtual content is not contained in the coupled zone or is within a specified distance from a boundary of the coupled zone, the at least one functional unit is further configured to determine that the 3D virtual content is moving within the coupled zone at a rate; and

adjust, in response to said determining, display of the 3D virtual content in the virtual 3D space such that the 3D virtual content has a second position in the virtual 3D space that corresponds to another position within the coupled zone, wherein to adjust display of the 3D virtual content, the at least one functional unit is further configured to:

adjust size of images rendered in one or more regions of the 3D virtual content; and

limit the rate at which the 3D virtual content is moving, thereby limiting a rate at which disparity changes.

26. The system of claim 25 , wherein the coupled zone is a first coupled zone, wherein the POV of the user is a first POV of the user, wherein the system further comprises:

one or more devices configured to measure position of a user's head;

wherein the at least one functional unit is further configured to:

detect position and movements of the user's head via a head tracking system;

determine a second POV of the user based on said detecting;

determine a size and a shape of a second coupled zone of the 3D stereoscopic display;

wherein to determine that the 3D virtual content is not contained in the coupled zone, the at least one functional unit is further configured to:

determine that the 3D virtual content is not contained in the second coupled zone or is within a specified distance from a boundary of the second coupled zone; and

wherein to adjust the display of the 3D virtual content, the at least one functional unit is further configured to:

adjust display of the 3D virtual content in the virtual 3D space such that the second position in the virtual 3D space corresponds to a position within the second coupled zone.

27. The system of claim 25 , wherein to determine that the 3D virtual content is moving, the at least one functional unit is further configured to determine that the 3D virtual content is moving in response to user input manipulating the 3D virtual content.

28. The system of claim 25 , wherein to adjust display of the 3D virtual content, the at least one functional unit is further configured to:

partition the coupled zone into a plurality of regions, wherein each region of the plurality of regions has a corresponding maximum disparity value; and

limit the disparity of each region to the corresponding maximum disparity value.

Assignments (7)
SECURITY INTEREST Recorded Apr 14, 2025
From: ZSPACE, INC.
To: 3I, L.P.
Reel/Frame 070826/0887 →
RELEASE OF PATENT SECURITY AGREEMENT Recorded Feb 6, 2023
From: EAST WEST BANK
To: ZSPACE, INC.
Reel/Frame 062640/0162 →
SECURITY INTEREST Recorded Sep 17, 2021
From: ZPACE, INC.
To: EAST WEST BANK
Reel/Frame 057651/0222 →
SECURITY INTEREST Recorded May 22, 2019
From: ZSPACE, INC.
To: BSPACE INVESTMENTS LIMITED
Reel/Frame 049259/0533 →
RELEASE OF SECURITY INTEREST Recorded May 8, 2019
From: RUNWAY GROWTH CREDIT FUND INC.
To: ZSPACE, INC. (F/K/A INFINITE Z, INC.)
Reel/Frame 049113/0898 →
SECURITY INTEREST Recorded Jan 2, 2018
From: ZSPACE, INC. (F/K/A INFINITE Z, INC.)
To: RUNWAY GROWTH CREDIT FUND INC.
Reel/Frame 044985/0721 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 21, 2014
From: WILSON, MARK P.; TWILLEAGER, DOUGLAS C.; BOREL, DAVID J.
To: ZSPACE, INC.
Reel/Frame 032716/0214 →
Continuity (1)
Related Publication 20150304645A1 · Oct 22, 2015