IP Library Granted Patent US 11,856,326
Granted Patent B1
US 11,856,326 · App. 17/940,438 · Granted Dec 26, 2023

Virtual world method and system for affecting mind state

Inventors: Nicolas de Benoist (Paris, FR); Francis Gerard Graziano (Grand Rapids, MI); Mark Baloga (East Grand Rapids, MI); Paul Noll (Grand Rapids, MI); Terry West (Caledonia, MI)
Assignee: Steelcase Inc.
H04N7/147G06T11/60H04N7/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,856,326
App. No.
17/940,438
Granted
Dec 26, 2023
Kind
B1
Abstract

A system and method for creating a virtual world conferencing experience wherein a first set of real world emissive surfaces and content thereon is replicated on virtual world emissive surfaces where the virtual world emissive surfaces are juxtaposed in a virtual world instance at locations and in orientations that replicate the juxtapositions in the real world arrangement and where the virtual world instance is presented on a second set of real world emissive surfaces at a virtual world workstation where the second set of emissive surfaces are arranged differently than the first set of real world surfaces.

Claims (53)

1. A viewing system for presenting views into a three dimensional (3D) virtual world (VW) representation to at least first and second system users located at first and second different locations, respectively, the system comprising:

a database storing a 3D VW dataset that specifies a VW representation;

a first emissive surface arrangement used at the first location to observe views of the VW representation;

a second emissive surface arrangement used at the second location to observe views of the VW representation;

a sensor arrangement at the second location for detecting a direction the second user is facing with respect to the VW representation presented on the second emissive surface arrangement;

a processor programmed to perform the steps of (i) using the direction the second user is facing with respect to the VW representation to identify a perspective of the second user that should be used to generate a VW representation of the second user within the VW representation presented on the first emissive surface arrangement, (ii) generating a VW representation of the second user from the identified perspective and (iii) presenting the VW representation of the second user within the VW representation on the first emissive surface arrangement.

2. The viewing system of claim 1 wherein the representation of the second user is a video representation of the second user.

3. The viewing system of claim 2 wherein at least one of the perspectives is a front perspective of the second user.

4. The viewing system of claim 3 wherein at least one of the perspectives is a side perspective of the second user.

5. The viewing system of claim 2 further including at least first and second cameras at the second location for obtaining video representations of the second user from different perspectives, the processor identifying one of the perspectives aligned with one of the cameras based on the direction the second user is facing with respect to the VW representation.

6. The viewing system of claim 5 wherein the sensor arrangement includes at least one of the first and second cameras.

7. The viewing system of claim 1 wherein the first emissive surface arrangement includes at least one large flat panel display screen located at a first workstation.

8. The viewing system of claim 7 wherein the second emissive surface arrangement includes at least one large flat panel display screen located at a second workstation.

9. The viewing system of claim 8 wherein the second emissive surface arrangement includes at least first and second emissive surfaces located at different locations about the second workstation where each surface faces a user location occupied by the second user in the real world from a different angle.

10. The viewing system of claim 9 further including a plurality of cameras located about the user location wherein each camera is capable of generating a separate video representation of the second user.

11. The viewing system of claim 1 wherein the sensor arrangement tracks location and orientation of the second user's head relative to the first emissive surface arrangement to detect the direction the second user is facing with respect to the VW representation presented on the second emissive surface arrangement.

12. The viewing system of claim 1 wherein the sensor arrangement tracks the direction of eye gaze of the second user relative to the first emissive surface arrangement to detect the direction the second user is facing with respect to the VW representation presented on the second emissive surface arrangement.

13. The viewing system of claim 1 wherein the perspective of the VW representation of the second user changes automatically as the direction the second user faces with respect to the VW representation on the second emissive surface arrangement changes.

14. The viewing system of claim 1 wherein the sensor arrangement is a second sensor arrangement, the system further including a first sensor arrangement at the first location for detecting a direction the first user is facing with respect to the VW representation presented on the first emissive surface arrangement, and a processor programmed to perform the steps of (i) using the direction the first user is facing with respect to the VW representation to identify a perspective of the first user that should be used to generate a VW representation of the first user within the VW representation presented on the second emissive surface arrangement, (ii) generating a VW representation of the first user from the identified perspective and (iii) presenting the VW representation of the first user within the VW representation on the second emissive surface arrangement.

15. The viewing system of claim 14 further including a first plurality of cameras at the first location for generating representations of the first user that may be used to generate the VW representation of the first user from the identified perspective and a second plurality of cameras at the second location for generating representations of the second user that may be used to generate the VW representation of the second user from the identified perspective.

16. The viewing system of claim 1 wherein the second emissive surface arrangement includes at least first and second emissive surface portions that form an angle with respect to each other with both the first and second emissive surface portions facing a location occupied by the second user.

17. A viewing system for presenting views into a three dimensional (3D) virtual world (VW) representation to at least first and second system users located at first and second different locations, respectively, the system comprising:

a database storing a 3D VW dataset that specifies a VW representation;

a first emissive surface arrangement used at the first location;

a second emissive surface arrangement used at the second location remote from the first location;

a sensor arrangement at the second location detecting a direction the second user is facing at the second location;

a processor programmed to perform the steps of:

(i) presenting a first view of the VW representation via the first emissive surface arrangement and a second view of the VW representation via the second emissive surface arrangement;

(ii) receiving a direction location from the sensor arrangement indicating the direction the second user is facing at the second location;

(iii) using the received direction location and the VW representation presented via the second emissive surface arrangement to identify the direction the second user is facing with respect to the virtual world representation presented on the second emissive surface arrangement;

(iv) using the direction the second user is facing with respect to the VW representation to identify a perspective of the second user that should be used to generate a VW representation of the second user within the VW representation presented on the first emissive surface arrangement;

(v) generating a VW representation of the second user from the identified perspective; and

(vi) presenting the VW representation of the second user within the VW representation on the first emissive surface arrangement.

18. The viewing system of claim 17 wherein the perspective of the VW representation of the second user changes automatically as the direction the second user faces with respect to the VW representation on the second emissive surface arrangement changes.

19. The viewing system of claim 17 further including a camera arrangement for generating video images of the second user at the second location.

20. A viewing system for presenting views into a three dimensional (3D) virtual world (VW) representation to at least first and second system users located at first and second different locations, respectively, the system comprising:

a database storing a 3D VW dataset that specifies a VW representation;

a first emissive surface arrangement used at the first location;

a second emissive surface arrangement used at the second location remote from the first location;

a first sensor arrangement at the first location detecting a direction the first user is facing at the first location;

a second sensor arrangement at the second location detecting a direction the second user is facing at the second location;

a processor programmed to perform the steps of:

(i) presenting a first view of the VW representation via the first emissive surface arrangement and a second view of the VW representation via the second emissive surface arrangement;

(ii) receiving a first direction location from the first sensor arrangement indicating the direction the first user is facing at the first location;

(iii) using the received first direction location and the VW representation presented via the first emissive surface arrangement to identify the direction the first user is facing with respect to the VW representation presented on the first emissive surface arrangement;

(iv) using the direction the first user is facing with respect to the VW representation to identify a perspective of the first user that should be used to generate a VW representation of the first user within the VW representation presented on the second emissive surface arrangement;

(v) generating a VW representation of the first user from the identified perspective;

(vi) presenting the VW representation of the first user within the VW representation on the second emissive surface arrangement;

(vii) receiving a second direction location from the second sensor arrangement indicating the direction the second user is facing at the second location;

(viii) using the received second direction location and the VW representation presented via the second emissive surface arrangement to identify the direction the second user is facing with respect to the VW representation presented on the second emissive surface arrangement;

(ix) using the direction the second user is facing with respect to the VW representation to identify a perspective of the second user that should be used to generate a VW representation of the second user within the VW representation presented on the first emissive surface arrangement;

(x) generating a VW representation of the second user from the identified perspective; and

(xi) presenting the VW representation of the second user within the VW representation on the first emissive surface arrangement.

Assignments (3)
PATENT SECURITY AGREEMENT Recorded Feb 4, 2026
From: AMQ SOLUTIONS, LLC; HALCON FURNITURE LLC; SMITH SYSTEM MANUFACTURING COMPANY; STEELCASE INC.
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 074944/0368 →
PATENT SECURITY AGREEMENT Recorded Feb 4, 2026
From: AMQ SOLUTIONS, LLC; HALCON FURNITURE LLC; SMITH SYSTEM MANUFACTURING COMPANY; STEELCASE INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS ADMINISTRATIVE AGENT
Reel/Frame 074944/0784 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 8, 2022
From: DE BENOIST, NICOLAS; GRAZIANO, FRANCIS GERARD; BALOGA, MARK; NOLL, PAUL; WEST, TERRY
To: STEELCASE INC.
Reel/Frame 061026/0787 →
Continuity (4)
Continuation 17196268 · Mar 9, 2021
Continuation 16516984 · Jul 19, 2019
Continuation 15385192 · Dec 20, 2016
Provisional Application 62270898 · Dec 22, 2015