IP Library › Granted Patent US 12,347,023
Granted Patent B2
US 12,347,023 · App. 18/077,071 · Granted Jul 1, 2025

System and method for virtualized environment

Inventor: Cary Harr (Waretown, NJ)
G06T15/20G06F3/1423G06T7/60G06T7/70H04R5/02H04R5/04H04S7/30H04S2400/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,347,023
App. No.
18/077,071
Granted
Jul 1, 2025
Kind
B2
Abstract

A system and method for a virtual environment with multiple display devices connected to one or more computing systems with hardware and software that replicates the camera and speaker (3D sounds) setup needed to create the portals in the real-world environment corresponding to virtual environments that are viewable through the portals with designated point of views corresponding to the real-world locations of the display devices.

Claims (37)

1. A virtual environment system comprising:

at least one memory including processor readable instructions; and

at least one processor arranged to read and execute the processor readable instructions stored on the at least one memory and execute the processor readable instructions to:

obtain a virtual area model;

obtain display locations of a plurality of displays and speaker locations for a plurality of speakers;

obtain a portal perspective for each display of the plurality of displays, wherein the portal perspective is automatic and adjustable;

adjust the virtual area model based on the display locations of each display of the plurality of displays, and the speaker locations of each speaker of the plurality of speakers, wherein the adjusting of the virtual area model comprises programmatically changing paths of virtual objects to ensure visibility on the plurality of displays; and

send display information to each display of the plurality of displays and send sound information to each speaker of the plurality of speakers based on the adjusted virtual area model.

2. The virtual environment system of claim 1 , wherein the at least one processor is further arranged to read and execute the processor readable instructions stored on the at least one memory and execute the processor readable instructions to:

create a virtual map of an area in which each display of the plurality of displays is located; and

adjust the virtual area model based on the virtual map of the area including entering the virtual map of the area into the virtual area model.

3. The virtual environment system of claim 2 , wherein the at least one processor is further arranged to read and execute the processor readable instructions stored on the at least one memory and execute the processor readable instructions to: adjust the virtual area model to prevent the virtual objects from appearing to pass through a mapped virtual space of a physical room.

4. A virtual environment system comprising:

one or more displays;

at least one memory including processor readable instructions; and

at least one processor arranged to read and execute the processor readable instructions stored on the at least one memory and execute the processor readable instructions to:

create a virtual environment in a physical space;

determine display locations and angles of the one or more displays using test images to be displayed on the one or more displays wherein by processing a size and angle of the test images as viewed by a virtual camera, the display locations and angles are determined;

obtain a point of view for each display of the one or more displays;

determine a portal perspective of a user;

modify the point of view based on the display locations of each display of the one or more displays for proper alignment with the virtual environment;

send display information to each display of the one or more displays to a corresponding area of the virtual environment; and

adjust the virtual points of view for the virtual displays based on the portal perspective to maintain proper perspective.

5. The virtual environment system of claim 4 , further comprising one or more triggers to activate one or more assets in the virtual environment to appear on the one or more displays.

6. The virtual environment system of claim 5 , wherein the one or more triggers is a motion sensor.

7. The virtual environment system of claim 4 , wherein the one or more displays have an interface element for interacting with the virtual environment wherein a first action on a first display of the one or more displays causes a first effect on a second display of the one or more displays.

8. The virtual environment system of claim 4 , wherein the at least one processor is further arranged to read and execute the processor readable instructions stored on the at least one memory and execute the processor readable instructions to:

define paths for virtual objects that avoid intersecting with mapped virtual space corresponding to the physical space.

9. The virtual environment system of claim 4 , wherein the at least one processor is further arranged to read and execute the processor readable instructions stored on the at least one memory and execute the processor readable instructions to:

determine a size of an area the one or more displays have been placed.

10. The virtual environment system of claim 9 , wherein the at least one processor is further arranged to read and execute the processor readable instructions stored on the at least one memory and execute the processor readable instructions to:

match the size of the area to a size of the virtual environment.

11. The virtual environment system of claim 4 , further comprising one or more speakers.

12. The virtual environment system of claim 11 , wherein the at least one processor is further arranged to read and execute the processor readable instructions stored on the at least one memory and execute the processor readable instructions to:

synchronize speaker sounds from the one or more speakers to sounds happening in the virtual environment.

13. The virtual environment system of claim 4 , wherein the one or more displays are positioned at different elevations.

14. The virtual environment system of claim 4 , wherein one or more assets are viewable at different perspectives through the one or more displays.

Continuity (2)
Provisional Application 63287764 · Dec 9, 2021
Related Publication 20230186552A1 · Jun 15, 2023
References Cited (22)
US 6106298A · Pollak · 2000 [cited by applicant]
US 6275258B1 · Chim · 2001 [cited by examiner]
US 7453418B2 · Palmquist · 2008 [cited by applicant]
US 8253649B2 · Imai · 2012 [cited by applicant]
US 10921373B2 · Lassalle-Balier et al. · 2021 [cited by applicant]
US 11868672B1 · Dehkordi · 2024 [cited by examiner]
US 20130321461A1 · Filip · 2013 [cited by examiner]
US 20190073831A1 · Kim · 2019 [cited by examiner]
US 20200363636A1 · Karafin · 2020 [cited by examiner]
US 20220391617A1 · Chastain · 2022 [cited by examiner]
US 20230267853A1 · Dyson · 2023 [cited by examiner]
US 20230343035A1 · Li · 2023 [cited by examiner]
US 20240075394A1 · Carbonar · 2024 [cited by examiner]
US 20240104877A1 · Henderson · 2024 [cited by examiner]
US 20240144604A1 · Zavesky · 2024 [cited by examiner]
Caeyers F. The design of movie-based theme park attractions: Exploring environmental storytelling to create immersive dark ride experiences (Doctoral dissertation, Université du Québec à Chicoutimi), Nov. 23, 2021. [cited by examiner]
Roussou, M., 2001. Immersive interactive virtual reality in the museum. Proc. of TiLE (Trends in Leisure Entertainment). [cited by examiner]
Carrozzino M, Bergamasco M. Beyond virtual museums: Experiencing immersive virtual reality in real museums. Journal of cultural heritage. Oct. 1, 2010;11(4):452-8. [cited by examiner]
Nelson T. Impact of virtual and augmented reality on theme parks. Master Degree Paper, Ryerson University. 2016:3. [cited by examiner]
Khalidov V, Forbes F, Hansard M, Arnaud E, Horaud R. Audio-Visual clustering for 3D speaker localization. InInternational Workshop on Machine Learning for Multimodal Interaction Sep. 8, 2008 (pp. 86-97). Berlin, Heidelb… [cited by examiner]
Christensen H, Barker J. Using location cues to track speaker changes from mobile, binaural microphones. InINTERSPEECH Sep. 2009 (pp. 140-143). [cited by examiner]
Atmoph Window 2 Connect to the world, atmoph.com. https://atmoph.com/en/products/aw102 [Date accessed Aug. 10, 2021]. [cited by applicant]