IP Library › Granted Patent US 12,614,358
Granted Patent B2
US 12,614,358 · App. 18/188,600 · Granted Apr 28, 2026

Augmented reality environment melding

Inventors: Logan Bailey (Atlanta, GA); Zachary A. Silverstein (Georgetown, TX); Martin G. Keen (Cary, NC); Tyler Hansen (Tucson, AZ)
Assignee: International Business Machines Corporation
G06T19/006G06T19/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,614,358
App. No.
18/188,600
Granted
Apr 28, 2026
Kind
B2
Abstract

Techniques are described with respect to a system, method, and computer program product for merging augmented reality experiences into an augmented reality environment. An associated method includes determining a first augmented reality experience of a first user and a second augmented reality experience of a second user; analyzing a plurality of environmental contextual data associated with the first augmented reality experience and the second augmented reality experience; and based on the analysis, generating a merged augmented reality environment comprising the first user and the second user.

Claims (69)

1 . A computer-implemented method for merging augmented reality experiences into an augmented reality environment, the method comprising:

determining, by a computing device, a first augmented reality experience of a first user and a second augmented reality experience of a second user;

analyzing, by the computing device, a plurality of environmental contextual data associated with the first augmented reality experience and the second augmented reality experience by segmenting the first and second augmented reality experiences for at least one virtual object associated with the plurality of environmental contextual data;

based on the analysis, generating, by the computing device, a merged augmented reality environment comprising the first user and the second user and a shared virtual object synchronized to the first and second augmented reality experiences;

analyzing, by the computing device, the merged augmented reality environment;

generating, by the computing device, a plurality of augmented reality interactions of the first and the second user based on the analysis; and

synchronizing, by the computing device, the first augmented reality experience and the second augmented reality experience in the merged augmented reality environment by mirroring a first subset of a plurality of augmented reality interactions for presentation in the merged augmented reality environment via a second subset of the plurality of augmented reality interactions.

2 . The computer-implemented method of claim 1 , wherein analyzing the plurality of environmental contextual data comprises:

extracting, by the computing device, a plurality of multi-media data from the first augmented reality experience and the second augmented reality experience;

segmenting, by the computing device, the plurality of multi-media data for multi-dimensional virtual objects; and

reconstructing, by the computing device, a 3D point cloud of the plurality of multi-media data based on the segmentation.

3 . The computer-implemented method of claim 1 , wherein analyzing the plurality of environmental contextual data further comprises:

identifying, by the computing device, a plurality of commonalities associated with the first augmented reality experience and the second augmented reality experience based on grouping data points derived from one or more clustering algorithms;

merging, by the computing device, the plurality of commonalities utilizing at least one machine learning algorithm.

4 . The computer-implemented method of claim 1 ,

wherein mirroring comprises:

overlaying virtual content based on the plurality of contextual information;

wherein the virtual content facilitates a plurality of smart transactions for the merged augmented reality environment.

5 . The computer-implemented method of claim 4 , where generating the plurality of augmented reality interactions comprises:

utilizing, by the computing device, a series of application programming interface (API) calls of the first user and the second user while interacting with the merged augmented reality environment.

6 . The computer-implemented method of claim 4 ,

wherein the second subset of the plurality of augmented reality interactions comprises a virtual object of the first augmented reality experience and the second augmented reality experience configured to support interactions with the first user and the second user.

7 . The computer-implemented method of claim 6 , wherein the virtual object is associated with a point of sale (POS) system integrated into the merged augmented reality environment.

8 . A computer program product for merging augmented reality experiences into an augmented reality environment, the computer program product comprising one or more computer readable storage media and program instructions collectively stored on the one or more computer readable storage media, the stored program instructions comprising:

program instructions to determine a first augmented reality experience of a first user and a second augmented reality experience of a second user;

program instructions to analyze a plurality of environmental contextual data associated with the first augmented reality experience and the second augmented reality experience by segmenting the first and second augmented reality experiences for at least one virtual object associated with the plurality of environmental contextual data;

program instructions to generate a merged augmented reality environment comprising the first user and the second user based on the analysis and a shared virtual object synchronized to the first and second augmented reality experiences;

program instructions to analyze the merged augmented reality environment;

program instructions to generate a plurality of augmented reality interactions of the first and the second user based on the analysis; and

program instructions to synchronize the first augmented reality experience and the second augmented reality experience in the merged augmented reality environment by mirroring a first subset of a plurality of augmented reality interactions for presentation in the merged augmented reality environment via a second subset of the plurality of augmented reality interactions.

9 . The computer program product of claim 8 , wherein program instructions to analyze the plurality of environmental contextual data further comprise:

program instructions to extract a plurality of multi-media data from the first and second augmented reality experiences;

program instructions to segment the plurality of multi-media data for multi-dimensional virtual objects; and

program instructions to reconstruct a 3D point cloud of the plurality of multi-media data based on the segmentation.

10 . The computer program product of claim 8 , wherein program instructions to analyze the plurality of environmental contextual data further comprise:

program instructions to identify a plurality of commonalities associated with the first augmented reality experience and the second augmented reality experience based on grouping data points derived from one or more clustering algorithms;

program instructions to merge the plurality of commonalities utilizing at least one machine learning algorithm.

11 . The computer program product of claim 8 ,

wherein program instructions to mirror comprise:

program instructions to overlay virtual content based on the plurality of contextual information;

wherein the virtual content facilitates a plurality of smart transactions for the merged augmented reality environment.

12 . The computer program product of claim 11 ,

wherein the second subset of the plurality of augmented reality interactions comprises a virtual object of the first augmented reality experience and the second augmented reality experience configured to support interactions with the first user and the second user.

13 . The computer program product of claim 12 , wherein the virtual object is associated with a point of sale (POS) system integrated into the merged augmented reality environment.

14 . A computer system for merging augmented reality experiences into an augmented reality environment, the computer system comprising:

one or more processors;

one or more computer-readable memories;

program instructions stored on at least one of the one or more computer-readable memories for execution by at least one of the one or more processors, the program instructions comprising:

program instructions to determine a first augmented reality experience of a first user and a second augmented reality experience of a second user;

program instructions to analyze a plurality of environmental contextual data associated with the first augmented reality experience and the second augmented reality experience by segmenting the first and second augmented reality experiences for at least one virtual object associated with the plurality of environmental contextual data;

program instructions to generate a merged augmented reality environment comprising the first user and the second user based on the analysis and a shared virtual object synchronized to the first and second augmented reality experiences; program instructions to analyze the merged augmented reality environment;

program instructions to generate a plurality of augmented reality interactions of the first and the second user based on the analysis; and

program instructions to synchronize the first augmented reality experience and the second augmented reality experience in the merged augmented reality environment by mirroring a first subset of a plurality of augmented reality interactions for presentation in the merged augmented reality environment via a second subset of the plurality of augmented reality interactions.

15 . The computer system of claim 14 , wherein program instructions to analyze the plurality of environmental contextual data further comprise:

program instructions to extract a plurality of multi-media data from the first and second augmented reality experiences;

program instructions to segment the plurality of multi-media data for multi-dimensional virtual objects; and

program instructions to reconstruct a 3D point cloud of the plurality of multi-media data based on the segmentation.

16 . The computer system of claim 15 , wherein program instructions to analyze the plurality of environmental contextual data further comprise:

program instructions to identify a plurality of commonalities associated with the first augmented reality experience and the second augmented reality experience based on grouping data points derived from one or more clustering algorithms;

program instructions to merge the plurality of commonalities utilizing at least one machine learning algorithm.

17 . The computer system of claim 15 ,

wherein program instructions to mirror comprise:

program instructions to overlay virtual content based on the plurality of contextual information;

wherein the virtual content facilitates a plurality of smart transactions for the merged augmented reality environment.

18 . The computer system of claim 17 , wherein program instructions to generate the plurality of augmented reality interactions comprise:

program instructions to utilize a series of application programming interface (API) calls of the first user and the second user while interacting with the merged augmented reality environment.

19 . The computer system of claim 17 ,

wherein the second subset of the plurality of augmented reality interactions comprises a virtual object of the first augmented reality experience and the second augmented reality experience configured to support interactions with the first user and the second user.

20 . The computer system of claim 19 , wherein the virtual object is associated with a point of sale (POS) system integrated into the merged augmented reality environment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2023
From: BAILEY, LOGAN; SILVERSTEIN, ZACHARY A.; KEEN, MARTIN G.; HANSEN, TYLER
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 063073/0785 →
Continuity (1)
Related Publication 20240320928A1 · Sep 26, 2024
References Cited (27)
US 11095869B2 · Holzer · 2021 [cited by applicant]
US 11621979B1 · Slotznick · 2023 [cited by examiner]
US 20110113018A1 · Hamilton, II · 2011 [cited by applicant]
US 20150287241A1 · Huston · 2015 [cited by applicant]
US 20160195403A1 · Tuukkanen · 2016 [cited by examiner]
US 20170365102A1 · Huston · 2017 [cited by applicant]
US 20190073712A1 · Nickerson · 2019 [cited by examiner]
US 20190373080A1 · Bastide · 2019 [cited by examiner]
US 20190378335A1 · Bentovim · 2019 [cited by examiner]
US 20200134827A1 · Saha · 2020 [cited by examiner]
US 20200167120A1 · Rakshit · 2020 [cited by applicant]
US 20200210137A1 · Noris · 2020 [cited by examiner]
US 20200402315A1 · Yerli · 2020 [cited by examiner]
US 20200413006A1 · Cheng · 2020 [cited by examiner]
US 20210011607A1 · Ziman · 2021 [cited by examiner]
US 20210383115A1 · Alon · 2021 [cited by examiner]
US 20220101420A1 · Woodyard · 2022 [cited by examiner]
US 20220139055A1 · Palmaro · 2022 [cited by examiner]
US 20220383594A1 · Li · 2022 [cited by applicant]
US 20230206571A1 · Darling · 2023 [cited by examiner]
US 20230305894A1 · Fan · 2023 [cited by examiner]
US 20230419625A1 · Chiu · 2023 [cited by examiner]
US 20240056553A1 · Brudy · 2024 [cited by examiner]
US 20240104863A1 · Brewer · 2024 [cited by examiner]
CN 101452339B · 2013 [cited by applicant]
Anonymous, “Splicing different speakers seamlessly in the shared screen during video conference.” IP.com No. IPCOM000241384D, IP.com Electronic Publication Date: Apr. 22, 2015, 5 pages. [cited by applicant]
Eisert, Peter, “Immersive 3-D Video Conferencing: Challenges, Concepts, and Implementations”, Proceedings of the Visual Communications and Image Processing (VCIP), Lugano, Switzerland, Jul. 8, 2003, 11 pages. [cited by applicant]