IP Library › Granted Patent US 12,608,897
Granted Patent B2
US 12,608,897 · App. 18/464,685 · Granted Apr 21, 2026

Computer-generated interactive hybrid virtual environment for item placement based on familiarity

Inventors: Katsuyuki Sakuma (Fishkill, NY); Sarbajit K. Rakshit (Kolkata, IN)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
G06T19/20G06Q30/0643G06T2219/2004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,608,897
App. No.
18/464,685
Granted
Apr 21, 2026
Kind
B2
Abstract

A customized computer-generated virtual environment corresponding to an environment familiar to a user for providing items in locations that are familiar to the user based on corresponding real-world environments and locations is provided. In association with the customized computer-generated virtual environment, a method may include generating an interactive virtual environment, wherein the generated interactive virtual environment includes virtual rooms and virtual areas based on the familiar environment. The method may also include identifying an item and a location of the item in the familiar environment, and correlating and associating the identified item with a corresponding location in the generated interactive virtual environment. The method may further include identifying and retrieving different items having a determined similarity to the identified item. The method may also include presenting the different items in the corresponding location of the generated interactive environment based on the determined similarity to the identified item.

Claims (51)

1 . A computer-implemented method, comprising:

generating an interactive virtual environment, wherein the generated interactive virtual environment further comprises one or more virtual rooms and one or more virtual areas based on an environment familiar to a user;

automatically identifying an item and a location of the item in the environment familiar to the user, and automatically correlating and associating the identified item with a corresponding location in the generated interactive virtual environment;

based on the correlation and association of the identified item with the corresponding location in the generated interactive virtual environment, automatically identifying and retrieving different items having a determined similarity to the identified item from one or more other different virtual environments, wherein the automatically identifying and retrieving the different items further comprises integrating and leveraging the one or more other different virtual environments having different virtual stores and retrieving the different items from the different virtual stores, wherein the different virtual stores are associated with different virtual store providers; and

automatically presenting the different items in the corresponding location of the generated interactive environment based on the determined similarity to the identified item and the location of the identified item in the environment familiar to the user, wherein automatically presenting the different items in the corresponding location of the generated interactive environment further comprises automatically presenting an option to select a specific virtual store associated with a particular item and corresponding to a specific virtual store provider, and in response to detecting user selection of the option, automatically switching virtually to the specific virtual store provided by the specific virtual store provider, wherein the specific virtual store includes other items by the specific virtual store provider.

2 . The computer-implemented method of claim 1 , wherein generating the interactive virtual environment further comprises:

generating a virtual representation of the environment familiar to the user based on received media content and internet of things (IoT) device data, wherein generating the virtual representation further comprises converting the received media content and the IoT device data to the generated interactive virtual environment using a virtual reality (VR) converter.

3 . The computer-implemented method of claim 1 , wherein generating the interactive virtual environment further comprises:

generating a virtual representation of the environment familiar to the user based on selected templates from a database of templates comprising different designs of the one or more virtual rooms and the one or more virtual areas.

4 . The computer-implemented method of claim 1 , wherein automatically identifying the item and automatically correlating and associating the identified item with the corresponding location in the generated interactive virtual environment further comprises:

automatically determining a type of item associated with the identified item, and correlating and associating the identified item and the determined type of item with at least one of a virtual room from the one or more virtual rooms and a virtual area from the one or more virtual areas.

5 . The computer-implemented method of claim 4 , wherein automatically identifying and retrieving the different items further comprises:

based on the correlation and association of the identified item and the determined type of item to the at least one of the virtual room and the virtual area, automatically identifying and retrieving the different items having the determined similarity to the identified item and the determined type of item from the one or more other virtual environments.

6 . The computer-implemented method of claim 5 , wherein automatically presenting the different items in the corresponding location of the generated interactive environment further comprises:

automatically presenting the different items in the corresponding location of the at least one of the virtual room and the virtual area based on the determined similarity to the identified item and the determined type of item and the correlation and association of the identified item and the determined type of item to the virtual room and the virtual area.

7 . The computer-implemented method of claim 1 , wherein automatically presenting the different items further comprises:

automatically projecting a virtual representation of the different items in the corresponding location, wherein automatically projecting the virtual presentation further comprises presenting virtual images of the different items and information associated with the different items.

8 . A computer system, comprising:

one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage devices, and program instructions stored on at least one of the one or more storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, wherein the computer system is capable of performing a method comprising:

generating an interactive virtual environment, wherein the generated interactive virtual environment further comprises one or more virtual rooms and one or more virtual areas based on an environment familiar to a user;

automatically identifying an item and a location of the item in the environment familiar to the user, and automatically correlating and associating the identified item with a corresponding location in the generated interactive virtual environment;

based on the correlation and association of the identified item with the corresponding location in the generated interactive virtual environment, automatically identifying and retrieving different items having a determined similarity to the identified item from one or more other different virtual environments, wherein the automatically identifying and retrieving the different items further comprises integrating and leveraging the one or more other different virtual environments having different virtual stores and retrieving the different items from the different virtual stores, wherein the different virtual stores are associated with different virtual store providers; and

automatically presenting the different items in the corresponding location of the generated interactive environment based on the determined similarity to the identified item and the location of the identified item in the environment familiar to the user, wherein automatically presenting the different items in the corresponding location of the generated interactive environment further comprises automatically presenting an option to select a specific virtual store associated with a particular item and corresponding to a specific virtual store provider, and in response to detecting user selection of the option, automatically switching virtually to the specific virtual store provided by the specific virtual store provider, wherein the specific virtual store includes other items by the specific virtual store provider.

9 . The computer system of claim 8 , wherein generating the interactive virtual environment further comprises:

generating a virtual representation of the environment familiar to the user based on received media content and internet of things (IoT) device data, wherein generating the virtual representation further comprises converting the received media content and the IoT device data to the generated interactive virtual environment using a virtual reality (VR) converter.

10 . The computer system of claim 8 , wherein generating the interactive virtual environment further comprises:

generating a virtual representation of the environment familiar to the user based on selected templates from a database of templates comprising different designs of the one or more virtual rooms and the one or more virtual areas.

11 . The computer system of claim 8 , wherein automatically identifying the item and automatically correlating and associating the identified item with the corresponding location in the generated interactive virtual environment further comprises:

automatically determining a type of item associated with the identified item, and correlating and associating the identified item and the determined type of item with at least one of a virtual room from the one or more virtual rooms and a virtual area from the one or more virtual areas.

12 . The computer system of claim 11 , wherein automatically identifying and retrieving the different items further comprises:

based on the correlation and association of the identified item and the determined type of item to the at least one of the virtual room and the virtual area, automatically identifying and retrieving the different items having the determined similarity to the identified item and the determined type of item from the one or more other virtual environments.

13 . The computer system of claim 12 , wherein automatically presenting the different items in the corresponding location of the generated interactive environment further comprises:

automatically presenting the different items in the corresponding location of the at least one of the virtual room and the virtual area based on the determined similarity to the identified item and the determined type of item and the correlation and association of the identified item and the determined type of item to the virtual room and the virtual area.

14 . The computer system of claim 8 , wherein automatically presenting the different items further comprises:

automatically projecting a virtual representation of the different items in the corresponding location, wherein automatically projecting the virtual presentation further comprises presenting virtual images of the different items and information associated with the different items.

15 . A computer program product for automatically generating, correlating, and presenting visual content along with an audio stream associated with an audiobook, comprising:

one or more tangible computer-readable storage devices and program instructions stored on at least one of the one or more tangible computer-readable storage devices, the program instructions executable by a processor, the program instructions comprising:

generating an interactive virtual environment, wherein the generated interactive virtual environment further comprises one or more virtual rooms and one or more virtual areas based on an environment familiar to a user;

automatically identifying an item and a location of the item in the environment familiar to the user, and automatically correlating and associating the identified item with a corresponding location in the generated interactive virtual environment;

based on the correlation and association of the identified item with the corresponding location in the generated interactive virtual environment, automatically identifying and retrieving different items having a determined similarity to the identified item from one or more other different virtual environments, wherein the automatically identifying and retrieving the different items further comprises integrating and leveraging the one or more other different virtual environments having different virtual stores and retrieving the different items from the different virtual stores, wherein the different virtual stores are associated with different virtual store providers; and

automatically presenting the different items in the corresponding location of the generated interactive environment based on the determined similarity to the identified item and the location of the identified item in the environment familiar to the user, wherein automatically presenting the different items in the corresponding location of the generated interactive environment further comprises automatically presenting an option to select a specific virtual store associated with a particular item and corresponding to a specific virtual store provider, and in response to detecting user selection of the option, automatically switching virtually to the specific virtual store provided by the specific virtual store provider, wherein the specific virtual store includes other items by the specific virtual store provider.

16 . The computer program product of claim 15 , wherein generating the interactive virtual environment further comprises:

generating a virtual representation of the environment familiar to the user based on received media content and internet of things (IoT) device data, wherein generating the virtual representation further comprises converting the received media content and the IoT device data to the generated interactive virtual environment using a virtual reality (VR) converter.

17 . The computer program product of claim 15 , wherein automatically identifying the item and automatically correlating and associating the identified item with the corresponding location in the generated interactive virtual environment further comprises:

automatically determining a type of item associated with the identified item, and correlating and associating the identified item and the determined type of item with at least one of a virtual room from the one or more virtual rooms and a virtual area from the one or more virtual areas.

18 . The computer program product of claim 17 , wherein automatically identifying and retrieving the different items further comprises:

based on the correlation and association of the identified item and the determined type of item to the at least one of the virtual room and the virtual area, automatically identifying and retrieving the different items having the determined similarity to the identified item and the determined type of item from the one or more other virtual environments.

19 . The computer program product of claim 18 , wherein automatically presenting the different items in the corresponding location of the generated interactive environment further comprises:

automatically presenting the different items in the corresponding location of the at least one of the virtual room and the virtual area based on the determined similarity to the identified item and the determined type of item and the correlation and association of the identified item and the determined type of item to the virtual room and the virtual area.

20 . The computer program product of claim 15 , wherein automatically presenting the different items further comprises:

automatically projecting a virtual representation of the different items in the corresponding location, wherein automatically projecting the virtual presentation further comprises presenting virtual images of the different items and information associated with the different items.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 11, 2023
From: SAKUMA, KATSUYUKI; RAKSHIT, SARBAJIT K.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 064861/0538 →
Continuity (1)
Related Publication 20250086914A1 · Mar 13, 2025
References Cited (26)
US 10095929B1 · Hoover · 2018 [cited by examiner]
US 10366447B2 · Zhao · 2019 [cited by applicant]
US 11580592B2 · Berger · 2023 [cited by examiner]
US 11663781B1 · Alexander · 2023 [cited by applicant]
US 12008608B2 · Black · 2024 [cited by examiner]
US 20140214629A1 · Azam · 2014 [cited by examiner]
US 20140222627A1 · Kukreja · 2014 [cited by examiner]
US 20150248791A1 · Abovitz · 2015 [cited by examiner]
US 20170116667A1 · High · 2017 [cited by examiner]
US 20180182025A1 · Smith · 2018 [cited by examiner]
US 20180374276A1 · Powers · 2018 [cited by examiner]
US 20190019242A1 · Bajpai · 2019 [cited by examiner]
US 20190130649A1 · O'Brien · 2019 [cited by examiner]
US 20190156582A1 · Yankovich · 2019 [cited by examiner]
US 20200258144A1 · Chaturvedi · 2020 [cited by examiner]
US 20210065175A1 · Sukhija · 2021 [cited by examiner]
US 20210279963A1 · Silverstein · 2021 [cited by examiner]
US 20220129974A1 · Delgado · 2022 [cited by examiner]
US 20250078146A1 · Singh · 2025 [cited by examiner]
US 20250086914A1 · Sakuma · 2025 [cited by examiner]
Speicher, Marco, et al. “A virtual reality shopping experience using the apartment metaphor.” Proceedings of the 2018 international conference on advanced visual interfaces. 2018. (Year: 2018). [cited by examiner]
Disclosed Anonymously, “Method and System for Commerce Shopping Recommendations with Automated Owned Product Discovery, Maintenance, and Compatibility”, An IP.com Prior Art Database Technical Disclosure, IP.com No. IPCO… [cited by applicant]
Gomez, “VR in Shopping—Ultimate Guide”, Koombea, Feb. 18, 2023, 8 pages, https://www.koombea.com/blog/vr-in-shopping/. [cited by applicant]
Heller, “32 Open House Ideas That Will Actually Get You Leads”, Mar. 20, 23, 18 pages, https://www.agentadvice.com/real-estate-open-house-ideas/. [cited by applicant]
Koombea, “eCommerce Development Solutions”, accessed Jun. 30, 2023, 14 pages, https://www.koombea.com/services/ecommerce-development-solutions/. [cited by applicant]
Koombea, “We Bring HiTech Apps to Life”, accessed on Jul. 5, 2023, 11 pages, https://www.koombea.com/industries/hitech/. [cited by applicant]