IP Library Granted Patent US 12,475,644
Granted Patent B2
US 12,475,644 · App. 18/493,830 · Granted Nov 18, 2025

Virtual holiday control

Inventors: Amit Kumar Raha (Barrackpore, IN); Amitava Chakraborty (Kolkata, IN)
Assignee: International Business Machines Corporation
G06T17/00G06F3/011G06Q30/0643G06Q50/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,475,644
App. No.
18/493,830
Granted
Nov 18, 2025
Kind
B2
Abstract

Techniques are provided for controlling virtual holiday experiences. In one embodiment, the techniques involve receiving a virtual itinerary, wherein the virtual itinerary includes a virtual holiday destination and a user preference, retrieving media of the virtual holiday destination based on the virtual itinerary, wherein the media is retrieved from a social media network or a public media database, generating a virtual environment based on the media, and generating a virtual representative of a user in the virtual environment.

Claims (52)

1 . A method comprising:

receiving a virtual itinerary, wherein the virtual itinerary includes a virtual holiday destination and a user preference;

retrieving media of the virtual holiday destination based on the virtual itinerary, wherein the media is retrieved from a social media network or a public media database, the media comprising real-time geotagged imagery or video from social media networks corresponding to the virtual holiday destination;

generating a virtual environment based on the media, wherein the virtual environment is generated based on the real-time geotagged imagery or video;

generating a virtual representative of a user in the virtual environment;

upon determining that the user preference is unavailable, wherein the user preference is deemed unavailable when no feature in the retrieved media matches the user preference, generating geospatial data based on the unavailable user preference and at least one of: the media or historical media data, wherein the geospatial data represents a location of space in the virtual environment that can visually support a user preference instance and comprises geographic coordinates or map metadata extracted from the media or historical media data;

generating null input data corresponding to the unavailable user preference, wherein the null input data comprises a zero-valued placeholder tensor that substitutes for missing media features associated with the unavailable user preference;

reconstructing, via a null-infused denoising convolutional autoencoder, data of the unavailable user preference based on the null input data and the geospatial data; and

generating a user preference instance based on the reconstructed data of the unavailable user preference, wherein the user preference instance is a synthesized virtual representation that substitutes for the unavailable user preference, wherein the virtual environment is further generated based on the user preference instance.

2 . The method of claim 1 , wherein the media retrieved from the social media network includes real-time video or images, and wherein the media retrieved from the public media database includes historical video and images.

3 . The method of claim 1 , wherein the user preference represents at least one of: a tourist attraction, an event, a landmark, or a virtual vendor, and wherein the user preference is determined based on at least one of: a previous user preference of a previous virtual holiday, a user engagement with feature of the previous virtual holiday, a user profile, a travel wizard, or a text input field.

4 . The method of claim 1 , wherein the virtual environment includes a virtual vendor; wherein the virtual vendor represents a store, a seller, or a provider of goods or services available in the virtual environment; and wherein the virtual vendor is configured to:

receive a purchase order;

identify a local vendor corresponding to the virtual vendor, wherein the local vendor can provide a good, service, or experience associated with the virtual vendor or the purchase order; and

processing the purchase order via a vendor that is local to the user, wherein the purchase is routed to a physical or online vendor that is geographically local to the user for fulfillment and delivery.

5 . The method of claim 1 , wherein the user preference instance represents an attraction, an event, a landmark, or a vendor that can serve as a substitute or replacement of the user preference, and wherein the user preference instance is displayed as a substitute or replacement of the unavailable user preference.

6 . The method of claim 1 , wherein the virtual representative represents an avatar, a character design, or a 3 D model of the user in the virtual environment, and wherein the virtual representative can interact with a feature of the virtual environment.

7 . A system, comprising:

a processor; and

memory or storage comprising an algorithm or computer instructions, which when executed by the processor, performs an operation comprising:

receiving a virtual itinerary, wherein the virtual itinerary includes a virtual holiday destination and a user preference;

retrieving media of the virtual holiday destination based on the virtual itinerary, wherein the media is retrieved from a social media network or a public media database, the media comprising real-time geotagged imagery or video from social media networks corresponding to the virtual holiday destination;

generating a virtual environment based on the media, wherein the virtual environment is generated based on the real-time geotagged imagery or video;

generating a virtual representative of a user in the virtual environment;

upon determining that the user preference is unavailable, wherein the user preference is deemed unavailable when no feature in the retrieved media matches the user preference, generating geospatial data based on the unavailable user preference and at least one of: the media or historical media data, wherein the geospatial data represents a location of space in the virtual environment that can visually support a user preference instance and comprises geographic coordinates or map metadata extracted from the media or historical media data;

generating null input data corresponding to the unavailable user preference, wherein the null input data comprises a zero-valued placeholder tensor that substitutes for missing media features associated with the unavailable user preference;

reconstructing, via a null-infused denoising convolutional autoencoder, data of the unavailable user preference based on the null input data and the geospatial data; and

generating a user preference instance based on the reconstructed data of the unavailable user preference, wherein the user preference instance is a synthesized virtual representation that substitutes for the unavailable user preference, wherein the virtual environment is further generated based on the user preference instance.

8 . The system of claim 7 , wherein the media retrieved from the social media network includes real-time video or images, and wherein the media retrieved from the public media database includes historical video and images.

9 . The system of claim 7 , wherein the user preference represents at least one of: a tourist attraction, an event, a landmark, or a virtual vendor, and wherein the user preference is determined based on at least one of: a previous user preference of a previous virtual holiday, a user engagement with feature of the previous virtual holiday, a user profile, a travel wizard, or a text input field.

10 . The system of claim 7 , wherein the virtual environment includes a virtual vendor, wherein the virtual vendor represents a store, a seller, or a provider of goods or services available in the virtual environment; and wherein the virtual vendor is configured to:

receive a purchase order;

identify a local vendor corresponding to the virtual vendor, wherein the local vendor can provide a good, service, or experience associated with the virtual vendor or the purchase order; and

processing the purchase order via a vendor that is local to the user, wherein the purchase is routed to a physical or online vendor that is geographically local to the user for fulfillment and delivery.

11 . The system of claim 7 , wherein the user preference instance represents an attraction, an event, a landmark, or a vendor that can serve as a substitute or replacement of the user preference, and wherein the user preference instance is displayed as a substitute or replacement of the unavailable user preference.

12 . The system of claim 7 , wherein the virtual representative represents an avatar, a character design, or a 3 D model of the user in the virtual environment, and wherein the virtual representative can interact with a feature of the virtual environment.

13 . A computer-readable storage medium having a computer-readable program code embodied therewith, the computer-readable program code executable by one or more computer processors to perform an operation comprising:

receiving a virtual itinerary, wherein the virtual itinerary includes a virtual holiday destination and a user preference;

retrieving media of the virtual holiday destination based on the virtual itinerary, wherein the media is retrieved from a social media network or a public media database, the media comprising real-time geotagged imagery or video from social media networks corresponding to the virtual holiday destination;

generating a virtual environment based on the media, wherein the virtual environment is generated based on the real-time geotagged imagery or video;

generating a virtual representative of a user in the virtual environment;

upon determining that the user preference is unavailable, wherein the user preference is deemed unavailable when no feature in the retrieved media matches the user preference, generating geospatial data based on the unavailable user preference and at least one of: the media or historical media data, wherein the geospatial data represents a location of space in the virtual environment that can visually support a user preference instance and comprises geographic coordinates or map metadata extracted from the media or historical media data;

generating null input data corresponding to the unavailable user preference, wherein the null input data comprises a zero-valued placeholder tensor that substitutes for missing media features associated with the unavailable user preference;

reconstructing, via a null-infused denoising convolutional autoencoder, data of the unavailable user preference based on the null input data and the geospatial data; and

generating a user preference instance based on the reconstructed data of the unavailable user preference, wherein the user preference instance is a synthesized virtual representation that substitutes for the unavailable user preference, wherein the virtual environment is further generated based on the user preference instance.

14 . The computer-readable storage medium of claim 13 , wherein the media retrieved from the social media network includes real-time video or images, and wherein the media retrieved from the public media database includes historical video and images.

15 . The computer-readable storage medium of claim 13 , wherein the user preference represents at least one of: a tourist attraction, an event, a landmark, or a virtual vendor, and wherein the user preference is determined based on at least one of: a previous user preference of a previous virtual holiday, a user engagement with feature of the previous virtual holiday, a user profile, a travel wizard, or a text input field.

16 . The computer-readable storage medium of claim 13 , wherein the virtual environment includes a virtual vendor; wherein the virtual vendor represents a store, a seller, or a provider of goods or services available in the virtual environment; and wherein the virtual vendor is configured to:

receive a purchase order;

identify a local vendor corresponding to the virtual vendor, wherein the local vendor can provide a good, service, or experience associated with the virtual vendor or the purchase order; and

processing the purchase order via a vendor that is local to the user, wherein the purchase is routed to a physical or online vendor that is geographically local to the user for fulfillment and delivery.

17 . The computer-readable storage medium of claim 13 , wherein the user preference instance represents an attraction, an event, a landmark, or a vendor that can serve as a substitute or replacement of the user preference, and wherein the user preference instance is displayed as a substitute or replacement of the unavailable user preference.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2023
From: RAHA, AMIT KUMAR; CHAKRABORTY, AMITAVA
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 065332/0561 →
Continuity (1)
Related Publication 20250139881A1 · May 1, 2025
References Cited (22)
US 11017601B2 · Kim · 2021 [cited by applicant]
US 11120616B2 · Jiang et al. · 2021 [cited by applicant]
US 20110078052A1 · Ciptawilangga · 2011 [cited by applicant]
US 20160210602A1 · Siddique · 2016 [cited by examiner]
US 20180255285A1 · Hall et al. · 2018 [cited by applicant]
US 20190073831A1 · Kim · 2019 [cited by applicant]
US 20200273253A1 · Jadallah et al. · 2020 [cited by applicant]
US 20220100812A1 · Anvaripour · 2022 [cited by examiner]
US 20240127543A1 · Dessert · 2024 [cited by examiner]
US 20240144413A1 · Ishii · 2024 [cited by examiner]
US 20240367795A1 · Kasody · 2024 [cited by examiner]
KR 102314273B1 · 2021 [cited by applicant]
RU 2771098C2 · 2022 [cited by applicant]
Alexiei Dingli, “The Everyday Virtual Vacation: How to go on a global vacation from the comfort of your living room,” https://becominghuman.ai/the-everyday-virtual-vacation-28f6923f0ea0 (retrieved Jul. 5, 2023), 13 page… [cited by applicant]
Bronzin et al. “Artificial Intelligence (AI) brings enhanced personalized user experience.” 2021 44th International Convention on Information, Communication and Electronic Technology (MIPRO). IEEE, 2021, pp. 1231-1236. [cited by applicant]
Jang, Jong-Hwan, et al. “Deep learning approach for imputation of missing values in actigraphy data: Algorithm development study.” JMIR mHealth and uHealth vol. 8, Iss. 7, e16113,(2020): 14 pages. [cited by applicant]
Virtual Vacations, “Virtual Vacations: The website that lets you experience the world from home!” https://virtualvacation.us/ (retrieved Jul. 5, 2023), 3 pages. [cited by applicant]
Anshel Sag, “HypeVR Brings Industry-First Live Real-Time Photorealistic Volumetric Video Streaming To Life”, Sep. 16, 2022, 8 pages, doi: https://www.forbes.com/sites/moorinsights/2022/09/16/hypevr-brings-industry-first… [cited by applicant]
Hermes, “Real Time Streaming within Augmented and Virtual Reality”, Jun. 14, 2019, 26 pages, doi: https://medium.com/agora-io/sharing-augmented-realities-in-realtime-bfaf9d6f5283. [cited by applicant]
Lee et al., “Measurement Study of Real-Time Virtual Reality Contents Streaming over IEEE 802.11ac Wireless Links”, Electronics, Aug. 15, 2021, 13 pages, vol. 10, No. 16, doi: https://www.mdpi.com/2079-9292/10/16/1967. [cited by applicant]
Thomas Cook Virtual Reality Holiday ‘Try Before You Fly’, Work, 4 pages, Launched in 2015, 4 pages, doi: https://visualise.com/case-study/thomas-cook-virtual-holiday. [cited by applicant]
Tom Emrich, “How Augmented Reality Will Save the Holidays for Brick-and-Mortar Retail”, Adweek, 10 pages, doi: https://www.adweek.com/sponsored/how-augmented-reality-will-save-the-holidays-for-brick-and-mortar-retail/. [cited by applicant]