IP Library › Granted Patent US 12,494,024
Granted Patent B2
US 12,494,024 · App. 18/200,111 · Granted Dec 9, 2025

Experience sharing system and method thereof

Inventor: Kyoung Jin Chang (Suwon-si, KR)
Assignees: HYUNDAI MOTOR COMPANY; Kia Corporation
G06T19/006G06F3/167G06V10/764G06V20/20G06T2219/024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,494,024
App. No.
18/200,111
Filed
May 22, 2023
Granted
Dec 9, 2025
Kind
B2
Examiner
LI, GRACE Q
Art Unit
2618
USPC
345/419
Abstract

An experience sharing system for sharing an experience with others using VR and a method thereof includes a VR recorder that records a surrounding environment image, a user response image, and a surrounding sound of a first user to generate experience content, a VR player that plays and provides the experience content to a second user, and a data processing device connected to the VR recorder and the VR player over a communication network. The data processing device pre-analyzes the experience content received from the VR recorder to classify a category, adds an image matched with the classified category to the experience content, stores the experience content to which the image is added in a DB, and accesses the experience content from the DB depending on a request of the VR player and transmits the accessed experience content to the VR player.

Claims (64)

1 . An experience sharing system, comprising:

a virtual reality (VR) recorder configured to record a surrounding environment image, a user response image, and a surrounding sound of a first user using a camera and a microphone to generate experience content;

a VR player configured to play and provide the experience content to a second user; and

a data processing device connected to the VR recorder and the VR player over a communication network,

wherein the data processing device is configured to:

pre-analyze the experience content received from the VR recorder to classify a category;

add an image matched with the classified category to the experience content;

store the experience content to which the image matched with the classified category to the experience content is added in a database (DB);

access the experience content from the DB depending on a request of the VR player; and

transmit the accessed experience content to the VR player.

2 . The experience sharing system of claim 1 , wherein the user response image includes at least one of a facial expression or an operation of the first user.

3 . The experience sharing system of claim 1 , wherein the surrounding sound includes a surrounding environment sound and a voice of the first user.

4 . The experience sharing system of claim 1 , wherein the VR recorder is configured to add unique information of the first user to the experience content.

5 . The experience sharing system of claim 1 , wherein the data processing device is configured to classify a season and a place using an artificial intelligence (AI) algorithm.

6 . The experience sharing system of claim 1 , wherein the image matched with the classified category to the experience content includes a three-dimensional (3D) image for at least one of a crowd, a building, or a natural environment.

7 . The experience sharing system of claim 1 ,

wherein the VR player is further configured to:

transmit experience content selection information, first option selection information, and second optional selection information by the second user to the data processing device, and

wherein the data processing device is further configured to:

correct the surrounding environment image and the surrounding sound of the experience content based on the first option selection information and the second option selection information; and

transmit the corrected experience content to the VR player.

8 . The experience sharing system of claim 7 ,

wherein the first option selection information includes information associated with at least one of a weather change, a time change, or background sound addition, and

wherein the second option selection information includes information associated with background addition.

9 . The experience sharing system of claim 1 , further including:

a transaction server configured to register the experience content as content for sale depending on a request of the data processing device.

10 . The experience sharing system of claim 9 , further including:

a non-fungible token (NFT) transformation server configured to transform the experience content registered as the content for sale into an NFT and digitally assetize the transformed NFT depending on a request of the transaction server.

11 . An experience sharing method performed by a data processing device, comprising:

receiving, by the data processing device, from a virtual reality (VR) recorder, experience content which is generated based on a surrounding environment image, a user response image, and a surrounding sound of a first user recorded by using a camera and a microphone of the VR recorder;

pre-analyzing, by the data processing device, the experience content received from the VR recorder to classify a category;

adding, by the data processing device, an image matched with the classified category to the experience content;

storing, by the data processing device, the experience content to which the image matched with the classified category to the experience content is added in a database (DB);

accessing, by the data processing device, the experience content from the DB depending on a request of a VR player; and

transmitting, by the data processing device, the accessed experience content to the VR player, to play and provide,

the experience content to a second user by using the VR player.

12 . The experience sharing method of claim 11 , wherein the user response image includes at least one of a facial expression or an operation of the first user.

13 . The experience sharing method of claim 11 , wherein the surrounding sound includes a surrounding environment sound and a voice of the first user.

14 . The experience sharing method of claim 11 , wherein the generating of the experience content includes:

adding, by the VR recorder, unique information of the first user to the experience content.

15 . The experience sharing method of claim 11 , wherein the classifying of the category includes:

classifying, by the data processing device, a season and a place using an artificial intelligence (AI) algorithm.

16 . The experience sharing method of claim 11 , wherein the image matched with the classified category to the experience content includes a 3D image for at least one of a crowd, a building, or a natural environment.

17 . The experience sharing method of claim 11 , wherein the transmitting to the VR player includes:

transmitting, by the VR player, experience content selection information, first option selection information, and second option selection information by the second user to the data processing device;

correcting, by the data processing device, the surrounding environment image and the surrounding sound of the experience content based on the first option selection information and the second option selection information; and

transmitting, by the data processing device, the corrected experience content to the VR player.

18 . The experience sharing method of claim 17 ,

wherein the first option selection information includes information associated with at least one of a weather change, a time change, or background sound addition, and

wherein the second option selection information includes information associated with background addition.

19 . The experience sharing method of claim 11 , further including:

registering, by the data processing device, the experience content as a content for sale with a transaction server.

20 . The experience sharing method of claim 19 , further including:

requesting, by the transaction server, a non-fungible token (NFT) transformation server to digitally assetize the experience content registered as the content for sale; and

transforming, by the NFT transformation server, the experience content registered as the content for sale into an NFT.

21 . A non-transitory computer readable medium containing program instructions executed by a data processing device, the computer readable medium storing:

program instructions configured to:

receive from a virtual reality (VR) recorder, experience content which is generated based on a surrounding environment image, a user response image, and a surrounding sound of a first user recorded by using a camera and a microphone of the VR recorder;

pre-analyze the experience content received from the VR recorder to classify a category;

an image matched with the classified category to the experience content;

the experience content to which the image matched with the classified category to the experience content is added in a database (DB);

access the experience content from the DB depending on a request of a VR player; and

transmit the accessed experience content to the VR player, to play and provide,

the experience content to a second user by using the VR player.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 22, 2023
From: CHANG, KYOUNG JIN
To: HYUNDAI MOTOR COMPANY; KIA CORPORATION
Reel/Frame 063716/0055 →
Priority Claims (1)
KR 10-2022-0094843 · Jul 29, 2022 · national
Continuity (1)
Related Publication 20240037867A1 · Feb 1, 2024
References Cited (17)
US 10055887B1 · Gil · 2018 [cited by examiner]
US 10769797B2 · Budagavi et al. · 2020 [cited by applicant]
US 20170243403A1 · Daniels · 2017 [cited by examiner]
US 20180189958A1 · Budgavi et al. · 2018 [cited by applicant]
US 20200110264A1 · Nanasawa et al. · 2020 [cited by applicant]
US 20200202979A1 · Apte · 2020 [cited by examiner]
US 20200265613A1 · Yoon · 2020 [cited by examiner]
US 20210056758A1 · Yerli · 2021 [cited by applicant]
US 20220272133A1 · Jeon · 2022 [cited by applicant]
US 20220384027A1 · Kaleal, III · 2022 [cited by examiner]
US 20240181349A1 · Lee · 2024 [cited by examiner]
US 20240273835A1 · Gustafsson · 2024 [cited by examiner]
JP 202061118A · 2020 [cited by applicant]
KR 1020170081456A · 2017 [cited by applicant]
KR 1020190071839A · 2019 [cited by applicant]
KR 1020200003291A · 2020 [cited by applicant]
KR 1020210004862A · 2021 [cited by applicant]