IP Library › Granted Patent US 11,227,440
Granted Patent B2
US 11,227,440 · App. 16/425,945 · Granted Jan 18, 2022

Systems and methods for providing an audio-guided virtual reality tour

Inventor: Yuke Yang (Beijing, CN)
Assignee: KE.COM (BEIJING)TECHNOLOGY CO., LTD.
G06T19/003G06F3/165G06F3/167G06T7/75G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,227,440
App. No.
16/425,945
Granted
Jan 18, 2022
Kind
B2
Abstract

Systems and methods are provided for providing an audio-guided in-door virtual reality (VR) tour. An exemplary system may include a communication interface configured to receive input from a user and to output media contents, a memory storing computer-readable instructions, and at least one processor coupled to the communication interface and the memory. The computer-readable instructions, when executed by the processor, may cause the at least one processor to perform operations. The operations may include displaying a view of a 3D VR environment and playing an audio guide associated with the view. The operations may also include detecting, during the playing of the audio guide, a target operation input by the user to alter the view. In response to the detection of the target operation, the operations may include adjusting, based on the detected target operation, the view with respect to a fixed point position within the 3D VR environment.

Claims (53)

1. A system for providing an audio-guided in-door virtual reality (VR) tour, comprising:

a communication interface configured to receive input from a user and to output media contents;

a memory storing computer-readable instructions; and

at least one processor coupled to the communication interface and the memory, wherein the computer-readable instructions, when executed by the at least one processor, cause the at least one processor to perform operations comprising:

displaying, through the communication interface, a view of a three-dimensional (3D) VR environment;

playing, through the communication interface, an audio guide associated with the view;

during the playing of the audio guide, automatically altering the view by playing back a sequence of pre-recorded spatial operations to manipulate a field of view (FOV) for observing the 3D VR environment, wherein the playing back of the sequence of the pre-recording spatial operations is in synchronization with the playing of the audio guide;

detecting, during the playing of the audio guide, a target operation input by the user to further alter the view that is being automatically altered;

in response to the detection of the target operation, adjusting, based on the detected target operation, the view with respect to a fixed point position within the 3D VR environment, wherein the fixed point position is within a first functional space of the 3D VR environment and adjusting the view by changing to any other point position is not allowed;

detecting, during the playing of the audio guide, an operation input by the user to change, in virtual reality, the view from the first functional space to a second function space that is different from the first functional space; and

in response to the detection of the operation, sending, through the communication interface, an alert indicating the operation is not permitted because of the playing of the audio guide.

2. The system of claim 1 , wherein the fixed point position corresponds to a first point position at which the view is displayed when the target operation is detected.

3. The system of claim 1 , wherein the fixed point position corresponds to a first point position at which the view is captured by a VR image capturing device.

4. The system of claim 1 , wherein:

the target operation comprises altering the FOV for observing the 3D VR environment; and

the operations comprise displaying, based on the FOV, the adjusted view observed at the fixed point position.

5. The system of claim 4 , wherein the target operation comprises at least one of a sliding operation, a zooming-in operation, or a zooming-out operation.

6. The system of claim 1 , wherein the operations comprise:

displaying, through the communication interface, an audio guide control associated with the audio guide on a launching page of the audio-guided in-door VR tour, the launching page comprising an image associated with the audio-guided in-door VR tour;

receiving, through the communication interface, an instruction from the user triggering the audio guide control; and

in response to the reception of the instruction, automatically playing the audio guide and displaying the view of the 3D VR environment associated with the audio guide.

7. The system of claim 6 , wherein the audio guide control comprises at least one of an image of an audio guide narrator, a description of the audio guide, or a play button.

8. A method for providing an audio-guided in-door virtual reality (VR) tour, comprising:

displaying, through a communication interface, a view of a three-dimensional (3D) VR environment;

playing, through the communication interface, an audio guide associated with the view;

during the playing of the audio guide, automatically altering the view by playing back a sequence of pre-recorded spatial operations to manipulate a field of view (FOV) for observing the 3D VR environment, wherein the playing back of the sequence of the pre-recording spatial operations is in synchronization with the playing of the audio guide;

detecting, during the playing of the audio guide, a target operation input by a user to further alter the view that is being automatically altered;

in response to the detection of the target operation, adjusting, based on the detected target operation, the view with respect to a fixed point position within the 3D VR environment, wherein the fixed point position is within a first functional space of the 3D VR environment and adjusting the view by changing to any other point position is not allowed;

detecting, during the playing of the audio guide, an operation input by the user to change, in virtual reality, the view from the first functional space to a second function space that is different from the first functional space; and

in response to the detection of the operation, sending, through the communication interface, an alert indicating the operation is not permitted because of the playing of the audio guide.

9. The method of claim 8 , wherein the fixed point position corresponds to a first point position at which the view is displayed when the target operation is detected.

10. The method of claim 8 , wherein the fixed point position corresponds to a first point position at which the view is captured by a VR image capturing device.

11. The method of claim 8 , wherein:

the target operation comprises altering the FOV for observing the 3D VR environment; and

the method comprises displaying, based on the FOV, the adjusted view observed at the fixed point position.

12. The method of claim 11 , wherein the target operation comprises at least one of a sliding operation, a zooming-in operation, or a zooming-out operation.

13. The method of claim 8 , comprising:

displaying, through the communication interface, an audio guide control associated with the audio guide on a launching page of the audio-guided in-door VR tour, the launching page comprising an image associated with the audio-guided in-door VR tour;

receiving, through the communication interface, an instruction from the user triggering the audio guide control; and

in response to the reception of the instruction, automatically playing the audio guide and displaying the view of the 3D VR environment associated with the audio guide.

14. The method of claim 13 , wherein the audio guide control comprises at least one of an image of an audio guide narrator, a description of the audio guide, or a play button.

15. A non-transitory computer-readable medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform a method for providing an audio-guided in-door virtual reality (VR) tour, the method comprising:

displaying, through a communication interface, a view of a three-dimensional (3D) VR environment;

playing, through the communication interface, an audio guide associated with the view;

during the playing of the audio guide, automatically altering the view by playing back a sequence of pre-recorded spatial operations to manipulate a field of view (FOV) for observing the 3D VR environment, wherein the playing back of the sequence of the pre-recording spatial operations is in synchronization with the playing of the audio guide;

detecting, during the playing of the audio guide, a target operation input by a user to further alter the view that is being automatically altered;

in response to the detection of the target operation, adjusting, based on the detected target operation, the view with respect to a fixed point position within the 3D VR environment, wherein the fixed point position is within a first functional space of the 3D VR environment and adjusting the view by changing to any other point position is not allowed;

detecting, during the playing of the audio guide, an operation input by the user to change, in virtual reality, the view from the first functional space to a second function space that is different from the first functional space; and

in response to the detection of the operation, sending, through the communication interface, an alert indicating the operation is not permitted because of the playing of the audio guide.

16. The non-transitory computer-readable medium of claim 15 , wherein the method comprises:

displaying, through the communication interface, an audio guide control associated with the audio guide on a launching page of the audio-guided in-door VR tour, the launching page comprising an image associated with the audio-guided in-door VR tour;

receiving, through the communication interface, an instruction from the user triggering the audio guide control; and

in response to the reception of the instruction, automatically playing the audio guide and displaying the view of the 3D VR environment associated with the audio guide.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2022
From: KE.COM (BEIJING)TECHNOLOGY CO., LTD.
To: REALSEE (BEIJING) TECHNOLOGY CO., LTD.
Reel/Frame 062183/0681 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 31, 2019
From: YANG, YUKE
To: KE.COM (BEIJING)TECHNOLOGY CO., LTD.
Reel/Frame 049326/0211 →
Priority Claims (2)
CN 201810538662.2 · May 30, 2018 · national
CN 201810539141.9 · May 30, 2018 · national
Continuity (1)
Related Publication 20190371062A1 · Dec 5, 2019