IP Library › Granted Patent US 12,285,680
Granted Patent B2
US 12,285,680 · App. 17/747,680 · Granted Apr 29, 2025

Multiplayer somatosensory system, method, and apparatus combining virtual and reality, and medium

Inventors: Gaolei Wang (Shenzhen, CN); Yingyan Zhu (Shenzhen, CN); Hui Xiao (Shenzhen, CN); Xin Liu (Shenzhen, CN); Jin Wang (Shenzhen, CN); Li Luo (Shenzhen, CN); Yu Lin (Shenzhen, CN)
Assignee: Tencent Technology (Shenzhen) Company Limited
A63F13/52A63F13/57A63F13/803A63F13/837A63F2300/8082
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,285,680
App. No.
17/747,680
Granted
Apr 29, 2025
Kind
B2
Abstract

This disclosure discloses a multiplayer somatosensory system, method, and apparatus combining virtual and reality, and a medium, which belongs to the field of human-computer interaction. The system includes: a computer device, and a simulation carrier, n simulation firearms and a display apparatus; where the simulation carrier includes a driver's seat and n passenger seats; the display apparatus is configured to display a virtual environment picture and n aiming points provided by the computer device; and the computer device is configured to control a virtual carrier to change a driving direction in the virtual environment; control the virtual carrier to change a driving speed in the virtual environment; and shoot a virtual object aimed at an i th aiming point in the virtual environment in response to a shooting operation on an i th simulation firearm in the n simulation firearms.

Claims (80)

1. A multiplayer somatosensory system, comprising:

a simulation carrier, comprising:

a driver's seat;

n passenger seats, disposed adjacent to the driver's seat;

a first controller, disposed adjacent to the driver's seat and configured to control a driving direction; and

a second controller, disposed adjacent to the driver's seat and configured to control a driving speed;

n simulation firearms, n being a positive integer;

a display apparatus configured to display a virtual environment picture and n aiming points, the virtual environment picture being a picture of a virtual environment in which a virtual carrier corresponding to the simulation carrier is located; and

a computer, coupled to the simulation carrier, the n simulation firearms, and the display apparatus, and configured to:

provide the n aiming points;

control, in response to a first driving operation on the first controller, the virtual carrier to change the driving direction in the virtual environment;

control, in response to a second driving operation on the second controller, the virtual carrier to change the driving speed in the virtual environment;

shoot a virtual object aimed at an i th aiming point in the virtual environment in the n aiming points in response to a shooting operation on an i th simulation firearm in the n simulation firearms, i being a positive integer not greater than n;

transmit room information of the virtual environment, an entry graphic code of the driver's seat, and entry graphic codes of the n passenger seats to an administrator terminal;

receive a first join request triggered by a first terminal scanning the entry graphic code of the driver's seat; and

add, in response to the first join request, a virtual character corresponding to a first account logged in by the first terminal to the driver's seat of the virtual carrier in the virtual environment.

2. The system according to claim 1 , wherein:

the simulation carrier comprises a simulation vehicle, the first controller comprises a steering wheel, and the second controller comprises an accelerator and a brake;

or,

the simulation carrier comprises a simulation aircraft, the first controller comprises at least one of a flight stick or a rudder, and the second controller comprises a throttle stick.

3. The system according to claim 1 , wherein

at least one seat of the driver's seat or the n passenger seats comprises a vibration feedback component.

4. The system according to claim 1 , wherein

at least one of the n simulation firearms establishes a wireless communication connection with the computer;

and/or,

at least one of the n simulation firearms establishes a wired communication connection with the computer.

5. The system according to claim 1 , wherein

the display apparatus comprises a virtual reality headset; or

the display apparatus comprises n+1 virtual reality (VR) headsets; or

the display apparatus comprises a display screen; or

the display apparatus comprises a semi-surround screen disposed in front of the simulation carrier or a surround screen disposed on a peripheral side of the simulation carrier; or

the display apparatus comprises a projector.

6. The system according to claim 5 , wherein the display apparatus comprises the semi-surround screen disposed in front of the simulation carrier,

a width of the semi-surround screen being not less than a width of the simulation carrier, and a height of the semi-surround screen being not less than a height of the simulation carrier.

7. A multiplayer somatosensory method, comprising:

displaying a virtual environment picture and n aiming points by using a display apparatus, the virtual environment picture being a picture of a virtual environment in which a virtual carrier corresponding to a simulation carrier is located;

controlling, in response to a first driving operation on a first controller, the virtual carrier to change a driving direction in the virtual environment;

controlling, in response to a second driving operation on a second controller, the virtual carrier to change a driving speed in the virtual environment;

shooting a virtual object aimed at an i th aiming point in the virtual environment in n aiming points in response to a shooting operation on an i th simulation firearm in n simulation firearms;

transmitting room information of the virtual environment, an entry graphic code of a driver's seat, and entry graphic codes of n passenger seats to an administrator terminal;

receiving a first join request triggered by a first terminal scanning the entry graphic code of the driver's seat; and

adding, in response to the first join request, a virtual character corresponding to a first account logged in by the first terminal to the driver's seat of the virtual carrier in the virtual environment.

8. The method according to claim 7 , wherein the simulation carrier comprises a simulation vehicle; and

controlling, in response to the first driving operation on the first controller, the virtual carrier to change the driving direction in the virtual environment comprises:

controlling, in response to the first driving operation on a steering wheel of the simulation vehicle, a virtual vehicle to change the driving direction in the virtual environment.

9. The method according to claim 7 , wherein the simulation carrier comprises a simulation aircraft; and

controlling, in response to the first driving operation on the first controller, the virtual carrier to change the driving direction in the virtual environment comprises:

controlling, in response to the first driving operation on a flight stick and/or a rudder of the simulation aircraft, a virtual aircraft to change the driving direction in the virtual environment.

10. The method according to claim 7 , wherein the simulation carrier comprises a simulation vehicle; and

controlling, in response to the second driving operation on the second controller, the virtual carrier to change the driving speed in the virtual environment comprises:

controlling, in response to the second driving operation on an accelerator and/or a brake of the simulation vehicle, a virtual vehicle to change the driving speed in the virtual environment.

11. The method according to claim 7 , wherein the simulation carrier comprises a simulation aircraft; and

controlling, in response to the second driving operation on the second controller, the virtual carrier to change the driving speed in the virtual environment comprises:

controlling, in response to the second driving operation on a throttle stick of the simulation aircraft, a virtual aircraft to change the driving speed in the virtual environment.

12. The method according to claim 7 , wherein the display apparatus comprises n+1 VR headsets; and

displaying the virtual environment picture and the n aiming points by using the display apparatus comprises:

displaying the virtual environment picture and the i th aiming point in the n aiming points by using an (i+1) th VR headset in the n+1 VR headsets.

13. The method according to claim 7 , wherein the display apparatus comprises a surround screen or a projector; and

displaying the virtual environment picture and the n aiming points by using the display apparatus comprises:

displaying the virtual environment picture and the n aiming points by using the surround screen or the projector, the n aiming points having different icon styles, the icon styles comprising at least one of shape, color, transparency, or number.

14. The method according to claim 7 , further comprising:

receiving a second join request triggered by that a second terminal scans the entry graphic code of the passenger seat; and

adding, in response to the second join request, a virtual character corresponding to a second account logged by the second terminal to the passenger seat of the virtual carrier in the virtual environment.

15. A non-transitory computer-readable storage medium, storing a computer program, the computer program being loaded and executed by a processor to perform steps comprising:

displaying a virtual environment picture and n aiming points by using a display apparatus, the virtual environment picture being a picture of a virtual environment in which a virtual carrier corresponding to a simulation carrier is located;

controlling, in response to a first driving operation on a first controller, the virtual carrier to change a driving direction in the virtual environment;

controlling, in response to a second driving operation on a second controller, the virtual carrier to change a driving speed in the virtual environment; and

shooting a virtual object aimed at an i th aiming point in the virtual environment in the n aiming points in response to a shooting operation on an i th simulation firearm in n simulation firearms;

transmitting room information of the virtual environment, an entry graphic code of a driver's seat, and entry graphic codes of n passenger seats to an administrator terminal;

receiving a first join request triggered by a first terminal scanning the entry graphic code of the driver's seat; and

adding, in response to the first join request, a virtual character corresponding to a first account logged in by the first terminal to the driver's seat of the virtual carrier in the virtual environment.

16. The non-transitory computer-readable storage medium of claim 15 , wherein controlling, in response to the first driving operation on the first controller, the virtual carrier to change the driving direction in the virtual environment comprises:

controlling, in response to the first driving operation on a steering wheel of a simulation vehicle, a virtual vehicle to change the driving direction in the virtual environment.

17. The non-transitory computer-readable storage medium of claim 15 , wherein controlling, in response to the first driving operation on the first controller, the virtual carrier to change the driving direction in the virtual environment comprises:

controlling, in response to the first driving operation on a flight stick and/or a rudder of a simulation aircraft, a virtual aircraft to change the driving direction in the virtual environment.

18. The non-transitory computer-readable storage medium of claim 15 , wherein controlling, in response to the second driving operation on the second controller, the virtual carrier to change the driving speed in the virtual environment comprises:

controlling, in response to the second driving operation on an accelerator and/or a brake of a simulation vehicle, a virtual vehicle to change the driving speed in the virtual environment.

19. The non-transitory computer-readable storage medium of claim 15 , wherein controlling, in response to the second driving operation on the second controller, the virtual carrier to change the driving speed in the virtual environment comprises:

controlling, in response to the second driving operation on a throttle stick of a simulation aircraft, a virtual aircraft to change the driving speed in the virtual environment.

20. The non-transitory computer-readable storage medium of claim 15 , wherein displaying the virtual environment picture and the n aiming points by using the display apparatus comprises: displaying the virtual environment picture and the i th aiming point in the n aiming points by using an (i+1) th VR headset in n+1 VR headsets.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2022
From: WANG, GAOLEI; ZHU, YINGYAN; XIAO, HUI; LIU, XIN; WANG, JIN; LUO, LI; LIN, YU
To: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
Reel/Frame 060165/0752 →
Priority Claims (1)
CN 202110412770.7 · Apr 16, 2021 · national
Continuity (2)
Continuation PCTCN2021124201 · Oct 15, 2021
Related Publication 20220331694A1 · Oct 20, 2022
References Cited (45)
US 10736159B2 · Kim · 2020 [cited by examiner]
US 20100267451A1 · Kawano · 2010 [cited by examiner]
US 20130005489A1 · Santhosh · 2013 [cited by examiner]
US 20130244789A1 · Gary · 2013 [cited by examiner]
US 20130310169A1 · Satsuma · 2013 [cited by examiner]
US 20130312013A1 · Ito · 2013 [cited by examiner]
US 20140068659A1 · Vasilikakis · 2014 [cited by examiner]
US 20190105572A1 · Bell · 2019 [cited by examiner]
US 20190121522A1 · Davis · 2019 [cited by examiner]
US 20200086213A1 · Perry et al. · 2020 [cited by applicant]
US 20200098172A1 · Atsmon · 2020 [cited by applicant]
US 20210012615A1 · Coppola · 2021 [cited by examiner]
US 20210192894A1 · Higgins · 2021 [cited by examiner]
US 20220197422A1 · Freudenberg · 2022 [cited by examiner]
US 20220301041A1 · Lee · 2022 [cited by examiner]
US 20230226445A1 · Buxton, III · 2023 [cited by examiner]
CN 103295446A · 2013 [cited by applicant]
CN 104857704A · 2015 [cited by applicant]
CN 107358656A · 2017 [cited by applicant]
CN 108172062A · 2018 [cited by applicant]
CN 111369861A · 2020 [cited by applicant]
CN 111625930A · 2020 [cited by applicant]
CN 112973119A · 2021 [cited by applicant]
EP 2883748A1 · 2015 [cited by applicant]
JP 6176131 · 1994 [cited by applicant]
JP H06176131A · 1994 [cited by applicant]
JP H836355 · 1996 [cited by applicant]
JP 2000116962A · 2000 [cited by applicant]
JP 2007268286A · 2007 [cited by applicant]
JP 2013141527 · 2013 [cited by applicant]
JP 6176131B2 · 2017 [cited by applicant]
KR 1020180008235A · 2018 [cited by applicant]
WO WO2018002910A1 · 2018 [cited by applicant]
Machine Translation of JPH06176131A, Picture Synthesis Device and Virtual Reality Device Using the Same, 2017, pp. 1-14 (Year: 2017). [cited by examiner]
International Search Report and Written Opinion for priority application No. PCT/CN2021/124201 dated Jan. 14, 2022, 11p, in Chinese language. [cited by applicant]
Concise Explanation of Relevance. [cited by applicant]
Second Office Action for corresponding application No. CN 202110412770.7 dated Jan. 28, 2023, 3p, in Chinese language. [cited by applicant]
Notification of Reasons for Refusal for corresponding application No. JP 2022-562121 dated Jul. 10, 2023, 4p, in Japanese language. [cited by applicant]
English language translation for Notification of Reasons for Refusal for corresponding application No. JP 2022-562121 dated Jul. 10, 2023, 5p. [cited by applicant]
Third examination report for corresponding application No. CN 202110412770.7 dated Jul. 29, 2023, 18p, in Chinese language. [cited by applicant]
Concise Explanation of Relevancy. [cited by applicant]
Search Report and First Office Action for corresponding application No. CN 202110412770.7 dated Oct. 18, 2022, 14p, in Chinese language. [cited by applicant]
Concise Explantion of Relevance. [cited by applicant]
Korean Office Action with English translation, Jul. 16, 2024, pp. 1-18, issued in Korean Patent Application No. 10-2022-7031619, Intellectual Property Office. [cited by applicant]
Korean Office Action with English translation, Dec. 16, 2024, pp. 1-19, issued in Korean Application No. 10-2022-7031619, Intellectual Property Office. [cited by applicant]
Cited By (1)
US 12,582,911