IP Library › Granted Patent US 9,839,854
Granted Patent B2
US 9,839,854 · App. 14/970,095 · Granted Dec 12, 2017

Built-in support of in-game virtual split screens with peer-to peer-video conferencing

Inventors: James van Welzen (Durham, NC); David Le Tacon (Cedar Park, TX)
Assignee: Nvidia Corporation
A63F13/87A63F13/213A63F13/215A63F13/25A63F13/30A63F13/32A63F13/34A63F13/355A63F13/86H04N7/15A63F2300/401
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,839,854
App. No.
14/970,095
Granted
Dec 12, 2017
Kind
B2
Abstract

Methods of providing in-game virtual split screens with peer-to-peer video conferencing are described for use in online gaming, for instance. In one approach, a live video stream, a live audio stream, and a player viewpoint are sent from a first computer system for receipt by a second computer system. The first and second computer systems concurrently execute the online game. The live video stream, the in-game video stream, and locally rendered in-game content are combined to create a composite video stream, and the live audio stream, the in-game audio stream, and locally generated in-game audio are combined to create a composite audio stream. The composite video stream and the composite audio stream are operable to be presented at the second computer system in real-time.

Claims (38)

1. A method of sharing information with remote players in an online multiplayer game, the method comprising:

executing the online multiplayer game using a processor and a memory of a computer system;

capturing a live video stream using a camera of the computer system;

capturing a live audio stream using a microphone of the computer system;

generating a player viewpoint of the online multiplayer game during execution thereof, wherein the player viewpoint comprises an in-game video stream and an in-game audio stream; and

sending the live video stream, the live audio stream, and the player viewpoint for receipt by a second computer system;

accessing the live video stream, the live audio stream, and the player viewpoint on the second computer system using a third computer system;

combining the live video stream and the in-game video stream to create a composite video stream;

combining the live audio stream and the in-game audio stream to create a composite audio stream;

rendering the composite video stream at the third computer system within a graphical user interface of the online multiplayer game; and

reproducing the composite audio stream at the third computer system during execution of the online multiplayer game by the third computer system,

wherein the computer system and the third computer system are concurrently executing the online multiplayer game, the graphical user interface of the online multiplayer game comprises interactive in-game content generated by the third computer system, and wherein the composite video stream is presented alongside the interactive in-game content generated by the third computer system.

2. The method of claim 1 , further comprising performing at least one of compression, encryption, or encoding on the live video stream and the live audio stream.

3. The method of claim 1 , further comprising performing at least one of compression, encryption, or encoding on the in-game video stream and the in-game audio stream.

4. The method of claim 1 , wherein the in-game video stream is generated using a 3D driver.

5. The method of claim 1 , wherein said sending utilizes a computer network and wherein the computer network comprises the Internet.

6. The method of claim 1 , wherein said sending utilizes a computer network and wherein the computer network comprises a local area network.

7. A method of sharing an online multiplayer game, the method comprising:

executing the online multiplayer game using a processor and a memory of a computer system;

capturing a live video stream using a camera communicatively coupled to the computer system;

capturing a live audio stream using a microphone communicatively coupled to the computer system;

generating a player viewpoint of the online multiplayer game during execution, wherein the player viewpoint comprises an in-game video stream and an in-game audio stream; and

sending the live video stream, the live audio stream, and the player viewpoint for receipt by a host using a computer network, wherein: the host is operable to connect to a second computer system using the computer network; the second computer system is operable to concurrently execute the online multiplayer game; the live video stream and the in-game video stream are combined to create a composite video stream; the live audio stream and the in-game audio stream are combined to create a composite audio stream; the composite video stream is operable to be rendered at the second computer system within a graphical user interface of the online multiplayer game; the graphical user interface of the online multiplayer game comprises interactive in-game content generated by the second computer system; and wherein the composite video stream is presented alongside the interactive in-game content generated by the second computer system.

8. The method of claim 7 , further comprising performing at least one of compression, encryption, or encoding on the live video stream and the live audio stream.

9. The method of claim 7 , further comprising performing at least one of compression, encryption, or encoding on the in-game video stream and the in-game audio stream.

10. The method of claim 7 , wherein the in-game video stream is generated using a 3D driver.

11. The method of claim 7 , wherein the computer network comprises the Internet.

12. The method of claim 7 , wherein the computer network comprises a local area network.

13. An apparatus for sharing a player viewpoint and audio-video communication with remote players of an online multiplayer game, comprising:

a processor and memory configured to execute instructions of an online multiplayer game, wherein the instructions, when executed, generate the player viewpoint comprising in-game audio data and in-game video data;

a camera for capturing a live video stream;

a microphone for capturing a live audio stream;

a network streamer for sending the in-game audio data, the in-game video data, the live video stream, and the live audio stream for receipt by a host using a computer network and receiving data from the host using the computer network;

a video compositor for combining the in-game video data, the live video stream, and local in-game video data to create a composite video stream; and

an audio compositor for combining in-game audio data, live audio stream, and local in-game audio data to create a composite audio stream, wherein: the host connects to a second computer system using the computer network; the second computer system is concurrently executing a copy of the online multiplayer game; and the composite video stream and the composite audio stream are presented at the second computer system such that the in-game audio and video and the live audio and video streams are presented alongside interactive in-game content generated by the second computer system within a graphical user interface of the online multiplayer game.

14. The apparatus of claim 13 , further comprising a 3D driver for translating video data instructions.

15. The apparatus of claim 13 , further comprising a video encoder for encoding video data and an audio encoder for encoding audio data.

16. The apparatus of claim 15 , further comprising a video decoder for decoding video data and an audio decoder for decoding audio data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 15, 2015
From: VAN WELZEN, JAMES; LE TACON, DAVID
To: NVIDIA CORPORATION
Reel/Frame 037297/0725 →
Continuity (1)
Related Publication 20170165569A1 · Jun 15, 2017