IP Library › Granted Patent US 12,544,664
Granted Patent B2
US 12,544,664 · App. 18/529,441 · Granted Feb 10, 2026

Multi-client context sharing for video streaming

Inventors: Aaron Michael Knoll (Millcreek, UT); Binh Huy Le (Santa Clara, CA); Madhusudhanan Srinivasan (Austin, TX); Mark Richard Nutter (Austin, TX)
Assignee: Advanced Micro Devices, Inc.
A63F13/52A63F13/355
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,544,664
App. No.
18/529,441
Granted
Feb 10, 2026
Kind
B2
Abstract

A server employs a shared raytracing context to generate video streams for multiple client devices. The server uses the shared raytracing context to perform raytracing operations for each of the client devices, and based on the raytracing operations generates different sets of image frames. The server then streams each set of image frames to a corresponding client device over a network.

Claims (43)

1 . A method comprising:

generating, based on a raytracing context, a first stream of frames for communication to a first client device; and

generating based on the raytracing context, a second stream of frames for communication to a second client device, different from the first client device.

2 . The method of claim 1 , wherein the raytracing context comprises a bounding volume hierarchy (BVH).

3 . The method of claim 2 , wherein:

generating the first stream of frames comprises traversing the BVH for the first client device; and

generating the second stream of frames comprises traversing the BVH for the second client device.

4 . The method of claim 3 , wherein:

traversing the BVH for the first client device comprises traversing the BVH based on first client state information associated with the first client device; and

traversing the BVH for the second client device comprises traversing the BVH based on second client state information associated with the second client device.

5 . The method of claim 1 , wherein the raytracing context comprises a scene graph.

6 . The method of claim 1 , wherein the raytracing context comprises a device driver.

7 . The method of claim 1 , wherein the raytracing context comprises at least one of geometry data and texture data.

8 . A processing unit, comprising:

a memory to store a raytracing context; and

a processor to:

generate, based on the raytracing context, a first stream of frames for communication to a first client device; and

generate based on the raytracing context, a second stream of frames for communication to a second client device, different from the first client device.

9 . The processing unit of claim 8 , wherein the raytracing context comprises a bounding volume hierarchy (BVH).

10 . The processing unit of claim 9 , wherein the processor is to:

generate the first stream of frames by traversing the BVH for the first client device; and

generate the second stream of frames by traversing the BVH for the second client device.

11 . The processing unit of claim 10 , wherein:

traversing the BVH for the first client device comprises traversing the BVH based on first client state information associated with the first client device; and

traversing the BVH for the second client device comprises traversing the BVH based on second client state information associated with the second client device.

12 . The processing unit of claim 8 , wherein the raytracing context comprises a scene graph.

13 . The processing unit of claim 8 , wherein the raytracing context comprises a device driver.

14 . The processing unit of claim 8 , wherein the raytracing context comprises at least one of geometry data and texture data.

15 . A processing system comprising:

a network interface to communicate with a first client device and a second client device via a network;

a memory to store a raytracing context; and

a processor to:

generate, based on the raytracing context, a first stream of frames for communication to the first client device; and

generate based on the raytracing context, a second stream of frames for communication to the second client device, different from the first client device.

16 . The processing system of claim 15 , wherein the raytracing context comprises a bounding volume hierarchy (BVH).

17 . The processing system of claim 16 , wherein the processor is to:

generate the first stream of frames by traversing the BVH for the first client device; and

generate the second stream of frames by traversing the BVH for the second client device.

18 . The processing system of claim 17 , wherein:

traversing the BVH for the first client device comprises traversing the BVH based on first client state information associated with the first client device; and

traversing the BVH for the second client device comprises traversing the BVH based on second client state information associated with the second client device.

19 . The processing system of claim 18 , wherein the raytracing context comprises a scene graph.

20 . The processing system of claim 18 , wherein the raytracing context comprises a device driver.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 14, 2024
From: KNOLL, AARON MICHAEL; LE, BINH HUY; SRINIVASAN, MADHUSUDHANAN; NUTTER, MARK RICHARD
To: ADVANCED MICRO DEVICES, INC.
Reel/Frame 066778/0029 →
Continuity (2)
Provisional Application 63530540 · Aug 3, 2023
Related Publication 20250041721A1 · Feb 6, 2025
References Cited (34)
US 11721064B1 · Aksoy · 2023 [cited by examiner]
US 11842223B2 · Chen · 2023 [cited by examiner]
US 11854141B2 · Muthler et al. · 2023 [cited by applicant]
US 20100309205A1 · Novosad · 2010 [cited by applicant]
US 20180139257A1 · Ninoles · 2018 [cited by examiner]
US 20210146240A1 · Colenbrander · 2021 [cited by examiner]
US 20210274347A1 · Dua · 2021 [cited by applicant]
US 20210362051A1 · Perry · 2021 [cited by examiner]
US 20220005256A1 · Hughes et al. · 2022 [cited by applicant]
US 20220138988A1 · Stengel et al. · 2022 [cited by applicant]
US 20220198739A1 · Saleh et al. · 2022 [cited by applicant]
US 20220254093A1 · Zheng et al. · 2022 [cited by applicant]
US 20220394072A1 · Aristarkhov · 2022 [cited by examiner]
US 20230169713A1 · Yoon et al. · 2023 [cited by applicant]
US 20230260195A1 · Wald · 2023 [cited by applicant]
US 20240390800A1 · Spratt · 2024 [cited by examiner]
EP 3833032B1 · 2025 [cited by applicant]
U.S. Appl. No. 18/751,915, filed Jun. 24, 2024, listing Aaron Michael Knoll et al. as inventor, entitled “Parallel Multi-Client Ray Tracing Task Processing”. [cited by applicant]
Van Antwerpen et al. “Improving SIMD efficiency for parallel Monte Carlo light transport on the GPU.” In Proceedings of the ACM SIGGRAPH Symposium on High Performance Graphics (HPG '11). Association for Computing Machin… [cited by applicant]
Clamchowder, “Shader Execution Reordering—NVIDIA tackles divergence,” Chips and Cheese, 2023, <https://chipsandcheese.com/2023/05/16/shader-execution-reordering-nvidia-tackles-divergence/>, Accessed Sep. 10, 2024, 16 pa… [cited by applicant]
NVIDIA, “NVIDIA Ada Lovelace Architecture” <https://www.nvidia.com/en-us/geforce/ada-lovelace-architecture/>, Accessed Sep. 10, 2024, 6 pages. [cited by applicant]
Laine et al., “Megakernels considered harmful: Wavefront path tracing on GPUs,” In Proceedings of the 5th High-Performance Graphics Conference Jul. 19, 2013 (pp. 137-143). 7 pages. doi:https://doi.org/10.1145/2492045.24… [cited by applicant]
Aila et al., “Understanding the Efficiency of Ray Traversal on GPUs,” HPG 2009 <https://research.nvidia.com/sites/default/files/pubs/2009-08_Understanding-the-Efficiency/aila2009hpg_paper.pdf>, Accessed Sep. 10, 2024, 5… [cited by applicant]
Fouladi et al., “R2E2: Low-Latency Path Tracing of Terabyte-Scale Scenes using Thousands of Cloud CPUs” ACM Trans. Graph., vol. 41, No. 4, Article 1, 2022, 14 pages. [cited by applicant]
Wald et al., “HPG 22, Data Parallel Path Tracing in Object Space” arXiv:2204.10170v1 [cs.GR], published Apr. 21, 2022, <arXiv:2204.10170v1>, Accessed Apr. 24, 2024, 8 pages. [cited by applicant]
Xie et al., “Real Time Cluster Path Tracing” arXiv:2110.08913v2 [cs.GR], published Oct. 21, 2021, <arXiv:2110.08913v2>, Accessed Apr. 24, 2024, 5 pages. [cited by applicant]
Jaros et al. “GPU Accelerated Path Tracing of Massive Scenes,” ACM Transactions on Graphics, vol. 40, No. 2, Article 16: 2021, 17 pages. [cited by applicant]
NVIDIA Corp., “NVIDIA Omniverse” <https://developer.nvidia.com/nvidia-omniverse-platform>, Accessed Apr. 24, 2024, 13 pages. [cited by applicant]
Amazon Inc., “Amazon Luna.” <https://www.amazon.com/luna/landing-page> Accessed Apr. 24, 2024, 7 pages. [cited by applicant]
Xbox Inc., “Xbox Cloud Gaming.” <https://www.xbox.com/en-us/play> Accessed Apr. 24, 2024, 3 pages. [cited by applicant]
AMD Inc., “AMD Radeon Pro Render.” <https://www.amd.com/en/technologies/radeon-prorender> Accessed Apr. 24, 2024, 18 pages. [cited by applicant]
AMD Inc., “AMD Advanced Media Framework SDK” <https://gpuopen.com/advanced-media-framework/> Accessed Apr. 24, 2024, 3 pages. [cited by applicant]
International Search Report and Written Opinion issued in Application No. PCT/US2024/039251, mailed Nov. 11, 2024, 9 pages. [cited by applicant]
International Search Report and Written Opinion mailed Oct. 27, 2025 for International Application No. PCT/US2025/034567, 11 pages. [cited by applicant]