IP Library › Granted Patent US 11,645,032
Granted Patent B1
US 11,645,032 · App. 17/932,020 · Granted May 9, 2023

Smart multi-screen wall arrangement in a virtual reality environment

Inventors: June-Ray Lin (Taipei, TW); Li Na Wang (Beijing, CN); Ju Ling Liu (Beijing, CN); Ye Chuan Wang (Beijing, CN); Nan Chen (Beijing, CN); Yu Zhu (Beijing, CN)
Assignee: International Business Machines Corporation
G06F3/1446G06F3/04815
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,645,032
App. No.
17/932,020
Granted
May 9, 2023
Kind
B1
Abstract

Embodiments of the invention are directed to a computer-implemented method of operating a multi-screen virtual reality environment. The computer-implemented method includes performing a wall arrangement and transmission (WA&T) protocol that includes receiving at a second module a function transmitted by a first module over a network to the second module. The second module and the function received over the network are used to generate priority data that identifies a priority of each of a plurality of individual video streams generated by a plurality of video sources. Based at least in part on the priority, the second module is used to generate reduced-size video streams that include selected ones of the plurality of individual video streams. The second module transmits the priority data and a multi-screen video stream that includes the reduced-size video streams and non-reduced-size video streams of the plurality of individual video streams.

Claims (81)

1. A computer-implemented method of operating a multi-screen virtual reality environment, the computer-implemented method comprising:

performing a wall arrangement and transmission (WA&T) protocol comprising:

receiving at a second module a function transmitted by a first module over a network to the second module;

using the second module and the function received over the network to generate priority data that identifies a priority of each of a plurality of individual video streams generated by a plurality of video sources;

based at least in part on the priority, using the second module to generate reduced-size video streams comprising selected ones of the plurality of individual video streams;

using the second module to transmit the priority data and a multi-screen video stream comprising:

the reduced-size video streams; and

non-reduced-size video streams of the plurality of individual video streams.

2. The computer-implemented method of claim 1 , wherein the first module is operable to:

responsive to receiving the priority data, generate a video screen arrangement from the multi-screen video stream; and

display the video screen arrangement on a user display.

3. The computer-implemented method of claim 2 , wherein the video screen arrangement comprises a central region of the display and peripheral regions of the display.

4. The computer-implemented method of claim 3 , wherein:

the central region is displayed at a first resolution; and

each of the peripheral regions is displayed at a reduced resolution that is less than the first resolution and based on a distance from the central region to one of the peripheral regions associated with the reduced resolution.

5. The computer-implemented method of claim 4 , wherein:

the first module is operable to make a determination that a user is devoting user attention to a first one of the peripheral regions; and

the WA&T protocol further comprises, based at least in part on the determination, using the second module to adjust a reduced resolution of the first one of the peripheral regions.

6. The computer-implemented method of claim 1 , wherein the WA&T protocol further comprises:

using the second module to generate updated priority data;

based at least in part on the updated priority data, using the second module to generate updated reduced-size video streams comprising updated selected ones of the plurality of individual video streams;

using the second module to transmit the updated priority data and an updated multi-screen video stream comprising:

the updated reduced-size video streams; and

updated non-reduced-size video streams of the plurality of individual video streams;

wherein the first module is operable to, responsive to receiving the updated priority data, generate an updated video screen arrangement from the updated multi-screen video stream.

7. The computer-implemented method of claim 1 , wherein:

the function comprises a pretrained machine learning model; and

functionality of the first module or the second module is performed at a cloud computing server.

8. A computer system comprising a processor communicatively coupled to a memory, wherein the processor performs processor operations comprising:

performing a wall arrangement and transmission (WA&T) protocol comprising:

receiving at a second module a function transmitted by a first module over a network to the second module;

using the second module and the function received over the network to generate priority data that identifies a priority of each of a plurality of individual video streams generated by a plurality of video sources;

based at least in part on the priority, using the second module to generate reduced-size video streams comprising selected ones of the plurality of individual video streams;

using the second module to transmit the priority data and a multi-screen video stream comprising:

the reduced-size video streams; and

non-reduced-size video streams of the plurality of individual video streams.

9. The computer system of claim 8 , wherein the first module is operable to:

responsive to receiving the priority data, generate a video screen arrangement from the multi-screen video stream; and

display the video screen arrangement on a user display.

10. The computer system of claim 9 , wherein the video screen arrangement comprises a central region of the display and peripheral regions of the display.

11. The computer system of claim 10 , wherein:

the central region is displayed at a first resolution; and

each of the peripheral regions is displayed at a reduced resolution that is less than the first resolution and based on a distance from the central region to one of the peripheral regions associated with the reduced resolution.

12. The computer system of claim 11 , wherein:

the first module is operable to make a determination that a user is devoting user attention to a first one of the peripheral regions; and

the WA&T protocol further comprises, based at least in part on the determination, using the second module to adjust a reduced resolution of the first one of the peripheral regions.

13. The computer system of claim 8 , wherein the WA&T protocol further comprises:

using the second module to generate updated priority data;

based at least in part on the updated priority data, using the second module to generate updated reduced-size video streams comprising updated selected ones of the plurality of individual video streams;

using the second module to transmit the updated priority data and an updated multi-screen video stream comprising:

the updated reduced-size video streams; and

updated non-reduced-size video streams of the plurality of individual video streams;

wherein the first module is operable to, responsive to receiving the updated priority data, generate an updated video screen arrangement from the updated multi-screen video stream.

14. The computer system of claim 8 , wherein:

the function comprises a pretrained machine learning model; and

functionality of the first module or the second module is performed at a cloud computing server.

15. A computer program product comprising a computer readable program stored on a computer readable storage medium, wherein the computer readable program, when executed on a processor system, causes the processor system to perform processor operations comprising:

performing a wall arrangement and transmission (WA&T) protocol comprising:

receiving at a second module a function transmitted by a first module over a network to the second module;

using the second module and the function received over the network to generate priority data that identifies a priority of each of a plurality of individual video streams generated by a plurality of video sources;

based at least in part on the priority, using the second module to generate reduced-size video streams comprising selected ones of the plurality of individual video streams;

using the second module to transmit the priority data and a multi-screen video stream comprising:

the reduced-size video streams; and

non-reduced-size video streams of the plurality of individual video streams.

16. The computer program product of claim 15 , wherein the first module is operable to:

responsive to receiving the priority data, generate a video screen arrangement from the multi-screen video stream; and

display the video screen arrangement on a user display.

17. The computer program product of claim 16 , wherein the video screen arrangement comprises a central region of the display and peripheral regions of the display.

18. The computer program product of claim 17 , wherein:

the central region is displayed at a first resolution; and

each of the peripheral regions is displayed at a reduced resolution that is less than the first resolution and based on a distance from the central region to one of the peripheral regions associated with the reduced resolution.

19. The computer program product of claim 18 , wherein: the WA&T protocol further comprises:

the first module is operable to make a determination that a user is devoting user attention to a first one of the peripheral regions; and

the WA&T protocol further comprises, based at least in part on the determination, using the second module to adjust a reduced resolution of the first one of the peripheral regions.

20. The computer program product of claim 15 , wherein the WA&T protocol further comprises:

using the second module to generate updated priority data;

based at least in part on the updated priority data, using the second module to generate updated reduced-size video streams comprising updated selected ones of the plurality of individual video streams; and

using the second module to transmit the updated priority data and an updated multi-screen video stream comprising:

the updated reduced-size video streams; and

updated non-reduced-size video streams of the plurality of individual video streams;

wherein the first module is operable to, responsive to receiving the updated priority data, generate an updated video screen arrangement from the updated multi-screen video stream.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 14, 2022
From: LIN, JUNE-RAY; WANG, LI NA; LIU, JU LING; WANG, YE CHUAN; CHEN, NAN; ZHU, YU
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 061091/0366 →
Cited By (1)
US 12,681,676