IP Library Granted Patent US 11,430,413
Granted Patent B2
US 11,430,413 · App. 17/079,632 · Granted Aug 30, 2022

Method, device, and computer program product for managing virtual visual content

Inventors: Zhen Jia (Shanghai, CN); Danqing Sha (Shanghai, CN); Bin He (Shanghai, CN); Xuwei Tang (Nanjing, CN)
Assignee: EMC IP Holding Company LLC
G09G5/37G06F3/012G06F3/013G06T7/194G06T7/20G06K9/6267G06T2207/20081G09G2320/0252G09G2320/043G09G2320/103G09G2320/106G09G2340/14G09G2350/00G09G2354/00G09G2370/022H04B1/3827H04L67/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,430,413
App. No.
17/079,632
Granted
Aug 30, 2022
Kind
B2
Abstract

Embodiments of the present disclosure relate to a method, a device, and a computer program product for managing virtual visual content. A method for managing virtual visual content is provided, which includes: determining a plurality of content portions from virtual visual content that is to be interacted with a user, the plurality of content portions having different change frequencies in the interaction; and transmitting, based on the change frequencies, the plurality of content portions to a plurality of computing devices having different proximities to the user, respectively. Through the embodiments of the present disclosure, the delay of a user interacting with virtual visual content can be reduced.

Claims (54)

1. A method for managing virtual visual content, comprising:

determining content portions from virtual visual content to be interacted with a user, the content portions having different change frequencies; and

transmitting content portions to respective computing devices, at least some of the computing devices having different proximities to the user;

wherein transmitting the content portions is determined based on at least the change frequencies of the virtual visual content and on proximities of the respective computing devices to the user; and

wherein transmitting the content portions to the respective computing devices comprises transmitting a first content portion in the content portions to a first computing device, and transmitting a second content portion in the content portions to a second computing device, the change frequency of the second content portion being higher than the change frequency of the first content portion, and the proximity of the second computing device to the user being relatively closer to the user than the proximity of the first computing device to the user.

2. The method according to claim 1 , wherein determining the content portions from the virtual visual content comprises:

determining a static content portion and a dynamic content portion from the virtual visual content, the change frequency of the dynamic content portion being higher than that of the static content portion.

3. The method according to claim 2 , wherein determining the static content portion and the dynamic content portion from the virtual visual content comprises:

determining the first content portion and the second content portion from the virtual visual content by applying at least one of background subtraction, motion detection, and object detection to the virtual visual content; and

determining the first content portion and the second content portion as the static content portion and the dynamic content portion, respectively.

4. The method according to claim 2 , wherein determining the content portions from the virtual visual content further comprises:

determining a first dynamic content portion and a second dynamic content portion from the dynamic content portion, the change frequency of the second dynamic content portion being higher than that of the first dynamic content portion.

5. The method according to claim 4 , wherein determining the first dynamic content portion and the second dynamic content portion from the dynamic content portion comprises:

determining change frequency statistics on the dynamic content portion; and

dividing the dynamic content portion into the first dynamic content portion and the second dynamic content portion based on the statistics.

6. The method according to claim 4 , wherein determining the first dynamic content portion and the second dynamic content portion from the dynamic content portion comprises:

obtaining a visual focus area of the user, the visual focus area being determined based on motion information of a time when the user interacts with historical visual content, the motion information being obtained from a viewing device worn by the user when viewing the historical visual content; and

determining a content portion corresponding to the visual focus area in the dynamic content portion as the second dynamic content portion.

7. The method according to claim 6 , wherein the motion information comprises at least one of the following: eyeball motion information and head motion information.

8. The method according to claim 1 , wherein the respective computing devices comprise at least one of the following: an augmented reality/virtual reality content viewing device, an edge server, and a cloud computing device.

9. An electronic device, comprising:

at least one processing unit; and

at least one memory coupled to the at least one processing unit and storing instructions configured to be executed by the at least one processing unit, wherein the instructions, when executed by the at least one processing unit, cause the device to perform actions comprising:

determining content portions from virtual visual content to be interacted with a user, the content portions having different change frequencies; and

transmitting the content portions to respective computing devices, at least some of the computing devices having different proximities to the user;

wherein transmitting the content portions is determined based on at least the change frequencies of the virtual visual content and on proximities of the respective computing devices to the user; and

wherein transmitting the content portions to the respective computing devices comprises transmitting a first content portion in the content portions to a first computing device, and transmitting a second content portion in the content portions to a second computing device, the change frequency of the second content portion being higher than the change frequency of the first content portion, and the proximity of the second computing device to the user being relatively closer to the user than the proximity of the first computing device to the user.

10. The device according to claim 9 , wherein determining the content portions from the virtual visual content comprises:

determining a static content portion and a dynamic content portion from the virtual visual content, the change frequency of the dynamic content portion being higher than that of the static content portion.

11. The device according to claim 10 , wherein determining the static content portion and the dynamic content portion from the virtual visual content comprises:

determining the first content portion and the second content portion from the virtual visual content by applying at least one of background subtraction, motion detection, and object detection to the virtual visual content; and

determining the first content portion and the second content portion as the static content portion and the dynamic content portion, respectively.

12. The device according to claim 10 , wherein determining the content portions from the virtual visual content further comprises:

determining a first dynamic content portion and a second dynamic content portion from the dynamic content portion, the change frequency of the second dynamic content portion being higher than that of the first dynamic content portion.

13. The device according to claim 12 , wherein determining the first dynamic content portion and the second dynamic content portion from the dynamic content portion comprises:

determining change frequency statistics on the dynamic content portion; and

dividing the dynamic content portion into the first dynamic content portion and the second dynamic content portion based on the statistics.

14. The device according to claim 12 , wherein determining the first dynamic content portion and the second dynamic content portion from the dynamic content portion comprises:

obtaining a visual focus area of the user, the visual focus area being determined based on motion information of a time when the user interacts with historical visual content, the motion information being obtained from a viewing device worn by the user when viewing the historical visual content; and

determining a content portion corresponding to the visual focus area in the dynamic content portion as the second dynamic content portion.

15. The device according to claim 14 , wherein the motion information comprises at least one of the following: eyeball motion information and head motion information.

16. The device according to claim 9 , wherein the respective computing devices comprise at least one of the following: an augmented reality/virtual reality content viewing device, an edge server, and a cloud computing device.

17. A computer program product tangibly stored in a non-transitory computer storage medium and comprising machine-executable instructions, wherein the machine-executable instructions, when executed by a device, cause the device to execute a method for managing virtual visual content, the method comprising:

determining content portions from virtual visual content to be interacted with a user, the content portions having different change frequencies; and

transmitting the content portions to respective computing devices, at least some of the computing devices having different proximities to the user;

wherein transmitting the content portions is determined based on at least the change frequencies of the virtual visual content and on proximities of the respective computing devices to the user; and

wherein transmitting the content portions to the respective computing devices comprises transmitting a first content portion in the content portions to a first computing device, and transmitting a second content portion in the content portions to a second computing device, the change frequency of the second content portion being higher than the change frequency of the first content portion, and the proximity of the second computing device to the user being relatively closer to the user than the proximity of the first computing device to the user.

18. The computer program product according to claim 17 , wherein determining the content portions from the virtual visual content comprises:

determining a static content portion and a dynamic content portion from the virtual visual content, the change frequency of the dynamic content portion being higher than that of the static content portion.

19. The computer program product according to claim 18 , wherein determining the static content portion and the dynamic content portion from the virtual visual content comprises:

determining the first content portion and the second content portion from the virtual visual content by applying at least one of background subtraction, motion detection, and object detection to the virtual visual content; and

determining the first content portion and the second content portion as the static content portion and the dynamic content portion, respectively.

20. The computer program product according to claim 18 , wherein determining the content portions from the virtual visual content further comprises:

determining a first dynamic content portion and a second dynamic content portion from the dynamic content portion, the change frequency of the second dynamic content portion being higher than that of the first dynamic content portion.

Assignments (9)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (054475/0523) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
Reel/Frame 060332/0664 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (054475/0434) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
Reel/Frame 060332/0740 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (054475/0609) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
Reel/Frame 062021/0570 →
RELEASE OF SECURITY INTEREST AT REEL 054591 FRAME 0471 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 058001/0463 →
SECURITY INTEREST Recorded Nov 18, 2020
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 054475/0609 →
SECURITY INTEREST Recorded Nov 18, 2020
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 054475/0434 →
SECURITY INTEREST Recorded Nov 18, 2020
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 054475/0523 →
SECURITY AGREEMENT Recorded Nov 13, 2020
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 054591/0471 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2020
From: JIA, ZHEN; SHA, DANQING; HE, BIN; TANG, XUWEI
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 054161/0968 →