IP Library Granted Patent US 11,579,691
Granted Patent B2
US 11,579,691 · App. 17/329,248 · Granted Feb 14, 2023

Mid-air volumetric visualization movement compensation

Inventors: Mauro Marzorati (Lutz, FL); Gary Francis Diamanti (Wake Forest, NC); Jeremy R. Fox (Georgetown, TX); Sarbajit K. Rakshit (Kolkata, IN)
Assignee: KYNDRYL, INC.
G06F3/013G02B30/50G06F3/0485G06F3/04815G06F3/04845G04G9/007G04G21/02G06F2203/04806G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,579,691
App. No.
17/329,248
Granted
Feb 14, 2023
Kind
B2
Abstract

A wearable computing device generates a volumetric visualization at a first position that is located in a three-dimensional space. The wearable computing device includes a volumetric source configured to create the volumetric visualization. The wearable computing device includes one or more sensors configured to determine movement of the wearable computing device. A movement of the wearable computing device is identified by the wearable computing device. Based on the movement the wearable computing device adjusts the volumetric source.

Claims (66)

1. A method comprising:

generating, by a wearable computing device, a rotatable volumetric visualization at a first position that is located in a three-dimensional space in mid-air, wherein the wearable computing device includes at least one volumetric source configured to create the volumetric visualization,

wherein the wearable computing device includes one or more sensors configured to determine movement of the wearable computing device;

identifying, by a machine learning model for volumetric visualization movement compensation communicatively coupled to the wearable computing device, a movement of the wearable computing device;

determining an intent of the identified movement by the machine learning model; and

adjusting, by the wearable computing device based on the identified movement and the intent of the identified movement, the at least one volumetric source.

2. The method of claim 1 , wherein the volumetric source is configured to trace a path during the creation of the volumetric visualization during a period of time, and wherein the adjusting the at least one volumetric source includes:

adjusting, by the wearable computing device and during the period of time, the path of the at least one volumetric source.

3. The method of claim 1 , wherein the wearable device is worn by a user, and wherein the movement includes the user moving.

4. The method of claim 3 , wherein the method comprises:

identifying, based on the machine learning model, a predetermined movement pattern of the user; and

adjusting, based on the predetermined movement pattern, the at least one volumetric source of the wearable computing device to create the volumetric visualization.

5. The method of claim 4 , wherein the method further comprises:

training, based on a movement corpus, the machine learning model

wherein the movement corpus includes movements of users having a similar status to the user, and

wherein the movement corpus includes previous movements of the user.

6. The method of claim 1 , wherein the movement is a rotation of the wearable device.

7. The method of claim 6 , wherein the adjusting the at least one volumetric source includes changing the angle of the at least one volumetric source during a rendering of the volumetric visualization.

8. The method of claim 1 , wherein:

the wearable device includes a plurality of volumetric sources disposed on an outer surface of the wearable device,

wherein a first volumetric source of the plurality of volumetric sources is one of the at least one volumetric source, and

the method further comprises:

identifying a render path of the volumetric visualization, wherein the render path begins at the wearable device, and wherein the render path extends through the three-dimensional space to the first position;

determining an obstruction in the render path, the obstruction between the first volumetric source and the first position; and

selecting, based on the obstruction and based on a current placement of the wearable computing device, a second volumetric source of the plurality of volumetric sources for generating the volumetric visualization.

9. The method of claim 1 , wherein the wearable computing device includes an optical sensor configured to determine a gaze of one or more users; and

wherein the method further comprises:

detecting, by the wearable computing device and based on the optical sensor, a first gaze of a first user;

determining, by the wearable computing device, the first gaze is the first user looking at one of the at least one the volumetric source; and

terminating, by the wearable computing device, the generating of the volumetric visualization.

10. The method of claim 1 , wherein the method further comprises:

determining the movement of the wearable computing device is an unintentional movement of a user that wears the wearable computing device, and

wherein the adjusting the at least one volumetric source includes adjusting the at least one volumetric source such that the volumetric visualization appears fixed in the three- dimensional space.

11. The method of claim 1 , wherein the method further comprises:

determining the movement of the wearable computing device is an intentional movement of a user that wears the wearable computing device, and

wherein the adjusting the at least one volumetric source is such that the appearance of the volumetric visualization from a perspective of the user is selected from the group consisting of panning, tilting, rotating, zooming, and scrolling in the three-dimensional space.

12. The method of claim 11 , wherein the determining the movement is an intentional movement is based on a deviation from a predetermined threshold of one or more characteristics of the user.

13. The method of claim 1 , further comprising:

inspecting by the wearable computing device a content of a user of the wearable computing device before the content is rendered in a mid-air volumetric visualization;

recognizing, by the machine learning model, a privacy level of the content; and

omitting the content from the mid-air volumetric visualization when the privacy level of the content exceeds a predetermined threshold.

14. The method of claim 13 , wherein the machine learning model is configured with a semi-supervised learning technique where the user pre-identifies privacy levels for information types.

15. A system, the system comprising:

a memory, the memory containing one or more instructions; and

a processor, the processor communicatively coupled to the memory, the processor, in response to reading the one or more instructions, configured to:

generate, by a wearable computing device, a rotatable volumetric visualization at a first position that is located in a three-dimensional space in mid-air, wherein the wearable computing device includes a volumetric source configured to create the volumetric visualization,

wherein, the wearable computing device, includes one or more sensors configured to determine movement of the wearable computing device;

identify, by a machine learning model for volumetric visualization movement compensation communicatively coupled to the wearable computing device, a movement of the wearable computing device;

determine an intent of the identified movement by the machine learning model; and

adjust, by the wearable computing device based on the identified movement and the intent of the identified movement, the volumetric source.

16. The system of claim 15 , wherein the wearable device is worn by a user, and wherein the movement includes the user moving.

17. The system of claim 16 , wherein the processor is further configured to:

identify, based on the machine learning model, a predetermined movement pattern of the user; and

adjust, based on the predetermined movement pattern, the volumetric source of the wearable computing device to create the volumetric visualization.

18. A computer program product, the computer program product comprising:

one or more computer readable storage media; and

program instructions collectively stored on the one or more computer readable storage media, the program instructions configured to:

generate, by a wearable computing device, a rotatable volumetric visualization at a first position that is located in a three-dimensional space in mid-air, wherein the wearable computing device includes a volumetric source configured to create the volumetric visualization,

wherein, the wearable computing device, includes one or more sensors configured to determine movement of the wearable computing device;

identify, by a machine learning model for volumetric movement compensation communicatively coupled to the wearable computing device, a movement of the wearable computing device;

determine an intent of the identified movement by the machine learning model; and

adjust, by the wearable computing device based on the identified movement and the intent of the identified movement, the volumetric source.

19. The computer program product of claim 18 , wherein the wearable device is worn by a user, and wherein the movement includes the user moving.

20. The computer program product of claim 19 , wherein the program instructions are further configured to:

identify, based on the machine learning model, a predetermined movement pattern of the user; and

adjust, based on the predetermined movement pattern, the volumetric source of the wearable computing device to create the volumetric visualization.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2021
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: KYNDRYL, INC.
Reel/Frame 058213/0912 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 25, 2021
From: MARZORATI, MAURO; DIAMANTI, GARY FRANCIS; FOX, JEREMY R.; RAKSHIT, SARBAJIT K.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 056338/0465 →