IP Library Granted Patent US 12,236,539
Granted Patent B2
US 12,236,539 · App. 17/807,784 · Granted Feb 25, 2025

Contextual positioning in virtual space

Inventors: Martin G. Keen (Cary, NC); Jeremy R. Fox (Georgetown, TX); Alexander Reznicek (Troy, NY); Bahman Hekmatshoartabari (White Plains, NY)
Assignee: International Business Machines Corporation
G06T19/006G06F3/011G10L15/22G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,236,539
App. No.
17/807,784
Granted
Feb 25, 2025
Kind
B2
Abstract

Methods, systems, and a computer program product are disclosed. The first method includes obtaining virtual session data in real time, identifying a positional utterance in the virtual session data, and generating a positional insight for the positional utterance. The first method also includes generating a best-practices recommendation based on the positional insight. The second method includes obtaining virtual session data, identifying positional utterances in the virtual session data, and generating positional insights for each of the positional utterances. The second method also includes selecting each of the positional insights having confidence scores above a threshold score and generating best-practices recommendations based on the selected positional insights.

Claims (71)

1. A method, comprising:

obtaining virtual session data in real time from a virtual session in a virtual space, wherein the virtual session data comprises natural language utterances of users participating in the virtual session;

identifying a positional utterance in the natural language utterances;

generating a positional insight for the positional utterance, wherein the positional insight indicates an ideal location within the virtual space for an avatar representing a user from the users;

determining that the positional insight has a confidence score above a threshold score;

in response to the determining, selecting the positional insight;

in response to the selecting, generating a best-practices recommendation based on the positional insight;

in response to the best-practices recommendation, comparing a location of the avatar with the ideal location; and

based on the comparing, automatically modifying a positional rendering of the avatar.

2. The method of claim 1 , further comprising generating a report providing a best-practices recommendation for rendering the virtual space during an instructional session.

3. The method of claim 1 , wherein the positional insight is generated based on a contextual correlation between the positional utterance and contextual information about the virtual session.

4. The method of claim 1 , wherein the positional utterance is identified in real time by, using natural language understanding, detecting an utterance related to a location within the virtual space.

5. The method of claim 1 , further comprising adding the virtual session data to a corpus of historical virtual session data.

6. The method of claim 1 further comprising receiving user feedback in response to the best-practices recommendation.

7. The method of claim 1 , further comprising generating a best-practices recommendation for positioning user avatars in a virtual instruction session.

8. The method of claim 1 , further comprising generating a best-practices recommendation for positioning virtually rendered objects in a virtual instruction session.

9. The method of claim 1 , wherein the positional insight is generated using at least one correlation model, and wherein the method further comprises training the at least one correlation model, the training comprising:

obtaining a corpus of historical virtual session data comprising positional requests and contextual information extracted from speech data during at least one virtual session in the virtual space; and

deriving correlations between the contextual information and the positional requests.

10. The method of claim 9 , wherein the contextual information is defined based on common scenarios in virtual instructional sessions.

11. The method of claim 1 , wherein the identifying comprises:

detecting an utterance related to an activity; and

determining that the activity is correlated with a location within the virtual space.

12. A system, comprising:

a memory; and

a processor communicatively coupled to the memory, wherein the processor is configured to perform a method comprising:

obtaining virtual session data in real time from a virtual session in a virtual space, wherein the virtual session data comprises natural language utterances of users participating in the virtual session;

identifying a positional utterance in the natural language utterances;

generating a positional insight for the positional utterance, wherein the positional insight indicates an ideal location within the virtual space for an avatar representing a user from the users;

determining that the positional insight has a confidence score above a threshold score;

in response to the determining, selecting the positional insight;

in response to the selecting, generating at least one best-practices recommendation based on the positional insight;

in response to the at least one best-practices recommendation, comparing a location of the avatar with the ideal location; and

based on the comparing, automatically modifying a positional rendering of the avatar.

13. The system of claim 12 , further comprising, in response to the best-practices recommendation, generating a report providing a recommendation for rendering the virtual space during an instructional session.

14. The system of claim 12 , wherein the positional insight is generated based on a contextual correlation between the positional utterance and contextual information about the virtual space.

15. The system of claim 12 , wherein the positional utterance is identified in real time by, using natural language understanding, detecting an utterance related to a location within the virtual space.

16. The system of claim 12 , further comprising adding the virtual session data to a corpus of historical virtual session data.

17. The system of claim 12 , further comprising receiving user feedback in response to the best-practices recommendation.

18. The system of claim 12 , further comprising generating a best-practices recommendation for positioning user avatars in a virtual instruction session.

19. The system of claim 12 , further comprising generating a best-practices recommendation for positioning virtually rendered objects in a virtual instruction session.

20. A computer program product, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause a device to perform a method, the method comprising:

obtaining virtual session data in real time from a virtual session in a virtual space, wherein the virtual session data comprises natural language utterances of users participating in the virtual session;

identifying a positional utterance in the natural language utterances;

generating a positional insight for the positional utterance, wherein the positional insight indicates an ideal location within the virtual space for an avatar representing a user from the users based on a correlation between the positional utterance and contextual information about the virtual session;

determining that the positional insight has a confidence score above a threshold score;

in response to the determining, selecting the positional insight;

in response to the selecting, generating a best-practices recommendation based on the positional insight;

in response to the best-practices recommendation, comparing a location of the avatar with the ideal location; and

based on the comparing, automatically modifying a positional rendering of the avatar.

21. The computer program product of claim 20 , further comprising generating a report providing a best-practices recommendation for rendering the virtual space during an instructional session.

22. The computer program product of claim 20 , further comprising generating a best-practices recommendation for positioning user avatars in a virtual instruction session.

23. The computer program product of claim 20 , further comprising generating a best-practices recommendation for positioning virtually rendered objects in a virtual instruction session.

24. A method, comprising:

obtaining virtual session data from a virtual session in a virtual space, wherein the virtual session data comprises natural language utterances of users participating in the virtual session;

identifying positional utterances in the natural language utterances;

generating positional insights for each of the positional utterances, wherein the positional insights comprise an insight indicating an ideal location within the virtual space for an avatar representing a user from the users based on a correlation between the positional utterance and contextual information about the virtual session;

selecting each of the positional insights having confidence scores above a threshold score;

generating best-practices recommendations based on the selected positional insights;

in response to at least one of the best-practices recommendations, comparing a location of the avatar with the ideal location; and

based on the comparing, automatically modifying a positional rendering of the avatar.

25. A system, comprising:

a memory; and

a processor communicatively coupled to the memory, wherein the processor is configured to perform a method comprising:

obtaining virtual session data from a virtual session in a virtual space, wherein the virtual session data comprises natural language utterances of users participating in the virtual session;

identifying positional utterances in the natural language utterances;

generating positional insights for each of the positional utterances, wherein the positional insights comprise an insight indicating an ideal location within the virtual space for an avatar representing a user from the users based on a correlation between the positional utterance and contextual information about the virtual session;

selecting each of the positional insights having confidence scores above a threshold score;

generating best-practices recommendations based on the selected positional insights;

in response to at least one of the best-practices recommendations, comparing a location of the avatar with the ideal location; and

based on the comparing, automatically modifying a positional rendering of the avatar.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 20, 2022
From: KEEN, MARTIN G.; FOX, JEREMY R.; REZNICEK, ALEXANDER; HEKMATSHOARTABARI, BAHMAN
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 060250/0928 →
Continuity (1)
Related Publication 20230410435A1 · Dec 21, 2023
References Cited (44)
US 6772195B1 · Hatlelid et al. · 2004 [cited by applicant]
US 7775885B2 · Van Luchene · 2010 [cited by applicant]
US 8140340B2 · Bhogal · 2012 [cited by applicant]
US 8156184B2 · Kurata · 2012 [cited by applicant]
US 10986230B1 · Sethi · 2021 [cited by examiner]
US 20080229215A1 · Baron et al. · 2008 [cited by applicant]
US 20090063995A1 · Baron · 2009 [cited by examiner]
US 20090113314A1 · Dawson et al. · 2009 [cited by applicant]
US 20090210804A1 · Kurata · 2009 [cited by examiner]
US 20090288002A1 · Hamilton, II · 2009 [cited by examiner]
US 20090299988A1 · Hamilton, II et al. · 2009 [cited by applicant]
US 20100083138A1 · Dawson et al. · 2010 [cited by applicant]
US 20120131478A1 · Maor et al. · 2012 [cited by applicant]
US 20120162214A1 · Chavez · 2012 [cited by examiner]
US 20120270620A1 · Bhogal et al. · 2012 [cited by applicant]
US 20160350973A1 · Shapira · 2016 [cited by examiner]
US 20170103564A1 · Hayashida · 2017 [cited by examiner]
US 20180165862A1 · Sawaki · 2018 [cited by examiner]
US 20180165863A1 · Kubo · 2018 [cited by examiner]
US 20190098255A1 · Bergmann · 2019 [cited by examiner]
US 20190306483A1 · Ishikawa · 2019 [cited by examiner]
US 20190355281A1 · Abe · 2019 [cited by applicant]
US 20200118336A1 · Oyanagi · 2020 [cited by examiner]
US 20200128902A1 · Brown · 2020 [cited by applicant]
US 20210165825A1 · Tanaka · 2021 [cited by applicant]
US 20210256769A1 · St Clair · 2021 [cited by applicant]
US 20230186542A1 · Gotoh · 2023 [cited by examiner]
US 20230224667A1 · Rodman · 2023 [cited by applicant]
WO 2010057304A1 · 2010 [cited by applicant]
WO 2012088285A2 · 2012 [cited by applicant]
WO 2016191051A1 · 2016 [cited by applicant]
WO 2023247306A1 · 2023 [cited by applicant]
Everett et al., “A Natural Language Interface for Virtual Reality Systems,” https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.52.4330&rep=rep1&type=pdf, accessed May 27, 2022, 3 pgs. [cited by applicant]
IBM, “IBM Unveils z15 With Industry-First Data Privacy Capabilities,” https://newsroom.ibm.com/2019-09-12-IBM-Unveils-z15-With-Industry-First-Data-Privacy-Capabilities, Sep. 12, 2019, 8 pgs. [cited by applicant]
Keen et al., “Contextual Positioning in Virtual Space,” U.S. Appl. No. 17/807,793, filed Jun. 20, 2022. [cited by applicant]
Kuijk, F. “A Method for Autonomous Positioning Avatars in a Group,” 2017 International Conference on Cyberworlds (CW), pp. 178-181. IEEE, 2017. [cited by applicant]
List of IBM Patents or Patent Applications Treated as Related, Jun. 17, 2022, 2 pgs. [cited by applicant]
Mehdi et al., “An Interactive Speech Interface for Virutal Characters in Dynamic Environments,” https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.549.2736&rep=rep1&type=pdf. [cited by applicant]
Mell et al., “The NIST Definition of Cloud Computing,” Recommendations of the National Institute of Standards and Technology, U.S. Department of Commerce, Special Publication 800-145, Sep. 2011, 7 pgs. [cited by applicant]
Unknown, “Metaverse,” https://golden.com/wiki/Metaverse-PB9GNW, printed Jun. 20, 2022, 6 pgs. [cited by applicant]
Wikipedia, “Metaverse,” https://en.wikipedia.org/wiki/Metaverse, printed Jun. 20, 2022, 10 pgs. [cited by applicant]
Wikipedia, “Teleportation,” https://en.wikipedia.org/wiki/Teleportation, printed May 27, 2022, 4 pgs. [cited by applicant]
International Search Report and Written Opinion, date of mailing Sep. 14, 2023, Application No. EP2023/066068, 19 pages. [cited by applicant]
Anonymous, “Voice Avatars: The Sound of a New You”, VoiceMod, downloaded from the Wayback Machine Internet Archive from Apr. 9, 2022, 3 pages, <https://web.archive.org/web/20220409125245/https://www.voicemod.net/voice-a… [cited by applicant]