IP Library › Granted Patent US 12705995
Granted Patent B1
US 12705995 · App. 18/788,542 · Granted Aug 11, 2026

Video conversion to extended reality (XR) instructions with haptic feedback

Inventors: Dustin Bowen Bitter (Lehi, UT); Timothy Blair Chalmers (San Antonio, TX); Megan Sarah Jennings (San Antonio, TX); Ric M. Peña (Boerne, TX); Nathan Lee Post (Rockport, TX); Rodney Tyrone Thomas (Cibolo, TX); Paula Ann Whittington (Helotes, TX)
Assignee: United Services Automobile Association (USAA)
G09B5/065G06F3/011G06F3/016G06T19/00G06T2210/32
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12705995
App. No.
18/788,542
Granted
Aug 11, 2026
Kind
B1
Abstract

A system and method for generating extended reality videos and using the extended reality videos to provide instructions for physical tasks is disclosed. Specifically, the embodiments allow a user to request extended reality guidance for a given physical task. The system and method retrieve corresponding guidance videos and convert the guidance videos into an extended reality format. The converted videos are provided to a user, and embodiments track the user's movements as the user performs the given physical task. The correctness of the tracked user movements is confirmed. Embodiments provide feedback to the user based on the confirmed correctness of the user movements. For example, the feedback may include at least one of visual feedback, auditory feedback, and haptic feedback, and the feedback may help the user correct incorrect movements.

Claims (30)

1 . A method of generating extended reality videos and using the extended reality videos to provide instructions for physical tasks, comprising:

receiving a request for extended reality guidance for a given physical task;

retrieving guidance videos showing how to perform the given physical task;

converting the guidance videos to an extended reality video;

processing the extended reality video to determine a set of instructions for performing the given physical task;

providing the extended reality video to a user;

tracking user movements while the user performs the given physical task;

confirming correctness of the user movements; and

providing feedback to the user based on the correctness of the user movements.

2 . The method of claim 1 , further comprising providing a visual indicator showing the user how to correct the user movement.

3 . The method of claim 1 , further comprising providing the determined set of instructions to the user while providing the extended reality video to the user.

4 . The method of claim 1 , wherein the set of instructions is determined based on analyzing an audio track corresponding to the extended reality video.

5 . The method of claim 1 , wherein the guidance videos are originally from a third-person perspective and are converted to a first-person perspective.

6 . The method of claim 1 , wherein the providing the extended reality video comprises displaying phantoms showing the user how to position the hands of the user.

7 . The method of claim 1 , wherein the providing feedback comprises at least one of providing visual feedback, auditory feedback, and haptic feedback.

8 . A system for generating extended reality videos and using the extended reality videos to provide instructions for physical tasks, comprising:

at least one processor, configured to:

receive a request for extended reality guidance for a given physical task;

retrieve guidance videos showing how to perform the given physical task;

convert the guidance videos to an extended reality video;

processing the extended reality video to determine a set of instructions for performing the given physical task;

provide the extended reality video to a user;

track user movements while the user performs the given physical task;

confirm that the user movements are incorrect; and

provide feedback to the user to help the user correct the user movements.

9 . The system of claim 8 , wherein the feedback is visual feedback including a visual indicator showing the user how to correct the user movement.

10 . The system of claim 9 , wherein the feedback is visual feedback including a movement of a phantom showing the user how to correct the user movement.

11 . The system of claim 8 , wherein the feedback is auditory feedback instructing the user how to correct the user movement.

12 . The system of claim 8 , wherein the feedback is haptic feedback instructing the user how to correct the user movement by providing a haptic reinforcer when the user movement is correct.

13 . The system of claim 8 , wherein the feedback is haptic feedback instructing the user how to correct the user movement by providing a haptic reinforcer when the user movement is incorrect.