IP Library Granted Patent US 11,277,655
Granted Patent B2
US 11,277,655 · App. 17/302,608 · Granted Mar 15, 2022

Recording remote expert sessions

Inventor: Brian Mullins (Altadena, CA)
Assignee: RPX Corporation
H04N21/4302H04N21/242H04N21/4223H04N21/6106H04N21/816
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,277,655
App. No.
17/302,608
Granted
Mar 15, 2022
Kind
B2
Abstract

A server receives, from a first display device of a first user, first content data, first sensor data, and a request for assistance identifying a context of the first display device. The server identifies a second display device of a second user based on the context of the first display device. The server receives second content data and second sensor data from the second display device. The first content data is synchronized with the second content data based on the first and second sensor data. Playback parameters are formed based on the context of the first display device. An enhanced playback session is generated using the synchronized first and second content data in response to determining that the first sensor data meet the playback parameters. The enhanced playback session is communicated to the first display device.

Claims (50)

1. A method comprising:

receiving, from a client device, data identifying a task and indicating an orientation of a client device in relation to a physical object;

determining, based on the orientation of the client device and the task, that a set of playback parameters have been satisfied;

in response to determining that the set of playback parameters have been satisfied, generating a playback session based on enhanced content data associated with the set of playback parameters, the enhanced content data including content generated by a first client device that is modified based on annotations received from a second client device, the annotations describing performance of the task in relation to the physical object; and

communicating the playback session to the client device.

2. The method of claim 1 , further comprising:

receiving the content from the first client device, the content being associated with performance of the task in relation to the physical object;

providing the content to a second device;

receiving, from the second client device, the annotations describing performance of the task in relation to the physical object; and

forming the set of playback parameters based on an orientation of the first client device in relation to the physical object.

3. The method of claim 1 , wherein the content includes sensor data and a request for assistance performing the task, wherein the second client device is identified based on the request for assistance.

4. The method of claim 3 , wherein the annotations received from the second client device includes second sensor data describing modifications to the content.

5. The method of claim 1 , wherein the content generated by the first client device comprises at least one of video data, image data, audio data, graphic data, and three-dimensional model data.

6. The method of claim 1 , wherein the annotations received from the second client device comprises at least one of video data, image data, audio data, graphic data, three-dimensional model data.

7. The method of claim 1 , wherein the set of playback parameters comprise at least one of a location parameter, a user parameter, and a task parameter.

8. The method of claim 1 , wherein the playback session comprises a video recording synchronized to a context of the client device, or an augmented reality content synchronized to the context of the client device.

9. The method of claim 1 , further comprising:

contacting the second client device in response to determining that the set of playback parameters have been satisfied; and

enabling the client device to communicate with the second client device.

10. A system comprising:

one or more computer processors; and

one or more computer-readable mediums storing instructions that, when executed by the one or more computer processors, cause the system to perform operations comprising:

receiving, from a client device, data identifying a task and indicating an orientation of a client device in relation to a physical object;

determining, based on the orientation of the client device and the task, that a set of playback parameters have been satisfied;

in response to determining that the set of playback parameters have been satisfied, generating a playback session based on enhanced content data associated with the set of playback parameters, the enhanced content data including content generated by a first client device that is modified based on annotations received from a second client device, the annotations describing performance of the task in relation to the physical object; and

communicating the playback session to the client device.

11. The system of claim 10 , the operations further comprising:

receiving the content from the first client device, the content being associated with performance of the task in relation to the physical object;

providing the content to a second device;

receiving, from the second client device, the annotations describing performance of the task in relation to the physical object; and

forming the set of playback parameters based on an orientation of the first client device in relation to the physical object.

12. The system of claim 10 , wherein the content includes sensor data and a request for assistance performing the task, wherein the second client device is identified based on the request for assistance.

13. The system of claim 12 , wherein the annotations received from the second client device includes second sensor data describing modifications to the content.

14. The system of claim 10 , wherein the content generated by the first client device comprises at least one of video data, image data, audio data, graphic data, and three-dimensional model data.

15. The system of claim 10 , wherein the annotations received from the second client device comprises at least one of video data, image data, audio data, graphic data, three-dimensional model data.

16. The system of claim 10 , wherein the set of playback parameters comprise at least one of a location parameter, a user parameter, and a task parameter.

17. The system of claim 10 , wherein the playback session comprises a video recording synchronized to a context of the client device, or an augmented reality content synchronized to the context of the client device.

18. The system of claim 10 , the operations further comprising:

contacting the second client device in response to determining that the set of playback parameters have been satisfied; and

enabling the client device to communicate with the second client device.

19. A non-transitory computer-readable medium storing instructions that, when executed by one or more computer processors of one or more computing devices, cause the one or more computing devices to perform operations comprising:

receiving, from a client device, data identifying a task and indicating an orientation of a client device in relation to a physical object;

determining, based on the orientation of the client device and the task, that a set of playback parameters have been satisfied;

in response to determining that the set of playback parameters have been satisfied, generating a playback session based on enhanced content data associated with the set of playback parameters, the enhanced content data including content generated by a first client device that is modified based on annotations received from a second client device, the annotations describing performance of the task in relation to the physical object; and

communicating the playback session to the client device.

20. The non-transitory computer-readable medium of claim 19 , the operations further comprising:

receiving the content from the first client device, the content being associated with performance of the task in relation to the physical object;

providing the content to a second device;

receiving, from the second client device, the annotations describing performance of the task in relation to the physical object; and

forming the set of playback parameters based on an orientation of the first client device in relation to the physical object.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 25, 2021
From: DAQRI, LLC
To: RPX CORPORATION
Reel/Frame 056680/0822 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 24, 2021
From: MULLINS, BRIAN
To: DAQRI, LLC
Reel/Frame 056660/0603 →
Continuity (4)
Continuation 16222275 · Dec 17, 2018
Continuation 15468476 · Mar 24, 2017
Provisional Application 62312823 · Mar 24, 2016
Related Publication 20210266628A1 · Aug 26, 2021