IP Library Granted Patent US 11,922,694
Granted Patent B2
US 11,922,694 · App. 17/967,497 · Granted Mar 5, 2024

Systems and methods for augmented reality application for annotations and adding interfaces to control panels and screens

Inventors: Scott Carter (Menlo Park, CA); Laurent Denoue (Verona, IT)
Assignee: FUJIFILM Business Innovation Corp.
G06V20/20G06F3/011G06F3/017G06T7/74G06T15/205G06T19/006G06V20/635
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,922,694
App. No.
17/967,497
Granted
Mar 5, 2024
Kind
B2
Abstract

Example implementations described herein systems and method for providing a platform to facilitate augmented reality (AR) overlays, which can involve stabilizing video received from a first device for display on a second device and for input made to a portion of the stabilized video at the second device, generating an AR overlay on a display of the first device corresponding to the portion of the stabilized video.

Claims (54)

1. A method, comprising:

stabilizing video received from a first device for display on a second device;

for input made to a portion of the stabilized video at the second device, generating an augmented reality (AR) overlay on a display of the first device corresponding to the portion of the stabilized video, wherein a saved videoclip of the stabilized video contains the AR overlay,

wherein the AR overlay comprises instructions for actions to be performed on the first device, and

wherein stabilizing the video comprises identifying at least one anchor image in the video, determining an object of interest based on the at least one anchor image, and executing perspective correction on the video based on the object of interest.

2. The method of claim 1 , further comprising:

displaying the saved videoclip on a third device different from the first device and the second device.

3. The method of claim 2 , wherein the second device displays the saved videoclip as the saved videoclip is displayed on the third device.

4. The method of claim 1 , further comprising:

previewing the AR overlay before the AR overlay is deployed to the first device.

5. The method of claim 4 , wherein the generating the AR overlay on the display of the first device corresponding to the portion of the stabilized video comprises:

generating the AR overlay on the display of the second device in response to the input; and

for receipt of instructions to provide the AR overlay to the first device, transmitting the AR overlay to the first device for display.

6. The method of claim 1 , further comprising:

cropping the video to the object of interest for display on the second device.

7. The method of claim 1 , wherein the AR overlay further comprises dynamic overlays having a plurality of action steps for the actions to be performed on the first device.

8. A system, comprising:

a first device configured to stabilize video

at least one memory configured to store instructions; and

at least one processor coupled to the memory and configured the execute the instructions to:

stabilize video received from a first device for display on a second device;

for input made to a portion of the stabilized video at the second device, generate an augmented reality (AR) overlay on a display of the first device corresponding to the portion of the stabilized video, wherein a saved videoclip of the stabilized video contains the AR overlay,

wherein the AR overlay comprises instructions for actions to be performed on the first device, and

wherein stabilize the video comprises identify at least one anchor image in the video, determine an object of interest based on the at least one anchor image, and execute perspective correction on the video based on the object of interest.

9. The system of claim 8 , wherein the at least one processor is configured to:

display the saved videoclip on a third device different from the first device and the second device.

10. The system of claim 9 , wherein the second device displays the saved videoclip as the saved videoclip is displayed on the third device.

11. The system of claim 8 , wherein the at least one processor is configured to:

preview the AR overlay before the AR overlay is deployed to the first device.

12. The system of claim 11 , wherein to generate the AR overlay on the display of the first device corresponding to the portion of the stabilized video, the at least one processor is configured to:

generate the AR overlay on the display of the second device in response to the input; and

for receipt of instructions to provide the AR overlay to the first device, transmit the AR overlay to the first device for display.

13. The system of claim 8 , wherein the at least one processor is configured to:

crop the video to the object of interest for display on the second device.

14. The system of claim 8 , wherein the AR overlay further comprises dynamic overlays having a plurality of action steps for the actions to be performed on the first device.

15. An information processing apparatus, comprising:

at least one memory configured to store instructions; and

at least one processor coupled to the memory and configured the execute the instructions to:

stabilize video received from a first device for display on a second device;

for input made to a portion of the stabilized video at the second device, generate an augmented reality (AR) overlay on a display of the first device corresponding to the portion of the stabilized video, wherein a saved videoclip of the stabilized video contains the AR overlay,

wherein the AR overlay comprises instructions for actions to be performed on the first device, and

wherein stabilize the video comprises identify at least one anchor image in the video, determine an object of interest based on the at least one anchor image, and execute perspective correction on the video based on the object of interest.

16. The apparatus of claim 15 , wherein the at least one processor is configured to:

display the saved videoclip on a third device different from the first device and the second device.

17. The apparatus of claim 16 , wherein the second device displays the saved videoclip as the saved videoclip is displayed on the third device.

18. The apparatus of claim 15 , wherein the at least one processor is configured to:

preview the AR overlay before the AR overlay is deployed to the first device.

19. The apparatus of claim 18 , wherein to generate the AR overlay on the display of the first device corresponding to the portion of the stabilized video, the at least one

processor is configured to:

generate the AR overlay on the display of the second device in response to the input; and

for receipt of instructions to provide the AR overlay to the first device, transmit the AR overlay to the first device for display.

20. The apparatus of claim 15 , wherein the at least one processor is configured to:

crop the video to the object of interest for display on the second device.

21. The apparatus of claim 15 , wherein the AR overlay further comprises dynamic overlays having a plurality of action steps for the actions to be performed on the first device.

Assignments (2)
CHANGE OF NAME Recorded Jan 23, 2023
From: FUJI XEROX CO., LTD.
To: FUJIFILM BUSINESS INNOVATION CORP.
Reel/Frame 062462/0384 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 19, 2023
From: CARTER, SCOTT; DENOUE, LAURENT
To: FUJI XEROX CO., LTD.
Reel/Frame 062423/0273 →
Continuity (2)
Continuation 16786827 · Feb 10, 2020
Related Publication 20230139977A1 · May 4, 2023