IP Library Granted Patent US 11,574,423
Granted Patent B2
US 11,574,423 · App. 17/589,875 · Granted Feb 7, 2023

Augmented reality (AR) object communication and interaction system and method

Inventors: Jane Dudley (San Antonio, TX); Michael Fredrick Hines (Savannah, GA); Maximiliano Knox Laguna (San Juan, PR)
Assignee: BOOMANITY CORP. A DELAWARE CORPORATION
G06T11/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,574,423
App. No.
17/589,875
Granted
Feb 7, 2023
Kind
B2
Abstract

An improved augmented reality object handling system, including: a display device; a camera functionally coupled to the display such that visual data from the camera is displayed on the display; an augmented reality object, including rendering data configured to provide instructions for displaying the AR object on the display; behavior instructions, the behavior instructions including interaction instructions for how the AR object interacts with visual data from the camera and/or other AR objects; and a characteristic interaction broker in communication with the AR object, wherein the interaction broker loads into memory interaction instructions from associated AR objects, tracks positions of associated AR objects, and triggers interactions based on loaded interaction instructions, characteristics, and tracked positions.

Claims (44)

1. An improved augmented reality object handling system, comprising:

a. a display device;

b. a camera functionally coupled to the display such that visual data from the camera is displayed on the display:

c. an augmented reality object (AR object), including:.

i. rendering data configured to provide instructions for displaying the AR object on the display; and

ii. behavior instructions, the behavior instructions including interaction instructions for how the AR object interacts with visual data from the camera and/or other AR objects; and

d. an interaction broker in communication with the AR object, wherein the interaction broker:

i. loads into memory interaction instructions from associated AR objects,

ii. tracks positions of associated AR objects, and

iii. triggers interactions based on loaded interaction instructions, characteristics, and tracked positions, wherein the interaction instructions reference specific characteristics that trigger particular interaction behaviors.

2. The improved augmented reality object handling system of claim 1 , wherein the interaction broker interprets visual data from the camera, thereby generating object-relevant visual data.

3. The improved augmented reality object handling system of claim 2 , wherein the object-relevant visual data is loaded from the camera to the interaction broker through a network.

4. The improved augmented reality object handling system of claim 1 , wherein the augmented reality object includes a set of characteristics readable by the characteristic interaction broker.

5. The improved augmented reality object handling system of claim 1 , wherein the interaction broker loads into memory the behavior instructions that are not characteristics or interaction instructions.

6. The improved augmented reality object handling system of claim 1 , wherein the augmented reality object includes a set of placement rules.

7. The improved augmented reality object handling system of claim 1 , wherein the interaction broker includes a query script which determines the order in whish interactions are triggered.

8. An improved augmented reality object handling system, comprising:

a. a display device,

b. a camera functionally coupled to the display such that visual data from the camera is displayed on the display;

c. an augmented reality object, including:

i. rendering data configured to provide instructions for displaying the AR object on the display; and

ii. behavior instructions, the behavior instructions including interaction instructions for how the AR object interacts with visual data from the camera and/or other AR objects; and

iii. a set of placement rules; and

d. an interaction broker in communication with the AR object, wherein the interaction broker includes a query script which determines the order in which interactions are triggered, and wherein the interaction broker:

i. loads into memory interaction instructions from associated AR objects,

ii. tracks positions of associated AR objects, and

iii. triggers interactions based on loaded interaction instructions, characteristics, and tracked positions.

9. The improved augmented reality object handling system of claim 8 , wherein the interaction broker loads visual data from the camera.

10. The improved augmented reality object handling system of claim 9 , wherein the visual data is loaded from the camera to the interaction broker through a network.

11. The improved augmented reality object handling system of claim 10 , wherein the augmented reality object includes a set of characteristics readable by the characteristic interaction broker.

12. The improved augmented reality object handling system of claim 11 , wherein the interaction broker loads into memory the behavior instructions.

13. The improved augmented reality object handling system of claim 11 , wherein the query script includes a concurrency algorithm that includes a set of interactions that are to be displayed as if occurring simultaneously.

14. The improved augmented reality object handling system of claim 13 , wherein the iinteraction instructions reference specific characteristics that trigger particular interaction behaviors.

15. A method for implementing AR content in a computerized system, comprising the steps of:

a. receiving visual data from a camera;

b. interpreting, the visual data by operation of a processor, thereby generating object-relevant visual data;

c. tracking the object relevant visual data on a display device by operation of an object recognition system;

d. receiving augmented reality object data, including rendering data and associated behavior instructions that include interaction instructions;

d. loading the augmented reality object data into an interaction broker;

e. resolving interactions by operation of the interaction broker; and

f. displaying resolved interactions on a display device in accordance with the rendering data,

g. displaying a pair of sequentially resolved interaction triggers as being simultaneous interactions.

16. The method of claim 15 , further including a step of organizing simultaneously triggered interactions based on order of interaction.

17. The method of claim 15 , wherein the steps of receiving the visual data and the augmented reality data are received over a network.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2022
From: DUDLEY, JANE; HINES, MICHAEL FREDRICK; LAGUNA, MAXIMILIANO KNOX
To: BOOMANITY CORP. A DELAWARE CORPORATION
Reel/Frame 058837/0555 →
Continuity (4)
Provisional Application 63143678 · Jan 29, 2021
Provisional Application 63191325 · May 20, 2021
Provisional Application 63223702 · Jul 20, 2021
Related Publication 20220245865A1 · Aug 4, 2022