IP Library Granted Patent US 12,518,436
Granted Patent B2
US 12,518,436 · App. 18/092,204 · Granted Jan 6, 2026

Augmented reality (AR) object communication and interaction system and method

Inventors: Jane Dudley (San Antonio, TX); Michael Fredrick Hines (Savannah, GA); Maximiliano Knox Laguna (San Juan, PR)
Assignee: BOOMANITY CORP.
G06T1/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,518,436
App. No.
18/092,204
Granted
Jan 6, 2026
Kind
B2
Abstract

An improved augmented reality object handling system, including: a display device; a camera functionally coupled to the display such that visual data from the camera is displayed on the display; an augmented reality object, including rendering data configured to provide instructions for displaying the AR of on the display; behavior instructions, the behavior instructions including interaction instructions for how the AR object interacts with visual data from the camera and/or other AR objects; and a characteristic interaction broker in communication with the AR object, wherein the interaction broker loads into memory interaction instructions from associated AR objects, tracks positions of associated AR objects, and triggers interactions based on loaded interaction instructions, characteristics, and tracked positions.

Claims (27)

1 . An improved augmented reality object handling system, comprising:

a. a display device;

b. a camera functionally coupled to the display such that visual data from the camera is displayed on the display;

c. an augmented reality object, including:

i. rendering data configured to provide instructions for displaying the AR object on the display; and

ii. behavior instructions, the behavior instructions including interaction instructions for how the AR object interacts with visual data from the camera and/or other AR objects;

d. an interaction broker in communication with the AR object, wherein the interaction broker includes a query script which determines the order in which interactions are triggered, wherein the query script includes a concurrency algorithm that includes a set of interactions that are to be displayed as if occurring simultaneously, and wherein the interaction broker:

i. loads into memory interaction instructions from associated AR objects,

ii. tracks positions of associated AR objects, and

iii. triggers interactions based on loaded interaction instructions, characteristics, and tracked positions.

2 . The improved augmented reality object handling system of claim 1 , wherein the interaction broker loads visual data from the camera.

3 . The improved augmented reality object handling system of claim 2 , wherein the visual data is loaded from the camera to the interaction broker through a network.

4 . The improved augmented reality object handling system of claim 3 , wherein the augmented reality object includes a set of characteristics readable by the characteristic interaction broker.

5 . The improved augmented reality object handling system of claim 4 , wherein the interaction broker loads into memory the behavior instructions.

6 . The improved augmented reality object handling system of claim 5 , wherein the augmented reality object includes a set of placement rules.

7 . The improved augmented reality object handling system of claim 6 , wherein the interaction instructions reference specific characteristics that trigger particular interaction behaviors.

8 . A method for implementing AR content in a computerized system, comprising the steps of:

a. receiving visual data from a camera;

b. interpreting the visual data by operation of a processor, thereby generating object-relevant visual data;

c. tracking the object relevant visual data on a display device by operation of an object recognition system;

d. receiving augmented reality object data, including rendering data and associated behavior instructions that include interaction instructions;

e. loading the augmented reality object data into an interaction broker;

f. resolving interactions by operation of the interaction broker;

g. displaying resolved interactions on a display device in accordance with the rendering data; and

h. organizing simultaneously triggered interactions based on order of interaction.

9 . The method of claim 8 , further including a step of displaying a pair of sequentially resolved interaction triggers as being simultaneous interactions.

10 . The method of claim 9 , wherein the steps of receiving the visual data and the augmented reality data are received over a network.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 31, 2022
From: DUDLEY, JANE; HINES, MICHAEL FREDRICK; LAGUNA, MAXIMILIANO KNOX
To: BOOMANITY CORP. A DELAWARE CORPORATION
Reel/Frame 062248/0457 →
Continuity (5)
Continuation 17589875 · Jan 31, 2022
Provisional Application 63223702 · Jul 20, 2021
Provisional Application 63191325 · May 20, 2021
Provisional Application 63143678 · Jan 29, 2021
Related Publication 20230154062A1 · May 18, 2023
References Cited (23)
US 8831255B2 · Crawford et al. · 2014 [cited by applicant]
US 9292085B2 · Bennett et al. · 2016 [cited by applicant]
US 9536352B2 · Anderson · 2017 [cited by applicant]
US 9952820B2 · Anderson et al. · 2018 [cited by applicant]
US 10008037B1 · Worley, III · 2018 [cited by examiner]
US 10062213B2 · Mount et al. · 2018 [cited by applicant]
US 10137374B2 · Miller et al. · 2018 [cited by applicant]
US 10140317B2 · McKinnon et al. · 2018 [cited by applicant]
US 10143925B2 · Middleton · 2018 [cited by applicant]
US 10719993B1 · Ha · 2020 [cited by applicant]
US 20120231887A1 · Lee et al. · 2012 [cited by applicant]
US 20130178257A1 · Langseth · 2013 [cited by applicant]
US 20130290876A1 · Anderson · 2013 [cited by examiner]
US 20170243403A1 · Daniels et al. · 2017 [cited by applicant]
US 20180157317A1 · Richter et al. · 2018 [cited by applicant]
US 20200183565A1 · Cronholm · 2020 [cited by applicant]
US 20200225757A1 · Schwarz · 2020 [cited by examiner]
US 20200302681A1 · Totty · 2020 [cited by examiner]
US 20200327047A1 · Mayhew · 2020 [cited by examiner]
WO 2010079876A1 · 2010 [cited by applicant]
AR Enabled IoT for a Smart and Interactive Environment: A Survey and Future Directions—https://www.mdpi.com/1424-8220/19/19/4330/htm. [cited by applicant]
Augmented Reality Agents with Pervasive Awareness, Appearance, and Abilities (ARA)—https://sreal.ucf.edu/projects/ara/. [cited by applicant]
Towards Pervasive Augmented Reality: Context-Awareness in Augmented Reality—https://ieeexplore.ieee.org/document/7435333. [cited by applicant]