IP Library Granted Patent US 12,026,806
Granted Patent B2
US 12,026,806 · App. 18/359,394 · Granted Jul 2, 2024

Systems and methods for utilizing a living entity as a marker for augmented reality content

Inventor: Nicholas T. Hariton (Trabuco Canyon, CA)
G06T11/00G06T7/74G06T11/60G06T13/80G06T19/00G06T19/006G06V10/225G06V20/20G06V40/103G06V40/18G06T2207/30196G06T2207/30204G06V10/143G10L17/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,026,806
App. No.
18/359,394
Granted
Jul 2, 2024
Kind
B2
Abstract

Systems and methods for utilizing living entities as markers for virtual content in an augmented reality environment are discussed herein. The virtual content may comprise objects, surfaces, textures, effects, and/or other content visibly manifested in views of the augmented reality environment. In some implementations, the virtual content may comprise an avatar and/or other full- or partial-body virtual content object depicted based on the living entity. A living entity and multiple linkage points for the living entity may be detected within the field of view of a user. Based on the arrangement of the linkage points, virtual content may be rendered and appear superimposed over or in conjunction with a view of the living entity in the augmented reality environment. In some implementations, the rendering of virtual content in the augmented reality environment may be triggered by the arrangement of the multiple linkage points for a given living entity.

Claims (39)

1. A system configured to utilize living entities as markers for virtual content viewed in an augmented reality environment, the system comprising:

a display device configured to superimpose images of visual virtual content over a real-world view of a user to create a visual effect of the augmented reality environment being present in a real world, wherein the real-world view of the user is an outlook of the real world from the point of view of the user;

electronic storage that stores information related to the visual virtual content;

one or more physical computer processors configured by computer-readable instructions to:

receive user input, via a user interface, that includes virtual content information that define individual virtual content items, wherein the virtual content information defines one or more colors, a shape, one or more sounds, a size, and/or a position for the individual virtual content items;

store the virtual content information in the electronic storage;

obtain an image of a field of view of the real-world view of the user visible via the display device, wherein the field of view is the area that comprises the real-world view of the user;

receive signals from transponders of living entities within the field of view, wherein the signals from the transponders indicate locations of the transponders and includes triggering information that causes images of virtual content items to be rendered in the augmented reality environment based on the living entities;

detect multiple linkage points for the living entities based on the transponders, wherein the signals from the transponders define positions of the multiple linkage points with respect to the living entities that correlate to specific portions of the virtual content items;

obtain the virtual content information from the electronic storage based on the triggering information;

generate images of the virtual content items to be displayed in the augmented reality environment based on the transponders of the living entities, wherein the images of the virtual content items are generated based on at least on the virtual content information and the field of view; and

cause the images of the virtual content items to be displayed in the augmented reality environment so that the images of the virtual content items are superimposed over the living entities in the real-world view of the user such that the user views the images of the virtual content items in the augmented reality environment via the display device.

2. The system of claim 1 , wherein the triggering information includes actions that prompt the virtual content items to be rendered, and wherein the one or more processors are further configured to:

identify actions of the living entities based on the signals from the transponders, wherein obtaining the virtual content information from the electronic storage is based on identification of the actions.

3. The system of claim 2 , wherein the virtual content items comprise an animation associated with the actions.

4. The system of claim 1 , wherein the positions of each of the multiple linkage points in the real world defines the reference frame of the virtual content items with respect to the real world and the living entities.

5. The system of claim 1 , wherein the images of the virtual content items are generated based further on a position of the display device in the real world and the position of each of the multiple linkage points in the real world.

6. The system of claim 1 , wherein the images of the virtual content items are generated based further on a size of an arrangement of the multiple linkage points within the field of view of the user.

7. The system of claim 1 , wherein the field of view is defined based on location information and orientation information, the location information indicating at least a current location associated with the display device, and the orientation information indicating at least a pitch angle, a roll angle, and a yaw angle associated with the display device.

8. The system of claim 1 , wherein the one or more processors are further configured to:

obtain audio information indicating the presence of the living entities within a proximity of the user to facilitate detecting the living entities and receiving the signals of the transponders, wherein the audio information comprises a sound that is associated with the living entities.

9. A method of utilizing living entities as markers for virtual content viewed in an augmented reality environment, the method comprising:

receiving user input, via a user interface, that includes virtual content information that define individual virtual content items, wherein the virtual content information defines one or more colors, a shape, one or more sounds, a size, and/or a position for the individual virtual content items;

storing the virtual content information in electronic storage;

obtaining an image of a field of view of a real-world view of a user that is visible via a display device, wherein the display device is configured to superimpose images of visual virtual content over the real-world view of the user to create a visual effect of the augmented reality environment being present in a real world, wherein the real-world view of the user is an outlook of the real world from the point of view of the user, wherein the field of view is the area that comprises the real-world view of the user;

receiving signals from transponders of living entities within the field of view, wherein the signals from the transponders indicate locations of the transponders and includes triggering information that causes images of virtual content items to be rendered in the augmented reality environment based on the living entities;

detecting multiple linkage points for the living entities based on the transponders, wherein the signals from the transponders define positions of the multiple linkage points with respect to the living entities that correlate to specific portions of the virtual content items;

obtaining the virtual content information from the electronic storage based on the triggering information;

generating images of the visual virtual content items to be displayed in the augmented reality environment based on the transponders of the living entities, wherein the images of the virtual content items are generated based on at least on the virtual content information and the field of view; and

causing the images of the virtual content items to be displayed in the augmented reality environment so that the images of the virtual content items are superimposed over the living entities in the real-world view of the user such that the user views the images of the virtual content items in the augmented reality environment via the display device.

10. The method of claim 9 , wherein the triggering information includes actions that prompt the virtual content items to be rendered, the method further comprising:

identifying actions of the living entities based on signals from the transponders, wherein obtaining the virtual content information from the electronic storage is based on identification of the actions.

11. The method of claim 10 , wherein the virtual content items comprise an animation associated with the actions.

12. The method of claim 9 , wherein the positions of each of the multiple linkage points in the real world defines the reference frame of the virtual content items with respect to the real world and the living entities.

13. The method of claim 9 , wherein the images of the virtual content items are generated based further on a position of the display device in the real world and the position of each of the multiple linkage points in the real world.

14. The method of claim 9 , wherein the images of the virtual content items are generated based further on a size of an arrangement of the multiple linkage points within the field of view of the user.

15. The method of claim 9 , wherein the field of view is defined based on location information and orientation information, the location information indicating at least a current location associated with the display device, and the orientation information indicating at least a pitch angle, a roll angle, and a yaw angle associated with the display device.

16. The method of claim 9 , further comprising:

obtaining audio information indicating the presence of the living entities within a proximity of the user to facilitate detecting the living entities and receiving the signals of the transponders, wherein the audio information comprises a sound that is associated with the living entities.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 23, 2026
From: HARITON, NICHOLAS T.
To: AR2 PROJECT, LLC
Reel/Frame 073558/0362 →
Continuity (5)
Continuation 17461657 · Aug 30, 2021
Continuation 17062227 · Oct 2, 2020
Continuation 16835242 · Mar 30, 2020
Continuation 15893498 · Feb 9, 2018
Related Publication 20230368433A1 · Nov 16, 2023