Granted Patent B2

US 12,602,107 · App. 18/199,492 · Granted Apr 14, 2026

Inventor: Spandana Govindgari (East Windsor Township, NJ)

Assignee: HYPE AR, INC.

G06F3/013G06F3/017G06Q30/0267G06Q30/0277G06V40/174G06V40/20

Abstract

Claims (50)

1 . A system for delivering tailored visual content in an augmented reality environment, the system comprising:

at least one network communication interface;

at least one processing device; and

at least one non-transitory storage device with computer-readable program code stored thereon and accessible by the at least one processing device, wherein the computer-readable code when executed is configured to cause the at least one processing device to:

determine that a user is accessing an augmented reality application, via a user device;

transmit a first set of control signals to cause one or more components of the user device to capture real-time environment data associated with a real-time environment of the user;

identify from the real-time environment data output by the one or more components of the user device, via neural network models, one or more bodily features of the user captured by the one or more components of the user device;

generate tailored visual content corresponding to the one or more bodily features captured by the one or more components of the user device, wherein the tailored visual content is (i) application specific visual content generated based on a type of the augmented reality application used to access an augmented reality environment, wherein the type of the augmented reality application is determined based on type of products provided by the augmented reality application and (ii) bodily-feature-specific visual content related to the one or more bodily features, wherein the bodily-feature-specific visual content is generated based on an identified type of the one or more bodily features;

calculate positional coordinates of the one or more bodily features that are related to the tailored visual content on a display of the user device for outputting the tailored visual content onto the one or more bodily features on the display of the user device;

transmit the tailored visual content and the calculated positional coordinates for outputting the tailored visual content to the user device in the calculated positional coordinates; and

transmit a second set of control signals to cause the user device to output, via the augmented reality application, the tailored visual content associated with the one or more bodily features of the user in an augmented reality environment of the user by placing the tailored visual content in the calculated positional coordinates on the display of the user device.

2 . The system of claim 1 , wherein the non-transitory storage device further comprises computer-readable program code configured to cause the at least one processing device to identify the one or more bodily features based on:

generating, via the neural network models, a mesh associated with the one or more bodily features of the user captured by the one or more components of the user device, wherein the mesh comprises one or more segments; and

determining, via the neural network models, a type of the one or more bodily features captured by the one or more components of the user device based on the generated mesh.

3 . The system of claim 2 , wherein the non-transitory storage device further comprises computer-readable program code configured to cause the at least one processing device to calculate the positional coordinates of the one or more segments of the mesh associated with the one or more bodily features on a display of the user device for outputting the tailored visual content associated with the one or more bodily features.

4 . The system of claim 3 , wherein the non-transitory storage device further comprises computer-readable program code configured to cause the at least one processing device to alter the tailored visual content based on the calculated positional coordinates to overlap the one or more bodily features.

5 . The system of claim 1 , wherein the non-transitory storage device further comprises computer-readable program code configured to cause the at least one processing device to generate the tailored visual content based on one or more factors comprising at least one of user preferences, historical data, and user profile.

6 . The system of claim 1 , wherein the one or more components used to capture the real-time environment data comprise at least a front facing camera.

7 . The system of claim 1 , wherein the tailored visual content is interstitial visual content.

8 . A computer program product for delivering tailored visual content in an augmented reality environment, the computer program product comprising a non-transitory computer-readable storage medium comprising computer executable instructions for causing a computer processor to perform the steps of:

determining that a user is accessing an augmented reality application, via a user device;

transmitting a first set of control signals to cause one or more components of the user device to capture real-time environment data associated with a real-time environment of the user;

identifying from the real-time environment data output by the one or more components of the user device, via neural network models, one or more bodily features of the user captured by the one or more components of the user device;

generating tailored visual content corresponding to the one or more bodily features captured by the one or more components of the user device, wherein the tailored visual content is (i) application specific visual content generated based on a type of the augmented reality application used to access an augmented reality environment, wherein the type of the augmented reality application is determined based on type of products provided by the augmented reality application and (ii) bodily-feature-specific visual content related to the one or more bodily features, wherein the bodily-feature-specific visual content is generated based on an identified type of the one or more bodily features;

calculating positional coordinates of the one or more bodily features that are related to the tailored visual content on a display of the user device for outputting the tailored visual content onto the one or more bodily features on the display of the user device;

transmitting the tailored visual content and the calculated positional coordinates for outputting the tailored visual content to the user device in the calculated positional coordinates; and

transmitting a second set of control signals to cause the user device to output, via the augmented reality application, the tailored visual content associated with the one or more bodily features of the user in an augmented reality environment of the user by placing the tailored visual content in the calculated positional coordinates on the display of the user device.

9 . The computer program product of claim 8 , wherein identifying the one or more bodily features comprises:

generating, via the neural network models, a mesh associated with the one or more bodily features of the user captured by the one or more components of the user device, wherein the mesh comprises one or more segments; and

determining, via the neural network models, a type of the one or more bodily features captured by the one or more components of the user device based on the generated mesh.

10 . The computer program product of claim 9 , wherein the computer executable instructions cause the computer processor to perform the steps of calculating the positional coordinates of the one or more segments of the mesh associated with the one or more bodily features on a display of the user device for outputting the tailored visual content associated with the one or more bodily features.

11 . The computer program product of claim 10 , wherein the computer executable instructions cause the computer processor to perform the step of altering the tailored visual content based on the calculated positional coordinates to overlap the one or more bodily features.

12 . The computer program product of claim 8 , wherein generating the tailored visual content is based on one or more factors comprising at least one of user preferences, historical data, and user profile.

13 . The computer program product of claim 8 , wherein the one or more components used to capture the real-time environment data comprise at least a front facing camera.

14 . The computer program product of claim 8 , wherein the tailored visual content is interstitial visual content.

15 . A computer implemented method for delivering tailored visual content in an augmented reality environment, wherein the method comprises:

determining that a user is accessing an augmented reality application, via a user device;

transmitting a first set of control signals to cause one or more components of the user device to capture real-time environment data associated with a real-time environment of the user;

identifying from the real-time environment data output by the one or more components of the user device, via neural network models, one or more bodily features of the user captured by the one or more components of the user device;

generating tailored visual content corresponding to the one or more bodily features captured by the one or more components of the user device, wherein the tailored visual content is (i) application specific visual content generated based on a type of the augmented reality application used to access an augmented reality environment, wherein the type of the augmented reality application is determined based on type of products provided by the augmented reality application and (ii) bodily-feature-specific visual content related to the one or more bodily features, wherein the bodily-feature-specific visual content is generated based on an identified type of the one or more bodily features;

calculating positional coordinates of the one or more bodily features that are related to the tailored visual content on a display of the user device for outputting the tailored visual content onto the one or more bodily features on the display of the user device;

transmitting the tailored visual content and the calculated positional coordinates for outputting the tailored visual content to the user device in the calculated positional coordinates; and

transmitting a second set of control signals to cause the user device to output, via the augmented reality application, the tailored visual content associated with the one or more bodily features of the user in an augmented reality environment of the user by placing the tailored visual content in the calculated positional coordinates on the display of the user device.

16 . The computer implemented method of claim 15 , wherein identifying the one or more bodily features comprises:

generating, via the neural network models, a mesh associated with the one or more bodily features of the user captured by the one or more components of the user device, wherein the mesh comprises one or more segments; and

determining, via the neural network models, a type of the one or more bodily features captured by the one or more components of the user device based on the generated mesh.

17 . The computer implemented method of claim 16 , wherein the method further comprises calculating the positional coordinates of the one or more segments of the mesh associated with the one or more bodily features on a display of the user device for outputting the tailored visual content associated with the one or more bodily features.

18 . The computer implemented method of claim 17 , wherein the method comprises altering the tailored visual content based on the calculated positional coordinates to overlap the one or more bodily features.

19 . The computer implemented method of claim 15 , wherein the method comprises generating the tailored visual content based on one or more factors comprising at least one of user preferences, historical data, and user profile.

20 . The computer implemented method of claim 15 , wherein the tailored visual content is interstitial visual content.

Assignments (1)

Continuity (2)

References Cited (68)