IP Library Granted Patent US 11,562,153
Granted Patent B1
US 11,562,153 · App. 17/708,656 · Granted Jan 24, 2023

Systems and methods for recognizability of objects in a multi-layer display

Inventors: Dharmendra Etwaru (Sparta, NJ); David Casper (St. Pete Beach, FL)
Assignee: MOBEUS INDUSTRIES, INC.
G06F40/58G06F3/04842G06V10/255G06V10/764
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,562,153
App. No.
17/708,656
Granted
Jan 24, 2023
Kind
B1
Abstract

A method, system, and computer-readable media of generating a display on a device, including combining content from a plurality of sources into a display, the content from each of the plurality of sources being presented as a layer of the display, and further, each layer of the display being of substantially the same dimensions, detecting one or more objects in each layer of the generated display, and for one or more of the detected objects determining an object type or classification, determining if the object is overlapping or obscuring an object in a different layer of the generated display, and determining if the object will appear to a viewer as if it will overlap or obscure an object in a different layer of the generated display as a result of the motion, orientation, or gaze of the viewer.

Claims (51)

1. A method of generating a display on a device, comprising:

combining content from a plurality of sources into a display, wherein the content from each of the plurality of sources is presented as a layer of the display, and further, wherein each layer of the display is of substantially the same dimensions;

detecting one or more objects in each layer of the generated display; and

for one or more of the detected objects

determining an object type or classification;

determining if the object is overlapping or obscuring an object in a different layer of the generated display;

determining if the object will appear to a viewer as if it will overlap or obscure an object in a different layer of the generated display as a result of motion, orientation, or gaze of the viewer; and

based on the object's type or classification, a determination that the object is overlapping or obscuring an object in a different layer of the generated display, or a determination that the object will appear to a viewer as if it will overlap or obscure an object in a different layer, modifying a transparency of the object based on a rule or trained model.

2. The method of claim 1 , wherein modifying based on a rule or trained model further comprises modifying a shape, a color, a contrast, an opacity, a position, a resolution, or an orientation.

3. The method of claim 1 , wherein determining an object type or classification further comprises providing an image of the object to a trained model operating to output a classification of the object.

4. The method of claim 3 , wherein the classification of the object is one of text, a human, an animal, or a shape of the object.

5. The method of claim 1 , further comprising determining if an object should be made selectable or not selectable, and in response setting that transparency accordingly.

6. The method of claim 1 , wherein the sources comprise one or more of a video camera, an application executing on a user's device, or a remote server storing content.

7. The method of claim 1 , wherein modifying based on a rule or trained model further comprises accessing a rule, a set of rules, or a trained model from a user's device that determine how to process the object.

8. The method of claim 1 , further comprising performing the steps of detecting one or more objects, determining an object type or classification, determining that the object is overlapping or obscuring an object in a different layer of the generated display, or determining that the object will appear to a viewer as if it will overlap or obscure an object in a different layer, and modifying a transparency of the object based on a rule or trained model continuously as video content or images are received from the sources.

9. The method of claim 1 , wherein if an object is determined to be text expressed in a first language, then the method further comprises:

translating the text into a second language;

removing the text in the first language; and

inserting the text in the second language into the generated display.

10. The method of claim 1 , wherein modifying based on a rule or trained model further comprises modifying a shape, a color, a contrast, an opacity, a position, a resolution, and an orientation.

11. A system for generating a display on a device, comprising:

one or more electronic processors configured to execute a set of computer-executable instructions;

one or more non-transitory electronic data storage media containing the set of computer-executable instructions, wherein when executed, the instructions cause the one or more electronic processors to

combine content from a plurality of sources into a display, wherein the content from each of the plurality of sources is presented as a layer of the display, and further, wherein each layer of the display is of substantially the same dimensions;

detect one or more objects in each layer of the generated display; and

for one or more of the detected objects;

determine an object type or classification;

determine if the object is overlapping or obscuring an object in a different layer of the generated display;

determine if the object will appear to a viewer as if it will overlap or obscure an object in a different layer of the generated display as a result of motion, orientation, or gaze of the viewer; and

based on the object's type or classification, a determination that the object is overlapping or obscuring an object in a different layer of the generated display, or a determination that the object will appear to a viewer as if it will overlap or obscure an object in a different layer, modify a transparency of the object based on a rule or trained model.

12. One or more non-transitory computer-readable media comprising a set of computer-executable instructions that when executed by one or more programmed electronic processors, cause the one or more programmed electronic processors to

combine content from a plurality of sources into a display, wherein the content from each of the plurality of sources is presented as a layer of the display, and further, wherein each layer of the display is of substantially the same dimensions;

detect one or more objects in each layer of a generated display; and

for one or more of the detected objects

determine an object type or classification;

determine if the object is overlapping or obscuring an object in a different layer of the generated display;

determine if the object will appear to a viewer as if it will overlap or obscure an object in a different layer of the generated display as a result of motion, orientation, or gaze of the viewer; and

based on the object's type or classification, a determination that the object is overlapping or obscuring an object in a different layer of the generated display, or a determination that the object will appear to a viewer as if it will overlap or obscure an object in a different layer, modify a transparency of the object based on a rule or trained model.

13. The one or more non-transitory computer-readable media of claim 12 , wherein modifying based on a rule or trained model further comprises modifying a shape, a color, a contrast, an opacity, a position, a resolution, or an orientation.

14. The one or more non-transitory computer-readable media of claim 12 , wherein determining an object type or classification further comprises providing an image of the object to a trained model operating to output a classification of the object.

15. The one or more non-transitory computer-readable media of claim 14 , wherein the classification of the object is one of text, a human, an animal, or a shape of the object.

16. The one or more non-transitory computer-readable media of claim 12 , wherein the set of computer-executable instructions, when executed by the one or more programmed electronic processors, cause the one or more programmed electronic processors to

determine if an object should be made selectable or not selectable, and in response setting that transparency accordingly.

17. The one or more non-transitory computer-readable media of claim 12 , wherein the sources comprise one or more of a video camera, an application executing on a user's device, or a remote server storing content.

18. The one or more non-transitory computer-readable media of claim 12 , wherein modifying based on a rule or trained model further comprises accessing a rule, a set of rules, or a trained model from a user's device that determine how to process the object.

19. The one or more non-transitory computer-readable media of claim 12 , wherein the set of computer-executable instructions, when executed by the one or more programmed electronic processors, cause the one or more programmed electronic processors to

perform the steps of detecting one or more objects, determining an object type or classification, determining that the object is overlapping or obscuring an object in a different layer of the generated display, or determining that the object will appear to a viewer as if it will overlap or obscure an object in a different layer, and modifying a transparency of the object based on a rule or trained model continuously as video content or images are received from the sources.

20. The one or more non-transitory computer-readable media of claim 12 , wherein if an object is determined to be text expressed in a first language, then the set of computer-executable instructions, when executed by the one or more programmed electronic processors, cause the one or more programmed electronic processors to:

translate the text into a second language;

remove the text in the first language; and

insert the text in the second language into the generated display.

Assignments (2)
CHANGE OF NAME Recorded Jul 15, 2022
From: BEAM, INC.
To: MOBEUS INDUSTRIES, INC.
Reel/Frame 060678/0149 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 30, 2022
From: ETWARU, DHARMENDRA; CASPER, DAVID
To: BEAM, INC.
Reel/Frame 059445/0242 →
Continuity (2)
Provisional Application 63248800 · Sep 27, 2021
Provisional Application 63222757 · Jul 16, 2021
Cited By (7)
US 12,242,580 US 12,293,267 US 12,323,691 US 12,361,202 US 12,367,008 US 12,462,845 US 12,646,487