IP Library Granted Patent US 11,682,101
Granted Patent B2
US 11,682,101 · App. 17/675,819 · Granted Jun 20, 2023

Overlaying displayed digital content transmitted over a communication network via graphics processing circuitry using a frame buffer

Inventors: Dharmendra Etwaru (Sparta, NJ); Michael R. Sutcliff (Inlet Beach, FL)
Assignee: MOBEUS INDUSTRIES, INC.
G06T1/60G06T1/20H04L65/70H04L65/75
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,682,101
App. No.
17/675,819
Granted
Jun 20, 2023
Kind
B2
Abstract

A method that includes accessing a frame buffer of a graphics processing unit (GPU), analyzing, in the frame buffer of the GPU, a frame representing a section of a stream of displayed data that is being displayed by a first device, identifying a reference patch that includes a unique identifier associated with secondary digital content that is insertable in the displayed data, the unique identifier including encoded data that identifies the secondary digital content, retrieving the secondary digital content from the remote device via the data communication network based on the unique identifier and a device parameter of the first device, and overlaying the secondary digital content into the displayed data in accordance with the display parameters of the customized secondary digital content.

Claims (37)

1. A device communicating with a remote device over a data communication network, the device comprising:

processing circuitry, including a graphics processing unit (GPU), configured to

access a frame buffer of the GPU,

analyze, in the frame buffer of the GPU, a frame representing a section of a stream of displayed data that is being displayed by the device,

based on the analyzed frame, identify a reference patch in the frame buffer that includes a unique identifier associated with secondary digital content that is insertable in the displayed data that is being displayed by the device, the unique identifier including encoded data that identifies the secondary digital content, a location address of the secondary digital content at the remote device, a size of the secondary digital content when inserted in the displayed data, and display parameters of the secondary digital content when inserted in the displayed data;

retrieve the secondary digital content from the remote device via the data communication network based on the unique identifier and a device parameter of the device, the secondary digital content being customized to the device based on the unique identifier and the device parameter of the device such that the secondary digital content is different among different devices, the device parameter of the device being different from a device parameter of another device that also receives a reference patch; and

after retrieving the secondary digital content from the remote device, overlay the secondary digital content into the displayed data in accordance with display parameters of the customized secondary digital content, such that the secondary digital content is overlaid onto an object present in a first area of the displayed data, while the reference patch is located in a second area that is different from the first area.

2. The device of claim 1 , wherein the reference patch received by the device is a same reference patch as the reference patch received by the another device.

3. The device of claim 1 , wherein the device parameter of the device includes a device type, an internet protocol (IP) address, a security protocol, or a user preference.

4. The device of claim 1 , wherein the processing circuitry is further configured to update the secondary digital content based on an input received at the device.

5. The device of claim 1 , wherein the processing circuitry is further configured to decode the encoded data using a key of the device based on the device parameter of the device, the key of the device being different from a key of the another device.

6. The device of claim 1 , wherein the processing circuitry is further configured to overlay the secondary digital content into the displayed data by overlaying the secondary digital content into the displayed data in accordance with the display parameters of the customized secondary digital content and a user preference of the device, the user preference of the device being different from a user preference of the another device.

7. The device of claim 6 , wherein a portion of the retrieved secondary digital content is overlaid into the displayed data, the portion of the retrieved secondary digital content being based on the user preference of the device.

8. The device of claim 1 , wherein the processing circuitry is configured to identify the reference patch in the frame buffer by processing attributes of each pixel included in the frame representing the section of the stream of the displayed data and detecting groups of pixels within the frame with a predetermined pattern of pixel luma and chroma manipulation.

9. A method of communicating with a remote device over a data communication network, comprising:

accessing a frame buffer of a graphics processing unit (GPU);

analyzing, in the frame buffer of the GPU, a frame representing a section of a stream of displayed data that is being displayed by a first device;

based on the analyzed frame, identifying a reference patch in the frame buffer that includes a unique identifier associated with secondary digital content that is insertable in the displayed data that is being displayed by the first device, the unique identifier including encoded data that identifies the secondary digital content, a location address of the secondary digital content at the remote device, a size of the secondary digital content when inserted in the displayed data, and display parameters of the secondary digital content when inserted in the displayed data;

retrieving the secondary digital content from the remote device via the data communication network based on the unique identifier and a device parameter of the first device, the secondary digital content being customized to the first device based on the unique identifier and the device parameter of the first device such that the secondary digital content is different among different devices, the device parameter of the first device being different from a device parameter of a second device that also receives a reference patch; and

after retrieving the secondary digital content from the remote device, overlaying the secondary digital content into the displayed data in accordance with the display parameters of the customized secondary digital content, such that the secondary digital content is overlaid onto an object present in a first area of the displayed data, while the reference patch is located in a second area that is different from the first area.

10. The method of claim 9 , wherein the reference patch received by the first device is a same as the reference patch received by the second device.

11. The method of claim 9 , wherein the device parameter of the first device includes a device location, a device type, an internet protocol (IP) address, a security protocol, or a user preference.

12. The method of claim 9 , further comprising updating the secondary digital content based on an input received at the first device.

13. The method of claim 9 , further comprising decoding the encoded data using a key of the first device based on the device parameter of the first device, the key of the first device being different from a key of the second device.

14. The method of claim 9 , wherein the overlaying the secondary digital content into the displayed data further comprises overlaying the secondary digital content into the displayed data in accordance with the display parameters of the customized secondary digital content and a user preference of the first device, the user preference of the first device being different from a user preference of the second device.

15. The method of claim 14 , wherein a portion of the retrieved secondary digital content is overlaid into the displayed data, the portion of the retrieved secondary digital content being based on the user preference of the first device.

16. A non-transitory computer-readable storage medium for storing computer-readable instructions that, when executed by a computer, cause the computer to perform a method, the method comprising:

accessing a frame buffer of a graphics processing unit (GPU);

analyzing, in the frame buffer of the GPU, a frame representing a section of a stream of displayed data that is being displayed by a first device;

based on the analyzed frame, identifying a reference patch in the frame buffer that includes a unique identifier associated with secondary digital content that is insertable in the displayed data that is being displayed by the first device, the unique identifier including encoded data that identifies the secondary digital content, a location address of the secondary digital content at a remote device, a size of the secondary digital content when inserted in the displayed data, and display parameters of the secondary digital content when inserted in the displayed data;

retrieving the secondary digital content from the remote device via a data communication network based on the unique identifier and a device parameter of the first device, the secondary digital content being customized to the first device based on the unique identifier and the device parameter of the first device such that the secondary digital content is different among different devices, the device parameter of the first device being different from a device parameter of a second device that also receives a reference patch; and

after retrieving the secondary digital content from the remote device, overlaying the secondary digital content into the displayed data in accordance with the display parameters of the customized secondary digital content, such that the secondary digital content is overlaid onto an object present in a first area of the displayed data, while the reference patch is located in a second area that is different from the first area.

17. The non-transitory computer-readable storage medium according to claim 15 , wherein the reference patch received by the first device is a same reference patch as the reference patch received by the second device.

18. The non-transitory computer-readable storage medium according to claim 15 , wherein the device parameter of the first device includes a device location, a device type, an internet protocol (IP) address, a security protocol, or a user preference.

19. The non-transitory computer-readable storage medium according to claim 15 , the method further comprising updating the secondary digital content based on an input received at the first device.

20. The non-transitory computer-readable storage medium according to claim 15 , the method further comprising decoding the encoded data using a key of the first device based on the device parameter of the first device, the key of the first device being different from a key of the second device.

21. The non-transitory computer-readable storage medium according to claim 15 , wherein the overlaying the secondary digital content into the displayed data further comprises overlaying the secondary digital content into the displayed data in accordance with the display parameters of the customized secondary digital content and a user preference of the first device, the user preference of the first device being different from a user preference of the second device.

Assignments (2)
CHANGE OF NAME Recorded Jul 15, 2022
From: BEAM, INC.
To: MOBEUS INDUSTRIES, INC.
Reel/Frame 060678/0149 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 7, 2022
From: ETWARU, DHARMENDRA; SUTCLIFF, MICHAEL R.
To: BEAM, INC.
Reel/Frame 059185/0944 →
Continuity (3)
Provisional Application 63189434 · May 17, 2021
Provisional Application 63182391 · Apr 30, 2021
Related Publication 20220351327A1 · Nov 3, 2022