IP Library Granted Patent US 11,064,247
Granted Patent B1
US 11,064,247 · App. 16/887,233 · Granted Jul 13, 2021

System and method for communicating non-standard video data via USB

Inventors: Brian Perry (Knoxville, TN); Asela Ekanayake (Santa Clara, CA); Fareed Uddin (San Jose, CA); Jiachi Zhang (Santa Clara, CA)
Assignee: Elo Touch Solutions, Inc.
H04N21/43632G06F13/382H04N21/42202H04N21/4381H04N21/4545G06F2213/0042
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,064,247
App. No.
16/887,233
Granted
Jul 13, 2021
Kind
B1
Abstract

Some embodiments include an apparatus, method, and computer program product for receiving non-standard video data via a single standard universal serial bus (USB) interface, where the non-standard video data includes sensor data from one or more sensors in addition to standard video frames from an image detector. Some embodiments include recovering a standard video picture encoding packet from a standard USB packet, and recovering non-standard video data. Some embodiments include detecting a pseudo-video frame within the non-standard video data, determining sensor data from one or more sensors from the pseudo-video frame, and transmitting the sensor data to a monitor scaler processor. Some embodiments include storing the standard USB packet, and in response to the detecting, discarding the pseudo-video frame.

Claims (52)

1. An apparatus for transmitting non-standard video data, comprising:

a transceiver; and

one or more processors coupled to the transceiver, configured to:

receive standard video frames;

determine that sensor data from one or more sensors have been received;

in response to the determination, determine a pseudo-video frame that corresponds to the sensor data;

generate the non-standard video data corresponding to the pseudo-video frame and the standard the video frames;

encode the non-standard video data to a standard video picture encoding packet;

encode the standard video picture encoding packet to a standard universal service bus (USB) packet; and

transmit the standard USB packet via a single standard USB interface.

2. The apparatus of claim 1 , wherein the one or more sensors comprise: an ambient light sensor, a proximity sensor, a motion sensor, a microphone, or a people counter sensor.

3. The apparatus of claim 1 , wherein to generate the non-standard video data, the one or more processors are configured to:

add the pseudo-video frame to the standard video frames; or

replace a video frame of the standard video frames with the pseudo-video frame.

4. The apparatus of claim 1 , wherein to determine the pseudo-video frame, the one or more processors are configured to: encode the sensor data to: a pattern on a video frame, a color on a video frame, an audio portion of a video frame, or a watermark added to a video frame.

5. The apparatus of claim 1 , wherein the standard video picture encoding packet is based on: MPEG-4 Part 2 protocol, YUY2 protocol, or H.264 protocol.

6. The apparatus of claim 5 , wherein the standard video picture encoding packet is an MPEG-4 Part 2 packet, and to encode the non-standard video data to the MPEG-4 Part 2 packet, the one or more processors are configured to: include the non-standard video data in a data field of the MPEG-4 Part 2 packet.

7. The apparatus of claim 6 , wherein to include the non-standard video data in the data field of the MPEG-4 Part 2 packet, the one or more processors are configured to:

create a quasi header field comprising the pseudo-video frame; and

create a quasi data field comprising the standard video frames, wherein the quasi header field and the quasi data field are carried within the data field of the MPEG-4 Part 2 packet.

8. An apparatus for receiving non-standard video data, comprising:

a transceiver; and

one or more processors coupled to the transceiver, configured to:

receive a standard universal serial bus (USB) packet via a single standard USB interface;

recover a standard video picture encoding packet from the standard USB packet;

recover the non-standard video data from the standard video picture encoding packet;

detect a pseudo-video frame within the non-standard video data;

determine, from the pseudo-video frame, sensor data from one or more sensors; and

transmit the sensor data to a monitor scaler processor.

9. The apparatus of claim 8 , further comprising:

a gated buffer coupled to the one or more processors, wherein the gated buffer is configured to store the standard USB packet, wherein the one or more processors are further configured to: in response to the detection, transmit a discard flag to the gated buffer.

10. The apparatus of claim 8 , wherein the sensor data comprises: ambient light sensor data, proximity sensor data, motion sensor data, audio data, or people counter sensor data.

11. The apparatus of claim 8 , wherein to determine from the pseudo-video frame, the sensor data from the one or more sensors, the one or more processors are configured to: decode the sensor data from: a pattern of the pseudo-video frame, a color of the pseudo-video frame, an audio portion of the pseudo-video frame, or a watermark added to the pseudo-video frame.

12. The apparatus of claim 8 , wherein the standard video picture encoding packet is based on: MPEG-4 Part 2 protocol, YUY2 protocol, or H.264 protocol.

13. The apparatus of claim 12 , wherein the standard video picture encoding packet is an MPEG-4 Part 2 packet, and to recover the non-standard video data from the MPEG-4 Part 2 packet, the one or more processors are configured to: decode the non-standard video data from a data field of the MPEG-4 Part 2 packet.

14. The apparatus of claim 13 , wherein to decode the non-standard video data from the data field of the MPEG-4 Part 2 packet, the one or more processors are configured to:

decode a quasi header field comprising the pseudo-video frame; and

decode a quasi data field comprising video frames, wherein the quasi header field and the quasi data field are within the data field of the MPEG-4 Part 2 packet.

15. A non-transitory computer-readable medium storing instructions that, when executed by a processor of a first electronic device, cause the processor to perform operations for receiving non-standard video data, the operations comprising:

receiving a standard universal serial bus (USB) packet via a single standard USB interface;

recovering a standard video picture encoding packet from the standard USB packet;

recovering the non-standard video data from the standard video picture encoding packet;

detecting a pseudo-video frame within the non-standard video data;

determining, from the pseudo-video frame, sensor data from one or more sensors; and

transmitting the sensor data to a monitor scaler processor.

16. The non-transitory computer-readable medium of claim 15 , wherein the operations further comprise:

storing the standard USB packet at a gated buffer;

in response to the detecting, discard the pseudo-video frame.

17. The non-transitory computer-readable medium of claim 15 , wherein the sensor data comprises: ambient light sensor data, proximity sensor data, motion sensor data, audio data, or people counter sensor data.

18. The non-transitory computer-readable medium of claim 15 , wherein the determining, from the pseudo-video frame, the sensor data from the one or more sensors operation comprises: decoding the sensor data from: a pattern of the pseudo-video frame, a color of the pseudo-video frame, an audio portion of the pseudo-video frame, or a watermark added to the pseudo-video frame.

19. The non-transitory computer-readable medium of claim 15 , wherein the standard video picture encoding packet is based on: MPEG-4 Part 2 protocol, YUY2 protocol, or H.264 protocol.

20. The non-transitory computer-readable medium of claim 19 , wherein the standard video picture encoding packet is an MPEG-4 Part 2 packet, and the recovering the non-standard video data from the MPEG-4 Part 2 packet operation comprises: decoding the non-standard video data from a data field of the MPEG-4 Part 2 packet.

Assignments (5)
PATENT SECURITY AGREEMENT Recorded Dec 17, 2025
From: ELO TOUCH SOLUTIONS, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 074005/0708 →
RELEASE OF SECURITY INTEREST IN PATENTS RECORDED AT REEL 070666/FRAME 0540 Recorded Sep 30, 2025
From: CITIZENS BANK, N.A.
To: ELO TOUCH SOLUTIONS, INC.
Reel/Frame 072982/0372 →
SECURITY INTEREST Recorded Mar 27, 2025
From: ELO TOUCH SOLUTIONS, INC.
To: CITIZENS BANK, N.A.
Reel/Frame 070666/0540 →
ADDRESS CHANGE Recorded Aug 11, 2023
From: ELO TOUCH SOLUTIONS, INC.
To: ELO TOUCH SOLUTIONS, INC.
Reel/Frame 064571/0711 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 29, 2020
From: PERRY, BRIAN; EKANAYAKE, ASELA; UDDIN, FAREED; ZHANG, JIACHI
To: ELO TOUCH SOLUTIONS, INC.
Reel/Frame 052788/0658 →