IP Library Granted Patent US 12,301,651
Granted Patent B2
US 12,301,651 · App. 16/390,111 · Granted May 13, 2025

System and method for integrating an electronic pointing device into digital image data

Inventors: John McDevitt (Clearwater, FL); Sean Bunner (St. Petersburg, FL)
Assignee: HSNi, LLC
H04L67/10G06F3/0346G06F3/038G06Q30/0601H04L65/60H04N21/41265H04N21/42204H04N21/42222H04N21/42224H04N21/4725H04N21/4728
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,301,651
App. No.
16/390,111
Granted
May 13, 2025
Kind
B2
Abstract

A method and system is provided for creating an integrated video stream based on relative location and movement of a wireless pointing device. The system includes a receiver for continuously receiving position data from a wireless pointing device and a processor for calculating an initial position and orientation of the wireless pointing device based on the position data received from the wireless pointing device, accessing additional data from a secondary source based on input data received from the wireless pointing device, and creating the integrated video stream based on an original video stream, the initial position and orientation of the wireless pointing device and the additional data accessed from the secondary source. The system further includes a server for transmitting the integrated video stream to the wireless pointing device to be rendered on a screen thereof.

Claims (49)

1. A method comprising:

determining, based on a first content stream bound for a display device at a premises, image data associated with the first content stream;

receiving, from a user device at the premises, orientation data;

determining, based on the orientation data, position data associated with a position indicator;

generating, by a processing system remote to the premises, based on the first content stream and the position data associated with the position indicator, a second content stream comprising the position indicator; and

sending, by the processing system, to the display device, the second content stream.

2. The method of claim 1 , wherein the first content stream and the second content stream comprise an internet protocol data stream.

3. The method of claim 1 , wherein the orientation data is configured to indicate an orientation of the user device relative to the display device and wherein the position data is configured to indicate a position on the display device relative to other image data output on the display device.

4. The method of claim 1 , wherein the image data comprises pixel data.

5. The method of claim 1 , wherein the second content stream comprises second image data associated with the position data, wherein the second image data is configured to cause output of the position indicator.

6. The method of claim 1 , further comprising causing output of the second content stream, wherein causing output of the second content stream comprises rendering image data on the display device.

7. The method of claim 1 , further comprising:

receiving, from the user device, updated orientation data associated with the user device; and

generating, based on the updated orientation data, an updated second content stream, wherein the updated second content stream comprises an updated position indicator.

8. The method of claim 1 , further comprising sending, to the processing system remote to the premises, the orientation data.

9. One or more non-transitory computer-readable media storing processor-executable instructions thereon that, when executed by a processor, cause the processor to:

receive, from a content source, a first content stream bound for a display device at a premises;

determine, based on the first content stream, image data associated with the first content stream;

receive, from a user device at the premises, orientation data;

determine, based on the orientation data, position data associated with the a position indicator;

generate, by a processing system remote to the premises, based on the first content stream and the position data, a second content stream; and

send, by the processing system, to the display device, the second content stream.

10. The computer-readable media of claim 9 , wherein the first content stream and the second content stream comprise an internet protocol data stream.

11. The computer-readable media of claim 9 , wherein the orientation data is configured to indicate an orientation of the user device relative to the display device and wherein the position data is configured to indicate a position on the display device relative to other image data output on the display device.

12. The computer-readable media of claim 9 , wherein the image data comprises pixel data.

13. The computer-readable media of claim 9 , wherein the second content stream comprises second image data associated with the position data, wherein the second image data is configured to cause output of the position indicator.

14. The computer-readable media of claim 9 , wherein the processor-executable instructions, when executed by at least one processor, further cause the at least one processor to cause output of the second content stream, wherein causing output of the second content stream comprises rendering image data on the display device.

15. The computer-readable media of claim 9 , wherein the processor-executable instructions, when executed by at least one processor, further cause the at least one processor to:

receive, from the user device, updated orientation data associated with the user device; and

generate, based on the updated orientation data, an updated second content stream, wherein the updated second content stream comprises an updated position indicator.

16. The one or more non-transitory computer-readable media of claim 9 , wherein the processor-executable instructions, when executed by the processor, further cause the processor to sending, to the processing system remote to the premises, the orientation data.

17. A system comprising:

a computing device configured to:

receive, from a content source, a first content stream bound for a display device at a premises;

determine, based on the first content stream, image data associated with the first content stream;

receive, from a user device, orientation data;

determine, based on the orientation data, position data associated with a position indicator;

generate, by a processing system remote to the premises, based on the first content stream and the position data, a second content stream;

send, by the processing system, to the display device, the second content stream; and

the display device configured to:

output the second content stream.

18. The system of claim 17 , wherein the first content stream and the second content stream comprise an internet protocol data stream, and wherein the image data comprises pixel data.

19. The system of claim 17 , wherein the orientation data is configured to indicate an orientation of the user device relative to the display device and wherein the position data is configured to indicate a position on the display device relative to other image data output on the display device.

20. The system of claim 17 , wherein the second content stream comprises second image data associated with the position data, wherein the second image data is configured to cause output of the position indicator.

21. The system of claim 17 , wherein the computing device is further configured to cause output of the second content stream, wherein causing output of the second content stream comprises rendering image data on the display device.

22. The system of claim 17 , wherein the computing device is further configured to:

receive, from the user device, updated orientation data associated with the user device; and

generate, based on the updated orientation data, an updated second content stream, wherein the updated second content stream comprises an updated position indicator.

23. The system of claim 17 , wherein the computing device is further configured to send, to the processing system remote to the premises, the orientation data.

Assignments (2)
SECURITY INTEREST Recorded Aug 7, 2026
From: HSNI, LLC
To: GLAS USA LLC, AS COLLATERAL AGENT
Reel/Frame 075572/0495 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 21, 2021
From: MCDEVITT, JOHN; BUNNER, SEAN
To: HSNI, LLC
Reel/Frame 054989/0312 →
Continuity (7)
Continuation 15917039 · Mar 9, 2018
Continuation 15040021 · Feb 10, 2016
Continuation 14712269 · May 14, 2015
Continuation 14218186 · Mar 18, 2014
Continuation 13165364 · Jun 21, 2011
Provisional Application 61357379 · Jun 22, 2010
Related Publication 20190253479A1 · Aug 15, 2019
References Cited (43)
US 4737773A · Kobayashi · 1988 [cited by applicant]
US 5192943A · Matsuo · 1993 [cited by examiner]
US 5416535A · Sato · 1995 [cited by examiner]
US 5438355A · Palmer · 1995 [cited by applicant]
US 5931949A · Perlman et al. · 1999 [cited by applicant]
US 6009470A · Watkins · 1999 [cited by applicant]
US 6567086B1 · Hashimoto · 2003 [cited by applicant]
US 6631418B1 · Watkins · 2003 [cited by applicant]
US 7027655B2 · Keeney et al. · 2006 [cited by applicant]
US 7457878B1 · Mathiske et al. · 2008 [cited by applicant]
US 7683807B2 · Tomita et al. · 2010 [cited by applicant]
US 7752083B2 · Johnson et al. · 2010 [cited by applicant]
US 7796116B2 · Salsman · 2010 [cited by examiner]
US 7852317B2 · Grunnet-Jepsen · 2010 [cited by examiner]
US 7864159B2 · Sweetser · 2011 [cited by examiner]
US 8421746B2 · Igoe · 2013 [cited by examiner]
US 8717289B2 · McDevitt et al. · 2014 [cited by applicant]
US 9094707B2 · McDevitt et al. · 2015 [cited by applicant]
US 9294556B2 · McDevitt et al. · 2016 [cited by applicant]
US 9948701B2 · McDevitt · 2018 [cited by applicant]
US 20020064314A1 · Comaniciu et al. · 2002 [cited by applicant]
US 20030001908A1 · Cohen-solal · 2003 [cited by applicant]
US 20040049530A1 · Lok et al. · 2004 [cited by applicant]
US 20050132420A1 · Howard · 2005 [cited by examiner]
US 20060008117A1 · Kanada · 2006 [cited by applicant]
US 20060290823A1 · Kondo · 2006 [cited by applicant]
US 20070085824A1 · Hong · 2007 [cited by examiner]
US 20070229465A1 · Sakai · 2007 [cited by examiner]
US 20080052750A1 · Grunnet-Jepsen · 2008 [cited by examiner]
US 20080184128A1 · Swenson et al. · 2008 [cited by applicant]
US 20090051573A1 · Tomita et al. · 2009 [cited by applicant]
US 20090109241A1 · Tsujimoto · 2009 [cited by applicant]
US 20090245568A1 · Thelen · 2009 [cited by examiner]
US 20090276805A1 · Andrews, II · 2009 [cited by examiner]
US 20100162303A1 · Cassanova · 2010 [cited by applicant]
US 20100217685A1 · Melcher · 2010 [cited by examiner]
US 20110063511A1 · Karaoguz · 2011 [cited by examiner]
US 20110157231A1 · Ye et al. · 2011 [cited by applicant]
US 20110216087A1 · Gritton · 2011 [cited by examiner]
US 20130080916A1 · Lopez et al. · 2013 [cited by applicant]
US 20140201790A1 · McDevitt · 2014 [cited by examiner]
US 20140317554A1 · Song · 2014 [cited by examiner]
US 20180198849A1 · McDevitt · 2018 [cited by applicant]