IP Library › Granted Patent US 12,309,437
Granted Patent B2
US 12,309,437 · App. 18/380,579 · Granted May 20, 2025

Enhanced screen share for online computer applications

Inventors: Steve Agoston (Hermosa Beach, CA); Michael Raymond Starich (Mission Viejo, CA); William Scott Watson (Mission Viejo, CA); Joseph Hiroshi Kimura (Orange, CA); Corbin J. Percy (San Clemente, CA); Akshay V. Rao (Aliso Viejo, CA)
Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
H04N21/2187G06F3/1454H04N21/4312H04N21/4788
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,309,437
App. No.
18/380,579
Granted
May 20, 2025
Kind
B2
Abstract

In a method and system for viewer interaction with streaming media, a scene from a media presentation is displayed with a broadcasting device that includes an operating system level broadcaster interface overlay. The overlay generates an image frame from the scene. The image frame is sent to a viewer device. Viewer interaction parameters are received from a viewing device and a viewer interaction is displayed over a subsequent scene from the media presentation with the broadcaster interface overlay. On a viewing device an image frame from the media presentation is received from the broadcasting device. An operating system level viewer interface overlay is generated over the image frame and the image frame of the media presentation is displayed. Viewer interaction parameters are generated from a viewer interaction with the operating system level viewer interface overlay and sent to the broadcasting device.

Claims (50)

1. A method for viewer interaction with streaming media on a broadcasting device, comprising:

displaying a scene from a media presentation wherein the broadcasting device includes an operating system level broadcaster interface overlay;

generating an image frame from the scene from the media presentation;

sending the image frame from the scene from the media presentation to a viewing device;

receiving viewer interaction parameters;

displaying a viewer interaction over a subsequent scene from the media presentation with the operating system level broadcaster interface overlay using the viewer interaction parameters, wherein the viewer interaction parameters include an interaction location;

wherein the viewer interaction parameters include a transform for the interaction location used to transform a location of the viewer interaction from a resolution at a viewer's device to a resolution at the broadcasting device.

2. The method for viewer interaction of claim 1 wherein the viewer interaction parameters include an interaction type.

3. The method for viewer interaction of claim 1 wherein the viewer interaction parameters include data for display of an emoticon or emoji in the operating system level broadcaster interface overlay.

4. The method for viewer interaction of claim 1 wherein the viewer interaction parameters include data for display of a free-form line, rectangle, circle, or ovoid, in the operating system level broadcaster interface overlay.

5. The method for viewer interaction of claim 1 wherein the viewer interaction parameters include data for display of a highlighted area, cursor, arrow, or a text comment in the operating system level broadcaster interface overlay.

6. The method for viewer interaction of claim 1 wherein the viewer interaction parameters include data for enlarging a portion of the scene of the media presentation in the operating system level broadcaster interface overlay.

7. The method for viewer interaction of claim 1 further comprising establishing viewer interaction limitations with the operating system level broadcaster interface overlay.

8. The method of claim 1 , wherein the operating system level broadcaster interface overlay includes information that is not included in the image sent to the viewing device.

9. A system for viewer interaction with streaming media, comprising:

a processor;

a memory coupled to the processor;

non-transitory instructions embodied in the memory that when executed by the processor cause the processor to implement the method for viewer interaction with streaming media on a broadcasting device comprising:

displaying a scene from a media presentation wherein the broadcasting device includes an operating system level broadcaster interface overlay;

generating an image frame from the scene from the media presentation;

sending the image frame from the scene from the media presentation to a viewing device;

receiving viewer interaction parameters;

displaying a viewer interaction over a subsequent scene from the media presentation with the operating system level broadcaster interface overlay using the viewer interaction parameters, wherein the viewer interaction parameters include an interaction location;

wherein the viewer interaction parameters include a transform for the interaction location used to transform a location of the viewer interaction from a resolution at a viewer's device to a resolution at the broadcasting device.

10. A method for viewer interaction with streaming media on a viewing device comprising:

requesting a connection with a broadcasting device;

receiving an image frame from a media presentation from the broadcasting device;

generating an operating system level viewer interface overlay over the image frame;

displaying the image frame from the media presentation;

generating viewer interaction parameters from a viewer interaction with the operating system level viewer interface overlay;

sending the viewer interaction parameters to the broadcasting device, wherein the viewer interaction parameters include an interaction location;

wherein the viewer interaction parameters include a transform for the interaction location used to transform a location of the viewer interaction from a resolution at the viewing device to a resolution at the broadcasting device.

11. The method for viewer interaction of claim 10 wherein the viewer interaction parameters include an interaction type.

12. The method for interaction of claim 10 wherein the viewer interaction parameters include data for display of an emoticon or emoji in the operating system level viewer interface overlay.

13. The method for interaction of claim 10 wherein the viewer interaction parameters include data for display of a free-form line, rectangle, circle, or ovoid, in the operating system level viewer interface overlay.

14. The method for interaction of claim 10 wherein the viewer interaction parameters include data for display of a highlighted area, cursor, arrow, or a text comment in the operating system level viewer interface overlay.

15. The method for interaction of claim 10 wherein the viewer interaction parameters include data for enlarging a portion of the scene of the media presentation in the operating system level viewer interface overlay.

16. The method for interaction of claim 10 further comprising receiving viewer interaction limitations from the broadcasting device.

17. The method for interaction of claim 10 wherein generating viewer interaction parameters includes capturing an interaction type and the interaction location from a location of the viewer interaction from an area of a display screen of the viewing device.

18. A system for viewer interaction with streaming media, comprising:

a processor;

a memory coupled to the processor;

non-transitory instructions embodied in the memory that when executed by the processor cause the processor to implement the method for interaction with streaming media on a viewing device comprising:

requesting a connection with a broadcasting device;

receiving an image frame from a media presentation from the broadcasting device;

generating an operating system level viewer interface overlay over the image frame from the media presentation;

displaying the image frame from the media presentation;

generating viewer interaction parameters from a viewer interaction with the operating system level viewer interface overlay;

sending viewer interaction parameters to the broadcasting device, wherein the viewer interaction parameters include an interaction location;

wherein the viewer interaction parameters include a transform for the interaction location used to transform a location of the viewer interaction from a resolution at the viewing device to a resolution at the broadcasting device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 16, 2023
From: AGOSTON, STEVE; STARICH, MICHAEL RAYMOND; WATSON, WILLIAM SCOTT; KIMURA, JOSEPH HIROSHI; RAO, AKSHAY V.; PERCY, CORBIN J.
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 065242/0859 →
Continuity (4)
Continuation PCTUS2023022854 · May 19, 2023
Continuation 17852993 · Jun 29, 2022
Continuation 17852993 · Jun 29, 2022
Related Publication 20240048781A1 · Feb 8, 2024
References Cited (15)
US 8559516B2 · Hardacker · 2013 [cited by examiner]
US 9195880B1 · Levoy · 2015 [cited by examiner]
US 10410376B1 · Waggoner et al. · 2019 [cited by applicant]
US 10785512B2 · Kambhatla et al. · 2020 [cited by applicant]
US 11792443B1 · Agoston · 2023 [cited by applicant]
US 20090271821A1 · Zalewski · 2009 [cited by examiner]
US 20180081509A1 · Varela et al. · 2018 [cited by applicant]
US 20190273954A1 · Evans · 2019 [cited by applicant]
US 20210099759A1 · Armstrong et al. · 2021 [cited by applicant]
US 20220132212A1 · Moehrle · 2022 [cited by applicant]
US 20220138902A1 · Lea · 2022 [cited by applicant]
US 20220207804A1 · Collins et al. · 2022 [cited by applicant]
“Typical Software Architecture” ebrary.net, Academic library 2014-2022, Available at: https://ebrary.net/22045/computer_science/typical_software_architecture, (Accessed: 2022). [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2023/022854, dated Oct. 10, 2023. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/852,993, dated Jun. 28, 2023. [cited by applicant]
Cited By (2)
US 1,086,149 US 1,117,213