IP Library Granted Patent US 12,321,579
Granted Patent B2
US 12,321,579 · App. 18/107,171 · Granted Jun 3, 2025

Guidance image generation for a mobile device

Inventors: Olivier D Meirhaeghe (Lincolnshire, IL); Amit Kumar Agrawal (Bangalore, IN); Satyabrata Rout (Bangalore, IN); Gokula Ramanan (Tamil Nadu, IN)
Assignee: Motorola Mobility LLC
G06F3/04845A63F13/2145A63F13/52G06F3/14G06F9/452
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,321,579
App. No.
18/107,171
Granted
Jun 3, 2025
Kind
B2
Abstract

Techniques for guidance image generation for a mobile device are described and are implementable to generate a guidance image for display by a first device based on digital content displayed by a second device. For instance, a mobile device executes and controls a gaming application, and communicates digital content from the application to a display device. A screenshot of the digital content displayed by the remote display device is captured, and based on the screenshot the mobile device generates a guidance image. The guidance image depicts one or more touchpoints of the application, and is displayed by the mobile device. The mobile device is further operable to terminate display of the guidance image, such as based on receipt of an instance proximity-based input. The mobile device recalls the guidance image subsequent to termination of display, such as based on a user request to recall the guidance image.

Claims (38)

1. A computing device, comprising:

a content control module implemented at least partially in hardware and configured to:

capture, by the computing device, a screenshot of digital content from a gaming application displayed by a remote display device as part of a content connectivity session between the computing device and the remote display device;

generate a guidance image based on the screenshot, the guidance image indicating one or more touchpoints of the gaming application;

display the guidance image in a user interface of the computing device as part of the content connectivity session;

terminate display of the guidance image responsive to receipt of proximity-based input to the computing device; and

configure the computing device with a recall rate that controls a frequency to recall the guidance image for display during the content connectivity session, the recall rate based in part on an on-target ratio calculated as a ratio of on-target instances of proximity-based input to off-target instances of proximity based input.

2. The computing device as described in claim 1 , wherein the computing device displays a blank screen configured to control functionality of the gaming application via the one or more touchpoints subsequent to termination of display of the guidance image.

3. The computing device as described in claim 1 , wherein to generate the guidance image includes adjusting an aspect ratio of the screenshot to configure the guidance image for display by the computing device.

4. The computing device as described in claim 1 , wherein to generate the guidance image includes applying a transparency filter to the screenshot.

5. The computing device as described in claim 1 , wherein the content control module is further configured to recall the guidance image subsequent to termination of display of the guidance image in accordance with the recall rate.

6. The computing device as described in claim 1 , wherein the content control module is further configured to receive a user input to recall the guidance image subsequent to termination of display of the guidance image; and recall the guidance image for display responsive to the user input to recall the guidance image.

7. The computing device as described in claim 1 , wherein the content control module is further configured to detect one or more off-target instances of proximity-based input as part of a user interaction with the gaming application subsequent to termination of display of the guidance image; and recall the guidance image for display based on detection of the one or more off-target instances of proximity-based input.

8. The computing device as described in claim 1 , wherein the guidance image includes the screenshot and additional content to identify the one or more touchpoints of the gaming application.

9. A method, comprising:

capturing, by a mobile device, a screenshot of digital content from an application displayed by a remote display device as part of a content connectivity session between the mobile device and the remote display device;

generating a guidance image based on the screenshot, the guidance image indicating one or more touchpoints of the application;

displaying the guidance image in a user interface of the mobile device as part of the content connectivity session;

receiving proximity-based input to the user interface of the mobile device;

terminating display of the guidance image responsive to receipt of the proximity-based input; and

configuring the mobile device with a recall rate to control a frequency to recall the guidance image for display during the content connectivity session, the recall rate based in part on an on-target ratio calculated as a ratio of on-target instances of proximity-based input to off-target instances of proximity based input.

10. The method as described in claim 9 , wherein the mobile device displays a blank screen configured to control functionality of the application via the one or more touchpoints subsequent to termination of display of the guidance image.

11. The method as described in claim 9 , wherein generating the guidance image includes adjusting an aspect ratio of the screenshot to configure the guidance image for display by the mobile device.

12. The method as described in claim 9 , wherein generating the guidance image includes applying a transparency filter to the screenshot.

13. The method as described in claim 9 , further comprising recalling the guidance image subsequent to termination of display of the guidance image in accordance with the recall rate.

14. The method as described in claim 9 , further comprising receiving a user request to recall the guidance image and displaying the guidance image responsive to the user request.

15. The method as described in claim 9 , further comprising detecting that a position of the one or more touchpoints have changed; and recalling the guidance image for display based on the detection that the one or more touchpoints have changed.

16. The method as described in claim 9 , wherein the guidance image includes the screenshot and one or more graphics to identify the one or more touchpoints of the application.

17. A system, comprising:

one or more processors; and

one or more computer-readable storage media storing instructions that are executable by the one or more processors to:

capture a screenshot of digital content from a gaming application displayed by a remote display device as part of a content connectivity session between a mobile device and the remote display device;

generate a guidance image based on the screenshot for display by the mobile device as part of the content connectivity session, the guidance image indicating one or more touchpoints of the gaming application;

calculate a recall rate to control a frequency of display of the guidance image during the content connectivity session, the recall rate based in part on an on-target ratio of proximity based input calculated as a ratio of on-target instances of proximity-based input to off-target instances of proximity based input; and

display the guidance image in a user interface of the mobile device in accordance with the recall rate.

18. The system as described in claim 17 , wherein the guidance image is dismissed responsive to receipt of proximity-based input to the user interface of the mobile device.

19. The system as described in claim 18 , wherein the guidance image is recalled for display by the mobile device subsequent to dismissal in accordance with the recall rate, the recalled guidance image including an updated screenshot of the digital content displayed by the remote display device.

20. The system as described in claim 17 , wherein the recall rate decreases as the content connectivity session continues.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2023
From: MEIRHAEGHE, OLIVIER D; AGRAWAL, AMIT KUMAR; ROUT, SATYABRATA; RAMANAN, GOKULA
To: MOTOROLA MOBILITY LLC
Reel/Frame 062627/0772 →
Continuity (1)
Related Publication 20240264729A1 · Aug 8, 2024
References Cited (111)
US 5195179A · Tokunaga · 1993 [cited by applicant]
US 5521841A · Arman et al. · 1996 [cited by applicant]
US 5760767A · Shore et al. · 1998 [cited by applicant]
US 5852435A · Vigneaux et al. · 1998 [cited by applicant]
US 5884056A · Steele · 1999 [cited by applicant]
US 6069606A · Sciammarella et al. · 2000 [cited by applicant]
US 6332147B1 · Moran et al. · 2001 [cited by applicant]
US 6463444B1 · Jain et al. · 2002 [cited by applicant]
US RE38401E · Goldberg · 2004 [cited by applicant]
US RE38609E · Chen et al. · 2004 [cited by applicant]
US 6807361B1 · Girgensohn et al. · 2004 [cited by applicant]
US 7143362B2 · Dieberger et al. · 2006 [cited by applicant]
US 7149974B2 · Girgensohn · 2006 [cited by applicant]
US 7343026B2 · Niwa et al. · 2008 [cited by applicant]
US 9491374B1 · Avrahami et al. · 2016 [cited by applicant]
US 10147141B1 · Rixford · 2018 [cited by applicant]
US 10387098B2 · Park et al. · 2019 [cited by applicant]
US 10531039B1 · Bender et al. · 2020 [cited by applicant]
US 10554921B1 · Lim et al. · 2020 [cited by applicant]
US 11583760B1 · Agrawal et al. · 2023 [cited by applicant]
US 12229397B2 · Agrawal et al. · 2025 [cited by applicant]
US 20030184598A1 · Graham · 2003 [cited by applicant]
US 20030189588A1 · Girgensohn et al. · 2003 [cited by applicant]
US 20050162384A1 · Yokoyama · 2005 [cited by applicant]
US 20060090141A1 · Loui et al. · 2006 [cited by applicant]
US 20060103631A1 · Mashima et al. · 2006 [cited by applicant]
US 20060112349A1 · Clow et al. · 2006 [cited by applicant]
US 20060120624A1 · Jojic et al. · 2006 [cited by applicant]
US 20060252541A1 · Zalewski et al. · 2006 [cited by applicant]
US 20070101293A1 · Cherry et al. · 2007 [cited by applicant]
US 20070112926A1 · Brett et al. · 2007 [cited by applicant]
US 20070124507A1 · Gurram et al. · 2007 [cited by applicant]
US 20080096654A1 · Mondesir et al. · 2008 [cited by applicant]
US 20080250408A1 · Tsui et al. · 2008 [cited by applicant]
US 20090204881A1 · Murthy et al. · 2009 [cited by applicant]
US 20100082585A1 · Barsook et al. · 2010 [cited by applicant]
US 20120050183A1 · Lee · 2012 [cited by applicant]
US 20120226742A1 · Momchilov et al. · 2012 [cited by applicant]
US 20130067422A1 · Hong · 2013 [cited by applicant]
US 20130217498A1 · Wang · 2013 [cited by applicant]
US 20130249819A1 · Akifusa et al. · 2013 [cited by applicant]
US 20140006634A1 · Eacott et al. · 2014 [cited by applicant]
US 20140098038A1 · Paek et al. · 2014 [cited by applicant]
US 20140179423A1 · Deng · 2014 [cited by examiner]
US 20140192137A1 · Kim et al. · 2014 [cited by applicant]
US 20140277843A1 · Langlois et al. · 2014 [cited by applicant]
US 20140320398A1 · Papstein · 2014 [cited by applicant]
US 20140349757A1 · Nogami et al. · 2014 [cited by applicant]
US 20160210011A1 · Ho · 2016 [cited by applicant]
US 20160283063A1 · Missig et al. · 2016 [cited by applicant]
US 20170078428A1 · Unter Ecker · 2017 [cited by applicant]
US 20170258449A1 · Nielsen · 2017 [cited by examiner]
US 20170277498A1 · Wood, Jr. et al. · 2017 [cited by applicant]
US 20170371844A1 · Yao · 2017 [cited by examiner]
US 20190056962A1 · Ng · 2019 [cited by examiner]
US 20190147721A1 · Avitan · 2019 [cited by examiner]
US 20190156788A1 · Lee et al. · 2019 [cited by applicant]
US 20190182113A1 · Alam et al. · 2019 [cited by applicant]
US 20190294268A1 · Koyama et al. · 2019 [cited by applicant]
US 20190378519A1 · Dunjic et al. · 2019 [cited by applicant]
US 20200285438A1 · Lagnado et al. · 2020 [cited by applicant]
US 20200356243A1 · Meyer et al. · 2020 [cited by applicant]
US 20210097208A1 · Donahue et al. · 2021 [cited by applicant]
US 20210181922A1 · Chang et al. · 2021 [cited by applicant]
US 20210248483A1 · Tomasik et al. · 2021 [cited by applicant]
US 20210349627A1 · Chang et al. · 2021 [cited by applicant]
US 20220070371A1 · Bushman et al. · 2022 [cited by applicant]
US 20220070389A1 · Tangeland et al. · 2022 [cited by applicant]
US 20230041046A1 · Agrawal et al. · 2023 [cited by applicant]
US 20230045005A1 · Meirhaeghe et al. · 2023 [cited by applicant]
US 20240264734A1 · Agrawal et al. · 2024 [cited by applicant]
CN 106648025A · 2017 [cited by examiner]
CN 113126862A · 2021 [cited by examiner]
CN 113868269A · 2021 [cited by examiner]
CN 114489398A · 2022 [cited by examiner]
JP 2013148990A · 2013 [cited by examiner]
JP 2014021857A · 2014 [cited by examiner]
KR 20160006337A · 2016 [cited by examiner]
NO 20181316A1 · 2018 [cited by examiner]
WO WO2017033569A1 · 2017 [cited by examiner]
U.S. Appl. No. 18/107,092, filed Feb. 28, 2024 , “Non-Final Office Action”, U.S. Appl. No. 18/107,092, filed Feb. 28, 2024, 13 pages. [cited by applicant]
“Auto Hotspot, How to | Samsung Galaxy S10 Plus”, YouTube Video uploaded by Omarr Ghafoor [online][retrieved Jun. 23, 2021]. Retrieved from the Internet <https://www.youtube.com/watch?v=2V6s31zA7p4>., Oct. 30, 2019, 4 P… [cited by applicant]
“Check your phone's notifications in Samsung DeX”, Samsung Electronics America, Inc. [retrieved Jul. 16, 2021]. Retrieved from the Internet <https://www.samsung.com/us/support/answer/ANS00062702/>., 2019, 3 Pages. [cited by applicant]
“Do you know about Auto Hotspot?”, Samsung [retrieved Jun. 23, 2021]. Retrieved from the Internet <https://r2.community.samsung.com/t5/Tech-Talk/Do-you-know-about-Auto-Hotspot/td-p/2967111>., Dec. 4, 2019, 5 Pages. [cited by applicant]
“How do you automatically activate Mobile hotspot via Bluetooth connection on Windows 10 Mobile?”, in: Windows Central Forums [online][retrieved Jul. 12, 2021]. Retrieved from the Internet <https://forums.windowscentral… [cited by applicant]
“Instant Hotspot on your Mac”, Apple Inc. [retrieved Jun. 23, 2021]. Retrieved from the Internet <https://support.apple.com/guide/macbook-air/instant-hotspot-apdae69c81f1/mac>., Feb. 2019, 2 Pages. [cited by applicant]
“Non-Final Office Action”, U.S. Appl. No. 17/395,405, filed Dec. 27, 2021, 21 pages. [cited by applicant]
“Setting up Auto Hotspot on my Samsung phone”, Samsung [retrieved Jun. 23, 2021]. Retrieved from the Internet <https://www.samsung.com/au/support/mobile-devices/setup-auto-hotspot/>., Oct. 20, 2020, 8 Pages. [cited by applicant]
Pratik , “How to Use Your Phone as a Drawing Pad for PC”, TechWiser Blog [online][retrieved Jun. 8, 2021]. Retrieved from the Internet <https://techwiser.com/use-phone-as-drawing-pad-for-pc/>., Jul. 15, 2020, 12 pages. [cited by applicant]
U.S. Appl. No. 17/395,405, filed Jun. 22, 2022, , “Final Office Action”, U.S. Appl. No. 17/395,405, filed Jun. 22, 2022, 38 pages. [cited by applicant]
U.S. Appl. No. 17/395,405, filed Oct. 28, 2022, , “Non-Final Office Action”, U.S. Appl. No. 17/395,405, filed Oct. 28, 2022, 39 pages. [cited by applicant]
U.S. Appl. No. 17/397,002, filed Aug. 3, 2022, , “Non-Final Office Action”, U.S. Appl. No. 17/397,002, filed Aug. 3, 2022, 25 pages. [cited by applicant]
U.S. Appl. No. 17/397,002, filed Nov. 16, 2022, , “Notice of Allowance”, U.S. Appl. No. 17/397,002, filed Nov. 16, 2022, 9 pages. [cited by applicant]
U.S. Appl. No. 17/397,002, filed Jan. 19, 2023, , “Supplemental Notice of Allowability”, U.S. Appl. No. 17/397,002, filed Jan. 19, 2023, 3 pages. [cited by applicant]
U.S. Appl. No. 17/473,384, filed Oct. 6, 2022, , “Non-Final Office Action”, U.S. Appl. No. 17/473,384, filed Oct. 6, 2022, 14 pages. [cited by applicant]
Agrawal, Amit Kumar et al., “U.S. Application as Filed”, U.S. Appl. No. 17/473,384, filed Sep. 13, 2021, 68 pages. [cited by applicant]
Agrawal, Amit Kumar et al., “U.S. Application as Filed”, U.S. Appl. No. 17/397,002, filed Aug. 9, 2021, 82 pages. [cited by applicant]
Agrawal, Amit Kumar et al., “US Application as Filed”, U.S. Appl. No. 18/107,092, filed Feb. 8, 2023, 52 pages. [cited by applicant]
Agrawal, Amit Kumar et al., “US Application as Filed”, U.S. Appl. No. 18/107,134, filed Feb. 8, 2023, 57 pages. [cited by applicant]
Bohn, Dieter , “Chromebook Instant Tethering expands beyond Google devices and phones”, The Verge Blog, Vox Media, LLC. [online][retrieved Jun. 23, 2021]. Retrieved from the Internet <https://www.theverge.com/2019/2/4/1… [cited by applicant]
Cipriani, Jason , “How to use Apple's Instant Hotspot feature”, CNET [online][retrieved Jun. 23, 2021]. Retrieved from the Internet <https://www.cnet.com/how-to/how-to-use-apples-instant-hotspot-feature/>., Feb. 7, 2019… [cited by applicant]
Desai, Rahul B. et al., “U.S. Application as Filed”, U.S. Appl. No. 17/462,281, filed Aug. 31, 2021, 57 pages. [cited by applicant]
Heinisch, Christian , “HotSpot Automatic (free)”, Google Play [retrieved Jul. 12, 2021]. Retrieved from the Internet <https://play.google.com/store/apps/details ?id=de.christian_heinisch.hotspot.enablehotspot&hl=en_US&g… [cited by applicant]
Meirhaeghe, Olivier D. et al., “U.S. Application as Filed”, U.S. Appl. No. 17/395,405, filed Aug. 5, 2021, 80 pages. [cited by applicant]
Russell, Brandon , “Galaxy S21 features wireless support for Samsung DeX on PC”, XDA Developers Blog [online][retrieved Mar. 30, 2021]. Retrieved from the Internet <https://www.xda-developers.com/galaxy-s21-wireless-sup… [cited by applicant]
Snow, Jeffrey T. et al., “U.S. Application as Filed”, U.S. Appl. No. 17/473,312, filed Sep. 13, 2021, 48 pages. [cited by applicant]
Tappert, Charles C. et al., “Chapter 6—English Language Handwriting Recognition Interfaces”, In: Text Entry Systems: Mobility, Accessibility, Universality, Morgan Kaugmann [retrieved Jun. 27, 2022]. Retrieved from the I… [cited by applicant]
U.S. Appl. No. 18/107,092, filed Aug. 23, 2024 , “Final Office Action”, U.S. Appl. No. 18/107,092, filed Aug. 23, 2024, 18 pages. [cited by applicant]
“Corrected Notice of Allowability”, U.S. Appl. No. 18/107,092, Jan. 22, 2025, 2 pages. [cited by applicant]
“Notice of Allowance”, U.S. Appl. No. 18/107,092, Dec. 9, 2024, 9 pages. [cited by applicant]
“Non-Final Office Action”, U.S. Appl. No. 18/107,134, Jan. 13, 2025, 12 pages. [cited by applicant]
Cited By (1)
US 12,464,184