IP Library › Granted Patent US 12,405,700
Granted Patent B2
US 12,405,700 · App. 18/611,216 · Granted Sep 2, 2025

User interfaces for managing visual content in media

Inventors: Grant R. Paul (San Francisco, CA); Steven D. Baker (Palo Alto, CA); Brandon J. Corey (Palo Alto, CA); Neil G. Crane (San Francisco, CA); Matthias Dantone (Redwood City, CA); Nathan De Vries (Alameda, CA); Craig M. Federighi (Los Altos Hills, CA); James N. Jones (San Francisco, CA); Xishuo Liu (Palo Alto, CA); Johnnie B. Manzari (San Francisco, CA); Sebastien V. Marineau-Mes (San Francisco, CA); Pulah J. Shah (Cupertino, CA); Andre Souza Dos Santos (San Jose, CA); Srinivasan Venkatachary (Sunnyvale, CA); Yang Zhao (Palo Alto, CA)
Assignee: Apple Inc.
G06F3/0481G06F3/04847G06V30/19G06F40/58
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,405,700
App. No.
18/611,216
Granted
Sep 2, 2025
Kind
B2
Abstract

The present disclosure generally relates to methods and user interfaces for managing visual content at a computer system. In some embodiments, methods and user interfaces for managing visual content in media are described. In some embodiments, methods and user interfaces for managing visual indicators for visual content in media are described. In some embodiments, methods and user interfaces for inserting visual content in media are described. In some embodiments, methods and user interfaces for identifying visual content in media are described. In some embodiments, methods and user interfaces for translating visual content in media are described. In some embodiments, methods and user interfaces for translating visual content in media are described. In some embodiments, methods and user interfaces for managing user interface objects for visual content in media are described.

Claims (94)

1. A computer system configured to communicate with a display generation component, comprising:

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:

displaying, via the display generation component, a media user interface that includes a representation of media;

while displaying the media user interface that includes the representation of the media, receiving a request to display additional information about a plurality of detected features in the representation of the media; and

in response to receiving the request to display additional information about the plurality of detected features and while displaying the media user interface that includes the representation of the media, displaying one or more indications of detected features in the media, including a first indication of a first detected feature that is displayed at a first location in the representation of the media that corresponds to a location of the first detected feature in the representation of the media, including:

in accordance with a determination that the first detected feature is a first type of feature, the first indication has a first appearance; and

in accordance with a determination that the first detected feature is a second type of feature that is different from the first type of feature, the first indication has a second appearance that is different from the first appearance.

2. The computer system of claim 1 , wherein the one or more indications of detected features in the media includes a second indication of a second detected feature that is displayed at a second location in the representation of the media that corresponds to a location of the second detected feature of the representation of the media, including:

in accordance with a determination that the second detected feature is the first type of feature, the second indication has the first appearance; and

in accordance with a determination that the second detected feature is the second type of feature that is different from the first type of feature, the second indication has the second appearance that is different from the first appearance.

3. The computer system of claim 2 , wherein:

the first indication of the first detected feature is concurrently displayed with the second indication of the second detected feature; and

the first detected feature is the first type of feature and the second feature is the second type of feature.

4. The computer system of claim 2 , wherein:

the first indication of the first detected feature is concurrently displayed with the second indication of the second detected feature;

the first detected feature is different from the second detected feature; and

the first detected feature is the first type of feature and the second feature is the first type of feature.

5. The computer system of claim 2 , wherein:

the first indication that has the first appearance is displayed with a first color; and

the first indication that has the second appearance is not displayed with the first color.

6. The computer system of claim 2 , wherein:

the first indication that has the first appearance is displayed with a first graphical representation of the first type of feature; and

the first indication that has the second appearance is displayed with a second graphical representation of the second type of feature that is different from the first graphical representation.

7. The computer system of claim 1 , wherein:

the one or more indications of detected features in the media include a third indication of a third detected feature that is the first type of feature, a fourth indication of a fourth detected feature that is the first type of feature, and a fifth indication of a fifth detected feature that is the second type of feature;

the third indication is displayed with the same as the fourth indication; and

the third indication is displayed with a different appearance than the fifth indication.

8. The computer system of claim 1 , wherein receiving the request to display additional information about the plurality of detected features of the representation of the media includes detecting an input directed to a media library.

9. The computer system of claim 1 , the one or more programs further including instructions for:

while displaying the first indication of the first detected feature, detecting a first input directed to the first indication of the first detected feature; and

in response to detecting the first input directed to the first indication of the first detected feature, displaying, via the display generation component, a first user interface object that includes information about the first detected feature.

10. The computer system of claim 9 , wherein the information about the first detected feature includes a representation of a portion of the media that corresponds to the first detected feature.

11. The computer system of claim 9 , wherein the one or more indications of detected feature in media include a sixth indication of a sixth detected feature, the one or more programs further including instructions for:

while displaying the first user interface object that includes information about the first detected feature and the sixth indication of the sixth detected feature, detecting an input directed to the sixth indication of the sixth detected feature; and

in response to detecting the input directed to the sixth indication of the sixth detected feature:

displaying, via the display generation component, a second user interface object that includes information about the sixth detected feature; and

ceasing to display, via the display generation component, the first user interface object that includes information about the first detected feature.

12. The computer system of claim 9 , wherein the information about the first detected feature includes an option to perform an action.

13. The computer system of claim 1 , wherein:

the one or more indications include a seventh indication of a seventh detected feature;

displaying, via the display generation component, the one or more indications of detected feature in the media, includes displaying an animation of the first indication being displayed before the seventh indication of the seventh feature is displayed; and

after displaying the animation, the first indication is concurrently displayed with the seventh indication.

14. The computer system of claim 1 , the one or more programs further including instructions for:

while displaying the first indication of the first detected feature, detecting a second input directed to the first indication of the first detected feature; and

in response to detecting the second input directed to the first indication of the first detected feature, displaying, via the display generation component, a third graphical representation of the first type of feature.

15. The computer system of claim 14 , wherein the one or more indications of detected feature in media include a ninth indication of a ninth detected feature, the one or more programs further including instructions for:

while displaying the third graphical representation of the first type of feature and the ninth indication of the ninth detected feature, detecting an input directed to the ninth indication of the ninth detected feature; and

in response to detecting the input directed to the ninth indication of the ninth detected feature, ceasing to display, via the display generation component, the third graphical representation of the first type of feature.

16. The computer system of claim 1 , the one or more programs further including instructions for:

while displaying the first indication of the first detected feature, detecting a third input directed to the first indication of the first detected feature; and

in response to detecting the third input directed to the first indication of the first detected feature, displaying, via the display generation component, a first user interface object that includes information about the first detected feature and information that corresponds to the representation of the media and does not correspond to the first detected feature.

17. The computer system of claim 16 , wherein the information that corresponds to the representation of the media and does not correspond to the first detected feature includes metadata corresponding to the representation of the media.

18. The computer system of claim 16 , wherein the information that corresponds to the representation of the media and does not correspond to the first detected feature includes one or more options for applying an effect.

19. The computer system of claim 16 , wherein the information that corresponds to the representation of the media and does not correspond to the first detected feature includes one or more links to related content in a media library.

20. The computer system of claim 1 , wherein:

the first indication is displayed at a first location on the display generation component in response to receiving the request to display additional information about the plurality of detected features;

the representation of the media is displayed with a first zoom level; and

the one or more programs further including instructions for:

while displaying the first indication of the first detected feature at the first location and the representation of the media is displayed with a second zoom level, detecting a fourth input directed to the first indication of the first detected feature; and

in response to detecting the fourth input directed to the first indication of the first detected feature, enlarging the representation of the media and displaying the first indication at a second location, wherein the second location is closer to a center of the display generation component than the first location.

21. The computer system of claim 1 , wherein:

the plurality of detected feature includes a tenth detected feature that is a tenth type of detected feature; and

displaying, via the display generation component, the one or more indications includes:

in accordance with a determination that a tenth location in the representation of the media that corresponds to a location of the tenth detected feature cannot be determined, displaying, via the display generation component, a tenth indication that corresponds to the tenth detected feature at a predetermined location on the media user interface.

22. The computer system of claim 21 , wherein the tenth indication displayed at the predetermined location is concurrently displayed with the first indication that is displayed at the first location.

23. The computer system of claim 21 , wherein:

the plurality of detected features include an eleventh detected feature; and

displaying, via the display generation component, the one or more indications includes:

in accordance with a determination that an eleventh location in the representation of the media that corresponds to a location of the tenth detected feature cannot be determined and a twelfth location that corresponds to a location of the eleventh detected feature cannot be determined:

in accordance with a determination that the tenth detected feature and eleventh detected feature are a different type of detected feature, displaying, via the display generation component, an eleventh indication that corresponds to type of feature of eleventh detected feature at a second predetermined location in the media user interface; and

in accordance with a determination that the tenth detected feature and eleventh detected feature are a same type of detected feature, forgoing displaying, via the display generation component, the eleventh indication.

24. The computer system of claim 23 , the one or more programs further including instructions for:

while displaying the tenth indication, detecting an input directed to the tenth indication when the tenth detected feature and eleventh detected feature are the same type of detected feature; and

in response to detecting the input directed to the tenth indication, displaying, via the display generation component, a user interface object that includes information about the tenth detected feature and information about the eleventh detected feature.

25. The computer system of claim 1 , wherein displaying the media user interface includes displaying a first user interface object for displaying additional information concurrently with a user interface object for corresponding to one or more text management operations.

26. The computer system of claim 1 , the one or more programs further including instructions for:

while displaying the representation of the media, receiving a request to display a second representation of second media that is different from the media; and

in response to receiving the request to display the second representation of second media that is different from the media:

in accordance with a determination that the representation of the second media includes one or more detected features, displaying, via the display generation component, a second user interface object for displaying additional information; and

in accordance with a determination that the representation of the media does not include the one or more detected feature, forgoing displaying, via the display generation component, the second user interface object for displaying additional information.

27. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system, wherein the computer system is in communication with a display generation component, the one or more programs including instructions for:

displaying, via the display generation component, a media user interface that includes a representation of media;

while displaying the media user interface that includes the representation of the media, receiving a request to display additional information about a plurality of detected features in the representation of the media; and

in response to receiving the request to display additional information about the plurality of detected features and while displaying the media user interface that includes the representation of the media, displaying one or more indications of detected features in the media, including a first indication of a first detected feature that is displayed at a first location in the representation of the media that corresponds to a location of the first detected feature in the representation of the media, including:

in accordance with a determination that the first detected feature is a first type of feature, the first indication has a first appearance; and

in accordance with a determination that the first detected feature is a second type of feature that is different from the first type of feature, the first indication has a second appearance that is different from the first appearance.

28. A method, comprising:

at a computer system that is in communication with a display generation component:

displaying, via the display generation component, a media user interface that includes a representation of media;

while displaying the media user interface that includes the representation of the media, receiving a request to display additional information about a plurality of detected features in the representation of the media; and

in response to receiving the request to display additional information about the plurality of detected features and while displaying the media user interface that includes the representation of the media, displaying one or more indications of detected features in the media, including a first indication of a first detected feature that is displayed at a first location in the representation of the media that corresponds to a location of the first detected feature in the representation of the media, including:

in accordance with a determination that the first detected feature is a first type of feature, the first indication has a first appearance; and

in accordance with a determination that the first detected feature is a second type of feature that is different from the first type of feature, the first indication has a second appearance that is different from the first appearance.

Continuity (6)
Continuation 18125070 · Mar 22, 2023
Continuation PCTUS2022025096 · Apr 15, 2022
Provisional Application 63318677 · Mar 10, 2022
Provisional Application 63197497 · Jun 6, 2021
Provisional Application 63176847 · Apr 19, 2021
Related Publication 20240256100A1 · Aug 1, 2024
References Cited (258)
US 7542971B2 · Thione et al. · 2009 [cited by applicant]
US 7575171B2 · Lev · 2009 [cited by applicant]
US 7908564B2 · Hara et al. · 2011 [cited by applicant]
US 8286102B1 · Wilensky · 2012 [cited by applicant]
US 8391697B2 · Cho et al. · 2013 [cited by applicant]
US 9075520B2 · Park et al. · 2015 [cited by applicant]
US 9332182B2 · Nonaka et al. · 2016 [cited by applicant]
US 9350924B2 · Posa · 2016 [cited by applicant]
US 9541407B1 · Mohler · 2017 [cited by applicant]
US 9600153B2 · Roh · 2017 [cited by examiner]
US 9900515B2 · Kim et al. · 2018 [cited by applicant]
US 9953631B1 · Cuthbert et al. · 2018 [cited by applicant]
US 9996976B2 · Zhou et al. · 2018 [cited by applicant]
US 10444975B2 · Murphy et al. · 2019 [cited by applicant]
US 10488218B2 · Kim et al. · 2019 [cited by applicant]
US 10503820B2 · Duggan et al. · 2019 [cited by applicant]
US 10534475B2 · Yoo et al. · 2020 [cited by applicant]
US 10572215B1 · Cooper et al. · 2020 [cited by applicant]
US 10656823B2 · Mukherjee et al. · 2020 [cited by applicant]
US 10671834B2 · Adato et al. · 2020 [cited by applicant]
US 10748345B2 · Zhou · 2020 [cited by applicant]
US 10762716B1 · Paul et al. · 2020 [cited by applicant]
US 10882613B2 · Sharma et al. · 2021 [cited by applicant]
US 10891800B1 · Stoyles et al. · 2021 [cited by applicant]
US 10902277B2 · Agarwal et al. · 2021 [cited by applicant]
US 10929443B2 · Grochocki et al. · 2021 [cited by applicant]
US 10943382B2 · Shapiro et al. · 2021 [cited by applicant]
US 11107219B2 · Cohen et al. · 2021 [cited by applicant]
US 11112963B2 · Chaudhri et al. · 2021 [cited by applicant]
US 11223728B2 · Kim · 2022 [cited by examiner]
US 11227494B1 · Stoyles et al. · 2022 [cited by applicant]
US 11231832B2 · Yang et al. · 2022 [cited by applicant]
US 11670023B2 · Xu et al. · 2023 [cited by applicant]
US 12001642B2 · Paul et al. · 2024 [cited by applicant]
US 20040201720A1 · Robins et al. · 2004 [cited by applicant]
US 20050171926A1 · Thione et al. · 2005 [cited by applicant]
US 20070074133A1 · Hara et al. · 2007 [cited by applicant]
US 20070175998A1 · Lev · 2007 [cited by applicant]
US 20080253656A1 · Schwartzberg et al. · 2008 [cited by applicant]
US 20090268076A1 · Kawamura et al. · 2009 [cited by applicant]
US 20090313584A1 · Kerr et al. · 2009 [cited by applicant]
US 20100110108A1 · Alexandersson et al. · 2010 [cited by applicant]
US 20100208999A1 · Oh et al. · 2010 [cited by applicant]
US 20110032377A1 · Kim et al. · 2011 [cited by applicant]
US 20110076003A1 · Cho et al. · 2011 [cited by applicant]
US 20110257958A1 · Kildevaeld · 2011 [cited by applicant]
US 20120310622A1 · Zivkovic et al. · 2012 [cited by applicant]
US 20130016042A1 · Makinen et al. · 2013 [cited by applicant]
US 20130093833A1 · Al-Asaaed et al. · 2013 [cited by applicant]
US 20130110494A1 · Elgazzar et al. · 2013 [cited by applicant]
US 20130117025A1 · Park et al. · 2013 [cited by applicant]
US 20130194254A1 · Miyoshi et al. · 2013 [cited by applicant]
US 20130212470A1 · Karunamuni et al. · 2013 [cited by applicant]
US 20130297287A1 · Yin · 2013 [cited by applicant]
US 20140056475A1 · Jang et al. · 2014 [cited by applicant]
US 20140062962A1 · Jang et al. · 2014 [cited by applicant]
US 20140109004A1 · Sadhvani et al. · 2014 [cited by applicant]
US 20140117076A1 · Eberlein · 2014 [cited by applicant]
US 20140156412A1 · Tse · 2014 [cited by applicant]
US 20140168056A1 · Swaminathan et al. · 2014 [cited by applicant]
US 20140192217A1 · Kim et al. · 2014 [cited by applicant]
US 20140201023A1 · Tang · 2014 [cited by applicant]
US 20140267796A1 · Jang et al. · 2014 [cited by applicant]
US 20150051898A1 · Cuthbert et al. · 2015 [cited by applicant]
US 20150268928A1 · Park et al. · 2015 [cited by applicant]
US 20150309997A1 · Lee et al. · 2015 [cited by applicant]
US 20160005189A1 · Gray et al. · 2016 [cited by applicant]
US 20160057363A1 · Posa · 2016 [cited by applicant]
US 20160063339A1 · Kwon et al. · 2016 [cited by applicant]
US 20160188181A1 · Smith · 2016 [cited by applicant]
US 20160210602A1 · Siddique et al. · 2016 [cited by applicant]
US 20160301813A1 · Swire et al. · 2016 [cited by applicant]
US 20160316147A1 · Bernstein et al. · 2016 [cited by applicant]
US 20160378277A1 · Cho · 2016 [cited by applicant]
US 20160378311A1 · Kim et al. · 2016 [cited by applicant]
US 20170039765A1 · Zhou et al. · 2017 [cited by applicant]
US 20170052939A1 · Seol · 2017 [cited by examiner]
US 20170090693A1 · Ku · 2017 [cited by examiner]
US 20170091174A1 · Rubin et al. · 2017 [cited by applicant]
US 20170134605A1 · Ju et al. · 2017 [cited by applicant]
US 20170336926A1 · Chaudhri et al. · 2017 [cited by applicant]
US 20170336960A1 · Chaudhri et al. · 2017 [cited by applicant]
US 20170365097A1 · Lim et al. · 2017 [cited by applicant]
US 20180011842A1 · Waibel et al. · 2018 [cited by applicant]
US 20180066956A1 · Kim et al. · 2018 [cited by applicant]
US 20180276203A1 · Cuthbert et al. · 2018 [cited by applicant]
US 20180284892A1 · Kwon et al. · 2018 [cited by applicant]
US 20180302568A1 · Kim et al. · 2018 [cited by applicant]
US 20180322076A1 · Prasad et al. · 2018 [cited by applicant]
US 20180349008A1 · Manzari et al. · 2018 [cited by applicant]
US 20180350144A1 · Rathod · 2018 [cited by applicant]
US 20190025999A1 · Murphy et al. · 2019 [cited by applicant]
US 20190080498A1 · Horie et al. · 2019 [cited by applicant]
US 20190084670A1 · Sharma et al. · 2019 [cited by applicant]
US 20190121522A1 · Davis et al. · 2019 [cited by applicant]
US 20190179423A1 · Rose et al. · 2019 [cited by applicant]
US 20190213212A1 · Adato et al. · 2019 [cited by applicant]
US 20190324546A1 · Lee et al. · 2019 [cited by applicant]
US 20190347144A1 · Chen et al. · 2019 [cited by applicant]
US 20200050906A1 · Mathai · 2020 [cited by applicant]
US 20200106965A1 · Malia et al. · 2020 [cited by applicant]
US 20200175975A1 · Kong et al. · 2020 [cited by applicant]
US 20200184478A1 · Peled et al. · 2020 [cited by applicant]
US 20200267267A1 · Kim et al. · 2020 [cited by applicant]
US 20200285379A1 · George-Svahn · 2020 [cited by applicant]
US 20200302135A1 · Nirmala · 2020 [cited by applicant]
US 20200341610A1 · Quintana et al. · 2020 [cited by applicant]
US 20210027471A1 · Cohen et al. · 2021 [cited by applicant]
US 20210193187A1 · Phillips et al. · 2021 [cited by applicant]
US 20210208741A1 · Yang et al. · 2021 [cited by applicant]
US 20210227145A1 · Kasugai · 2021 [cited by applicant]
US 20210263962A1 · Chang et al. · 2021 [cited by applicant]
US 20210272253A1 · Lin et al. · 2021 [cited by applicant]
US 20210279409A1 · Karunamuni et al. · 2021 [cited by applicant]
US 20210389868A1 · Crowder · 2021 [cited by applicant]
US 20220070385A1 · Van Os et al. · 2022 [cited by applicant]
US 20220078294A1 · Kim et al. · 2022 [cited by applicant]
US 20220138913A1 · Huang et al. · 2022 [cited by applicant]
US 20220150345A1 · Woo et al. · 2022 [cited by applicant]
US 20220179665A1 · Rathod · 2022 [cited by applicant]
US 20220240408A1 · Faulkner et al. · 2022 [cited by applicant]
US 20220269887A1 · Chee et al. · 2022 [cited by applicant]
US 20220319493A1 · Ohishi et al. · 2022 [cited by applicant]
US 20220334683A1 · Paul et al. · 2022 [cited by applicant]
US 20220334693A1 · De Vries et al. · 2022 [cited by applicant]
US 20220337741A1 · Paul et al. · 2022 [cited by applicant]
US 20220377248A1 · Minifie et al. · 2022 [cited by applicant]
US 20220391603A1 · Pham · 2022 [cited by examiner]
US 20230082876A1 · Guzman et al. · 2023 [cited by applicant]
US 20230136913A1 · Zhao et al. · 2023 [cited by applicant]
US 20230229279A1 · Paul · 2023 [cited by examiner]
US 20230319224A1 · Manzari et al. · 2023 [cited by applicant]
US 20230379427A1 · Manzari et al. · 2023 [cited by applicant]
US 20230393865A1 · Fleizach et al. · 2023 [cited by applicant]
US 20240078375A1 · Karunamuni et al. · 2024 [cited by applicant]
US 20240220009A1 · Dryer et al. · 2024 [cited by applicant]
US 20240340371A1 · Hua et al. · 2024 [cited by applicant]
US 20240406304A1 · Foss · 2024 [cited by examiner]
US 20250093947A1 · Bedard et al. · 2025 [cited by applicant]
US 20250113095A1 · Alonso · 2025 [cited by examiner]
US 20250238127A1 · Alonso et al. · 2025 [cited by applicant]
US 20250238128A1 · Manzari et al. · 2025 [cited by applicant]
US 20250238129A1 · Moussette et al. · 2025 [cited by applicant]
US 20250240516A1 · Zumbrunnen et al. · 2025 [cited by applicant]
CN 101609505A · 2009 [cited by applicant]
CN 103677618A · 2014 [cited by applicant]
CN 105654532A · 2016 [cited by applicant]
CN 111860479A · 2020 [cited by applicant]
CN 115914824A · 2023 [cited by applicant]
EP 1826724B1 · 2015 [cited by applicant]
EP 3833002A1 · 2021 [cited by applicant]
EP 3958101A1 · 2022 [cited by applicant]
EP 4089521A1 · 2022 [cited by applicant]
JP 2013541107A · 2013 [cited by applicant]
JP 2015228009A · 2015 [cited by applicant]
JP 2016519377A · 2016 [cited by applicant]
JP 2017513143A · 2017 [cited by applicant]
JP 2018128955A · 2018 [cited by applicant]
JP 202057204A · 2020 [cited by applicant]
KR 1020150135844A · 2015 [cited by applicant]
WO 2013169849A2 · 2013 [cited by applicant]
WO 2014159998A1 · 2014 [cited by applicant]
WO 2015105649A1 · 2015 [cited by applicant]
WO 2019054999A1 · 2019 [cited by applicant]
WO 2023116418A1 · 2023 [cited by applicant]
Aprio Editorial Department, “[Line] Useful ways to use the OCR feature, and how to easily copy and translate text within images”, Available online at: <https://appllio.com/line-how-to-use-ocr>, May 15, 2019, 14 pages (O… [cited by applicant]
Office Action received for Chinese Patent Application No. 202311577936.6, mailed on May 23, 2024, 20 pages (10 pages of English Translation and 10 pages of Official Copy). [cited by applicant]
Smahoto.jp, “An application for capturing unreadable characters in books and signboards with a camera!”, Available Online at: <https://www.kitamura.jp/smahoto/photolife/app/items/205.html>, Oct. 15, 2015, 8 pages (Offic… [cited by applicant]
Takafumi Yamazoe, “Development of character recognition technology that achieves highly accurate recognition”, Technology Reports, NTT Docomo Technical Journal vol. 20 No. 1, Telecommunications Association, Apr. 1, 2012… [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2023/014177, mailed on Sep. 19, 2024, 15 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/833,537, mailed on Sep. 9, 2024, 21 pages. [cited by applicant]
Decision to Grant received for European Patent Application No. 22720880.8, mailed on Mar. 27, 2025, 4 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2024/048985, mailed on Feb. 13, 2025, 19 pages. [cited by applicant]
Invitation to Pay Additional Fees and Partial International Search Report received for PCT Patent Application No. PCT/US2024/048985, mailed on Dec. 23, 2024, 13 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 18/441,971, mailed on Apr. 10, 2025, 39 pages. [cited by applicant]
Notice of Allowance received for Japanese Patent Application No. 2024-049961, mailed on Apr. 7, 2025, 4 pages (1 page of English Translation and 3 pages of Official Copy). [cited by applicant]
Corrected Notice of Allowance received for U.S. Appl. No. 18/125,070, mailed on Apr. 29, 2024, 2 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 18/125,070, mailed on Apr. 23, 2024, 6 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2024/043090, mailed on Jan. 28, 2025, 21 pages. [cited by applicant]
Invitation to Pay Additional Fees and Partial International Search Report received for PCT Patent Application No. PCT/US2024/043090, mailed on Dec. 4, 2024, 12 pages. [cited by applicant]
Office Action received for Japanese Patent Application No. 2024-049961, mailed on Feb. 28, 2025, 8 pages (4 pages of English Translation and 4 pages of Official Copy). [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/833,537, mailed on Oct. 21, 2024, 4 pages. [cited by applicant]
Corrected Notice of Allowance received for U.S. Appl. No. 17/484,856, mailed on Nov. 6, 2024, 2 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/484,856, mailed on Oct. 30, 2024, 9 pages. [cited by applicant]
Amazon.com, “Visual ID on Echo Show”, Online Available at: <https://www.amazon.com/b?ie=UTF8&node=23615589011>, retrieved on Aug. 16, 2023, 3 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2022/044236, mailed on Apr. 4, 2024, 12 pages. [cited by applicant]
Notice of Allowance received for Japanese Patent Application No. 2023-560220, mailed on Mar. 1, 2024, 4 pages (1 page of English Translation and 3 pages of Official Copy). [cited by applicant]
Intention to Grant received for European Patent Application No. 22720880.8, mailed on Sep. 30, 2024, 10 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/833,537, mailed on Dec. 23, 2024, 26 pages. [cited by applicant]
Intention to Grant received for European Patent Application No. 22720880.8, mailed on Nov. 20, 2024, 11 pages. [cited by applicant]
Notice of Allowance received for Chinese Patent Application No. 202311577936.6, mailed on Jan. 22, 2025, 4 pages (1 page of English Translation and 3 pages of Official Copy). [cited by applicant]
Office Action received for Australian Patent Application No. 2024201515, mailed on Dec. 11, 2024, 3 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 18/167,625, mailed on Feb. 12, 2025, 15 pages. [cited by applicant]
Casey Jonathan, “Galaxy S21 Ultra Tips For Editing Photos and Videos”, Online available at: https://www.youtube.com/watch?v=Cuym Tnn0ias, Feb. 12, 2021, 10 pages. [cited by applicant]
“Apple Previews Powerful Software Updates Designed for People with Disabilities”, Available online at: https://www.apple.com/newsroom/2021/05/apple-previews-powerful- software-updates-designed-for-people-with-disabiliti… [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/140,211, mailed on Feb. 13, 2020, 3 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/140,211, mailed on Sep. 3, 2020, 4 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/140,211, mailed on Feb. 20, 2020, 5 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/484,714, mailed on Apr. 28, 2022, 2 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/484,714, mailed on Nov. 10, 2022, 2 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/484,856, mailed on Apr. 24, 2023, 4 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/484,856, mailed on Jul. 27, 2022, 7 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/484,856, mailed on Mar. 10, 2022, 3 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/484,856, mailed on Oct. 25, 2023, 5 pages. [cited by applicant]
Corrected Notice of Allowance recieved for U.S. Appl. No. 17/484,714, mailed on Dec. 5, 2023, 3 pages. [cited by applicant]
Corrected Notice of Allowance recieved for U.S. Appl. No. 17/547,065, mailed on May 1, 2023, 9 pages. [cited by applicant]
Decision on Appeal received for U.S. Appl. No. 16/140,211, mailed on Jul. 1, 2021, 8 pages. [cited by applicant]
Ex Parte Quayle Action received for U.S. Appl. No. 17/484,844, mailed on Sep. 8, 2022, 8 pages. [cited by applicant]
Examiner's Answer to Appeal Brief received for U.S. Appl. No. 17/484,856, mailed on Sep. 6, 2023, 4 pages. [cited by applicant]
Examiner's Answer to Appeal Brief received for U.S. Appl. No. 16/140,211, mailed on Mar. 25, 2021, 21 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 16/140,211, mailed on May 26, 2020, 22 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/484,714, mailed on May 23, 2022, 22 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/484,856, mailed on Jun. 1, 2023, 31 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/484,856, mailed on Mar. 30, 2022, 26 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/484,856, mailed on Nov. 16, 2023, 29 pages. [cited by applicant]
Han, Sangwoo, “AR Glasses interaction prototype”, Available Online at: https://sangwoohan.cargo.site/AR-Glasses-interaction-prototype, Oct. 2020, 4 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2022/025096, mailed on Nov. 2, 2023, 14 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2022/025096, mailed on Sep. 26, 2022, 19 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2022/044236, mailed on Mar. 27, 2023, 17 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2023/014177, mailed on Sep. 1, 2023, 21 pages. [cited by applicant]
Invitation to Pay Additional Fees and Partial International Search Report received for PCT Patent Application No. PCT/US2023/014177, mailed on Jul. 11, 2023, 13 pages. [cited by applicant]
Invitation to Pay Additional Fees received for PCT Patent Application No. PCT/US2022/025096, mailed on Aug. 1, 2022, 11 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 16/140,211, mailed on Oct. 3, 2019, 15 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 16/140,286, mailed on Oct. 3, 2019, 14 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 16/897,551, mailed on Jun. 25, 2020, 12 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/142,134, mailed on Jul. 22, 2021, 11 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/484,714, mailed on Dec. 1, 2021, 19 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/484,714, mailed on Mar. 30, 2023, 19 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/484,856, mailed on Dec. 8, 2021, 24 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/484,856, mailed on Feb. 22, 2023, 26 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/484,856, mailed on Sep. 21, 2023, 32 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 18/125,070, mailed on Sep. 14, 2023, 13 pages. [cited by applicant]
Notice of Acceptance received for Australian Patent Application No. 2022261717, mailed on Dec. 20, 2023, 4 pages. [cited by applicant]
Notice of Acceptance received for Korean Patent Application No. 10-2023-7033711, mailed on Nov. 29, 2023, 9 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 16/140,211, mailed on Sep. 10, 2021, 10 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 16/140,286, mailed on Mar. 12, 2020, 5 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 16/897,551, mailed on Oct. 16, 2020, 5 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/142,134, mailed on Jan. 4, 2022, 5 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/484,714, mailed on May 30, 2023, 6 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/484,714, mailed on Oct. 31, 2023, 7 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/484,844, mailed on Jan. 17, 2023, 10 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/547,065, mailed on Feb. 16, 2023, 16 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 18/125,070, mailed on Feb. 6, 2024, 7 pages. [cited by applicant]
Office Action received for Australian Patent Application No. 2022261717, mailed on Nov. 6, 2023, 3 pages. [cited by applicant]
Stone, Zeda, “Could AR Be the Unlikely Savior of Print?”, Online available at: https://adage.com/article/digitalnext/ar-savior-print/308923, May 11, 2017, 4 pages. [cited by applicant]
Supplemental Notice of Allowance received for U.S. Appl. No. 17/142,134, mailed on Jan. 12, 2022, 2 pages. [cited by applicant]
“Text of 2nd CD Mixed and Augmented Reality (MAR) Reference Model”, International Organisation for Standardisation Organisation Internationale De Normalisation, ISO/IEC JTC 1/SC 29/WG 11, Coding of Moving Pictures and A… [cited by applicant]
Office Action received for Australian Patent Application No. 2024201515, mailed on May 28, 2025, 3 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 18/167,625, mailed on May 2, 2025, 3 pages. [cited by applicant]
Examiner's Answer to Appeal Brief received for U.S. Appl. No. 17/833,537, mailed on May 16, 2025, 13 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 18/167,625, mailed on Jun. 13, 2025, 16 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 18/441,971, mailed on Jul. 15, 2025, 4 pages. [cited by applicant]
Extended European Search Report received for European Patent Application No. 25164608.9, mailed on Jul. 4, 2025, 9 pages. [cited by applicant]
Timekettle, “Timekettle for ESL Students”, Online available at: https://www.timekettle.co/, Retrieved on Feb. 2025, 11 pages. [cited by applicant]
Translate with Google Pixel Buds, Online available at: https://support.google.com/googlepixelbuds/answer/7573100?hl=en, Retrieved on Feb. 2025, 2 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2025/010440, mailed on Jul. 4, 2025, 20 pages. [cited by applicant]
Invitation to Pay Additional Fees and Partial International Search Report received for PCT Patent Application No. PCT/US2025/010440, mailed on May 13, 2025, 15 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 18/892,251, mailed on Jul. 11, 2025, 28 pages. [cited by applicant]
Cited By (1)
US 12,531,036