IP Library › Granted Patent US 12,542,862
Granted Patent B2
US 12,542,862 · App. 18/167,625 · Granted Feb 3, 2026

User interfaces for managing visual content in a media representation

Inventors: Grant R. Paul (San Francisco, CA); James N. Jones (San Francisco, CA); Johnnie B. Manzari (San Francisco, CA); Adrian Zumbrunnen (San Francisco, CA)
Assignee: Apple Inc.
H04N5/272G06T7/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,542,862
App. No.
18/167,625
Granted
Feb 3, 2026
Kind
B2
Abstract

The present disclosure generally relates to managing media representations. In some embodiments, systems, methods, and user interfaces are provided for managing the background of a media representation, copying subjects of a media representation, converting one or more portions of a media representation, providing descriptions for one or more symbols in a media representation, and providing one or more animations for one or more detected objects and/or subjects.

Claims (138)

1 . A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, the one or more programs including instructions for:

detecting a request to display a user interface that corresponds to a media item; and

in response to detecting the request to display the user interface that corresponds to the media item, displaying, via the display generation component, the user interface that corresponds to the media item, including:

in accordance with a determination that a subject has automatically been detected in the media item without user input that identifies the subject, displaying, via the display generation component, a respective visual indication that the subject was automatically detected in the media item without user input; and

in accordance with a determination that the subject has not automatically been detected in the media item, forgoing display of the respective visual indication;

while displaying the respective visual indication that the subject was automatically detected in the media item without user input, detecting an input directed to a location of the respective visual indication; and

in response to detecting the input directed to the location of the respective visual indication, displaying, via the display generation component, a selectable user interface object that, when selected, initiates a process for copying the subject in the media item without copying another portion of the media item.

2 . The non-transitory computer-readable storage medium of claim 1 , wherein the media item is an image or a video.

3 . The non-transitory computer-readable storage medium of claim 1 , the one or more programs further including instructions for:

in response to detecting the request to display the user interface that corresponds to the media item, displaying, via the display generation component, the user interface that corresponds to the media item, including:

displaying, via the display generation component, a representation of the media item; and

in accordance with a determination that the subject has automatically been detected in the media item, selecting a boundary between the portion of the media item in the representation of the media item and the subject.

4 . The non-transitory computer-readable storage medium of claim 1 , the one or more programs further including instructions for:

in accordance with a determination that the subject has automatically been detected in the media item, displaying, via the display generation component, a second user interface object that, when selected, copies the subject in the media item without copying the portion of the media item.

5 . The non-transitory computer-readable storage medium of claim 4 , wherein the second user interface object is displayed concurrently with a third user interface object that, when selected, causes the computer system to copy the subject and the portion of the media item, and wherein the second user interface object and the third user interface object are displayed in a first menu.

6 . The non-transitory computer-readable storage medium of claim 1 , the one or more programs further including instructions for:

in response to detecting the request to display the user interface that corresponds to the media item, displaying, via the display generation component, the user interface that corresponds to the media item, including:

in accordance with a determination that the subject has automatically been detected in the media item, displaying, via the display generation component, a fourth user interface object that, when selected, causes the computer system to visually emphasize the subject relative to the portion of the media item.

7 . The non-transitory computer-readable storage medium of claim 1 , the one or more programs further including instructions for:

in response to detecting the request to display the user interface that corresponds to the media item, displaying, via the display generation component, the user interface that corresponds to the media item, including:

in accordance with a determination that the subject has automatically been detected in the media item, displaying, via the display generation component, a fifth user interface object that, when selected, causes the computer system to create a graphical user interface object that includes the subject and does not include the portion of the media item.

8 . The non-transitory computer-readable storage medium of claim 1 , wherein the user interface that corresponds to the media item is displayed in a respective application that is different from a media editing application.

9 . The non-transitory computer-readable storage medium of claim 1 , wherein the user interface that corresponds to the media item is displayed in a respective application, and wherein the respective application is a file manager application.

10 . The non-transitory computer-readable storage medium of claim 1 , wherein the user interface that corresponds to the media item is displayed in a respective application, and wherein the respective application is a file viewer application.

11 . The non-transitory computer-readable storage medium of claim 1 , wherein the user interface that corresponds to the media item is displayed in a respective application, and wherein the respective application is a productivity application.

12 . The non-transitory computer-readable storage medium of claim 1 , wherein detecting the request to display the user interface that corresponds to the media item includes detecting a pointer activation event.

13 . The non-transitory computer-readable storage medium of claim 1 , wherein displaying, via the display generation component, the user interface includes displaying, via the display generation component, a representation of the media item, the one or more programs further including instructions for:

in accordance with the determination that the subject has automatically been detected in the media item without user input that identifies the subject, displaying, via the display generation component, a first user interface object;

after detecting the request to display the user interface that corresponds to the media item and while displaying the representation of the media item and the first user interface object, detecting a first input directed to the first user interface object; and

in response to detecting the first input directed to the first user interface object and in accordance with a determination that the first input has been directed to the first user interface object for more than a predetermined period of time, displaying, via the display generation component, an indication that corresponds to the portion of the media item.

14 . The non-transitory computer-readable storage medium of claim 13 , wherein displaying the indication that corresponds to the portion of the media item includes visually deemphasizing the portion of the media item in the representation of the media item.

15 . The non-transitory computer-readable storage medium of claim 1 , wherein detecting the request to display the user interface that corresponds to the media item includes detecting a request to display a sharing user interface.

16 . The non-transitory computer-readable storage medium of claim 1 , the one or more programs further including instructions for:

in accordance with the determination that the subject has automatically been detected in the media item without user input that identifies the subject, displaying, via the display generation component, a first user interface object;

while displaying the first user interface object, detecting an input corresponding to selection of the first user interface object; and

in response to detecting the input corresponding to selection of the first user interface object, altering display of a portion of the media item in a representation of the media item without altering display of the subject in the representation of the media item, wherein altering display of the portion of the media item in the representation of the media item without altering display of the subject in the representation of the media item includes forgoing altering visual content of the media item.

17 . The non-transitory computer-readable storage medium of claim 1 , the one or more programs further including instructions for:

in accordance with the determination that the subject has automatically been detected in the media item without user input that identifies the subject, displaying, via the display generation component, a first user interface object, wherein the first user interface object is overlaid on one or more portions of a representation of the media item.

18 . The non-transitory computer-readable storage medium of claim 1 , the one or more programs further including instructions for:

in accordance with the determination that the subject has automatically been detected in the media item without user input that identifies the subject, displaying, via the display generation component, a first user interface object;

while displaying the first user interface object, detecting a second input directed to the first user interface object; and

in response to detecting the second input directed to the first user interface object:

in accordance with a determination that display of the portion of the media item in a representation of the media item and display of the subject in the media item in the representation of the media item is not altered, altering display of the portion of the media item in the representation of the media item without altering display of the subject in the media item in the representation of the media item; and

in accordance with a determination that display of the portion of the media item in the representation of the media item is altered without display of the subject in the media item in the representation of the media item being altered, forgoing altering display of the portion of the media item in the representation of the media item without altering display of the subject in the media item in the representation of the media item.

19 . The non-transitory computer-readable storage medium of claim 1 , wherein the request to display the user interface that corresponds to the media item is a request to display a second menu.

20 . The non-transitory computer-readable storage medium of claim 1 , the one or more programs further including instructions for:

in accordance with the determination that the subject has automatically been detected in the media item without user input that identifies the subject, displaying, via the display generation component, a first user interface object;

while displaying the first user interface object, detecting a third input directed to the first user interface object; and

in response to detecting the third input directed to the first user interface object, displaying a second representation of the media item that includes the subject and does not include the portion of the media item.

21 . The non-transitory computer-readable storage medium of claim 20 , the one or more programs further including instructions for:

in response to detecting the third input directed to the first user interface object, displaying a sixth user interface object that, when selected, displays a third representation of the media item that includes the subject and includes the portion of the media item.

22 . A method, comprising:

at a computer system that is in communication with a display generation component:

detecting a request to display a user interface that corresponds to a media item; and

in response to detecting the request to display the user interface that corresponds to the media item, displaying, via the display generation component, the user interface that corresponds to the media item, including:

in accordance with a determination that a subject has automatically been detected in the media item without user input that identifies the subject, displaying, via the display generation component, a respective visual indication that the subject was automatically detected in the media item without user input; and

in accordance with a determination that the subject has not automatically been detected in the media item, forgoing display of the respective visual indication;

while displaying the respective visual indication that the subject was automatically detected in the media item without user input, detecting an input directed to a location of the respective visual indication; and

in response to detecting the input directed to the location of the respective visual indication, displaying, via the display generation component, a selectable user interface object that, when selected, initiates a process for copying the subject in the media item without copying another portion of the media item.

23 . A computer system that is configured to communicate with a display generation component, the computer system comprising:

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:

detecting a request to display a user interface that corresponds to a media item; and

in response to detecting the request to display the user interface that corresponds to the media item, displaying, via the display generation component, the user interface that corresponds to the media item, including:

in accordance with a determination that a subject has automatically been detected in the media item without user input that identifies the subject, displaying, via the display generation component, a respective visual indication that the subject was automatically detected in the media item without user input; and

in accordance with a determination that the subject has not automatically been detected in the media item, forgoing display of respective visual indication;

while displaying the respective visual indication that the subject was automatically detected in the media item without user input, detecting an input directed to a location of the respective visual indication; and

in response to detecting the input directed to the location of the respective visual indication, displaying, via the display generation component, a selectable user interface object that, when selected, initiates a process for copying the subject in the media item without copying another portion of the media item.

24 . The method of claim 22 , further comprising:

in response to detecting the request to display the user interface that corresponds to the media item, displaying, via the display generation component, the user interface that corresponds to the media item, including:

displaying, via the display generation component, a representation of the media item; and

in accordance with a determination that the subject has automatically been detected in the media item, selecting a boundary between the portion of the media item in the representation of the media item and the subject.

25 . The method of claim 22 , further comprising:

in accordance with a determination that the subject has automatically been detected in the media item, displaying, via the display generation component, a second user interface object that, when selected, copies the subject in the media item without copying the portion of the media item.

26 . The method of claim 22 , further comprising:

in response to detecting the request to display the user interface that corresponds to the media item, displaying, via the display generation component, the user interface that corresponds to the media item, including:

in accordance with a determination that the subject has automatically been detected in the media item, displaying, via the display generation component, a fourth user interface object that, when selected, causes the computer system to visually emphasize the subject relative to the portion of the media item.

27 . The method of claim 22 , further comprising:

in response to detecting the request to display the user interface that corresponds to the media item, displaying, via the display generation component, the user interface that corresponds to the media item, including:

in accordance with a determination that the subject has automatically been detected in the media item, displaying, via the display generation component, a fifth user interface object that, when selected, causes the computer system to create a graphical user interface object that includes the subject and does not include the portion of the media item.

28 . The method of claim 22 , wherein the user interface that corresponds to the media item is displayed in a respective application that is different from a media editing application.

29 . The method of claim 22 , wherein displaying, via the display generation component, the user interface includes displaying, via the display generation component, a representation of the media item, the method further comprising:

in accordance with the determination that the subject has automatically been detected in the media item without user input that identifies the subject, displaying, via the display generation component, a first user interface object;

after detecting the request to display the user interface that corresponds to the media item and while displaying the representation of the media item and the first user interface object, detecting a first input directed to the first user interface object; and

in response to detecting the first input directed to the first user interface object and in accordance with a determination that the first input has been directed to the first user interface object for more than a predetermined period of time, displaying, via the display generation component, an indication that corresponds to the portion of the media item.

30 . The method of claim 22 , wherein detecting the request to display the user interface that corresponds to the media item includes detecting a request to display a sharing user interface.

31 . The method of claim 22 , further comprising:

in accordance with the determination that the subject has automatically been detected in the media item without user input that identifies the subject, displaying, via the display generation component, a first user interface object;

while displaying the first user interface object, detecting an input corresponding to selection of the first user interface object; and

in response to detecting the input corresponding to selection of the first user interface object, altering display of a portion of the media item in a representation of the media item without altering display of the subject in the representation of the media item, wherein altering display of the portion of the media item in the representation of the media item without altering display of the subject in the representation of the media item includes forgoing altering visual content of the media item.

32 . The method of claim 22 , further comprising:

in accordance with the determination that the subject has automatically been detected in the media item without user input that identifies the subject, displaying, via the display generation component, a first user interface object, wherein the first user interface object is overlaid on one or more portions of a representation of the media item.

33 . The method of claim 22 , further comprising:

in accordance with the determination that the subject has automatically been detected in the media item without user input that identifies the subject, displaying, via the display generation component, a first user interface object;

while displaying the first user interface object, detecting a second input directed to the first user interface object; and

in response to detecting the second input directed to the first user interface object:

in accordance with a determination that display of the portion of the media item in a representation of the media item and display of the subject in the media item in the representation of the media item is not altered, altering display of the portion of the media item in the representation of the media item without altering display of the subject in the media item in the representation of the media item; and

in accordance with a determination that display of the portion of the media item in the representation of the media item is altered without display of the subject in the media item in the representation of the media item being altered, forgoing altering display of the portion of the media item in the representation of the media item without altering display of the subject in the media item in the representation of the media item.

34 . The method of claim 22 , wherein the request to display the user interface that corresponds to the media item is a request to display a second menu.

35 . The method of claim 22 , further comprising:

in accordance with the determination that the subject has automatically been detected in the media item without user input that identifies the subject, displaying, via the display generation component, a first user interface object;

while displaying the first user interface object, detecting a third input directed to the first user interface object; and

in response to detecting the third input directed to the first user interface object, displaying a second representation of the media item that includes the subject and does not include the portion of the media item.

36 . The computer system of claim 23 , the one or more programs further including instructions for:

in response to detecting the request to display the user interface that corresponds to the media item, displaying, via the display generation component, the user interface that corresponds to the media item, including:

displaying, via the display generation component, a representation of the media item; and

in accordance with a determination that the subject has automatically been detected in the media item, selecting a boundary between the portion of the media item in the representation of the media item and the subject.

37 . The computer system of claim 23 , the one or more programs further including instructions for:

in accordance with a determination that the subject has automatically been detected in the media item, displaying, via the display generation component, a second user interface object that, when selected, copies the subject in the media item without copying the portion of the media item.

38 . The computer system of claim 23 , the one or more programs further including instructions for:

in response to detecting the request to display the user interface that corresponds to the media item, displaying, via the display generation component, the user interface that corresponds to the media item, including:

in accordance with a determination that the subject has automatically been detected in the media item, displaying, via the display generation component, a fourth user interface object that, when selected, causes the computer system to visually emphasize the subject relative to the portion of the media item.

39 . The computer system of claim 23 , the one or more programs further including instructions for:

in response to detecting the request to display the user interface that corresponds to the media item, displaying, via the display generation component, the user interface that corresponds to the media item, including:

in accordance with a determination that the subject has automatically been detected in the media item, displaying, via the display generation component, a fifth user interface object that, when selected, causes the computer system to create a graphical user interface object that includes the subject and does not include the portion of the media item.

40 . The computer system of claim 23 , wherein the user interface that corresponds to the media item is displayed in a respective application that is different from a media editing application.

41 . The computer system of claim 23 , wherein displaying, via the display generation component, the user interface includes displaying, via the display generation component, a representation of the media item, the one or more programs further including instructions for:

in accordance with the determination that the subject has automatically been detected in the media item without user input that identifies the subject, displaying, via the display generation component, a first user interface object;

after detecting the request to display the user interface that corresponds to the media item and while displaying the representation of the media item and the first user interface object, detecting a first input directed to the first user interface object; and

in response to detecting the first input directed to the first user interface object and in accordance with a determination that the first input has been directed to the first user interface object for more than a predetermined period of time, displaying, via the display generation component, an indication that corresponds to the portion of the media item.

42 . The computer system of claim 23 , wherein detecting the request to display the user interface that corresponds to the media item includes detecting a request to display a sharing user interface.

43 . The computer system of claim 23 , the one or more programs further including instructions for:

in accordance with the determination that the subject has automatically been detected in the media item without user input that identifies the subject, displaying, via the display generation component, a first user interface object;

while displaying the first user interface object, detecting an input corresponding to selection of the first user interface object; and

in response to detecting the input corresponding to selection of the first user interface object, altering display of a portion of the media item in a representation of the media item without altering display of the subject in the representation of the media item, wherein altering display of the portion of the media item in the representation of the media item without altering display of the subject in the representation of the media item includes forgoing altering visual content of the media item.

44 . The computer system of claim 23 , the one or more programs further including instructions for:

in accordance with the determination that the subject has automatically been detected in the media item without user input that identifies the subject, displaying, via the display generation component, a first user interface object, wherein the first user interface object is overlaid on one or more portions of a representation of the media item.

45 . The computer system of claim 23 , the one or more programs further including instructions for:

in accordance with the determination that the subject has automatically been detected in the media item without user input that identifies the subject, displaying, via the display generation component, a first user interface object;

while displaying the first user interface object, detecting a second input directed to the first user interface object; and

in response to detecting the second input directed to the first user interface object:

in accordance with a determination that display of the portion of the media item in a representation of the media item and display of the subject in the media item in the representation of the media item is not altered, altering display of the portion of the media item in the representation of the media item without altering display of the subject in the media item in the representation of the media item; and

in accordance with a determination that display of the portion of the media item in the representation of the media item is altered without display of the subject in the media item in the representation of the media item being altered, forgoing altering display of the portion of the media item in the representation of the media item without altering display of the subject in the media item in the representation of the media item.

46 . The computer system of claim 23 , wherein the request to display the user interface that corresponds to the media item is a request to display a second menu.

47 . The computer system of claim 23 , the one or more programs further including instructions for:

in accordance with the determination that the subject has automatically been detected in the media item without user input that identifies the subject, displaying, via the display generation component, a first user interface object;

while displaying the first user interface object, detecting a third input directed to the first user interface object; and

in response to detecting the third input directed to the first user interface object, displaying a second representation of the media item that includes the subject and does not include the portion of the media item.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 11, 2023
From: MANZARI, BEHKISH J.; PAUL, GRANT R.; JONES, JAMES N.; ZUMBRUNNEN, ADRIAN
To: APPLE INC.
Reel/Frame 063293/0263 →
Continuity (3)
Provisional Application 63349086 · Jun 4, 2022
Provisional Application 63318678 · Mar 10, 2022
Related Publication 20230319224A1 · Oct 5, 2023
References Cited (236)
US 7542971B2 · Thione et al. · 2009 [cited by applicant]
US 7575171B2 · Lev · 2009 [cited by applicant]
US 7908564B2 · Hara et al. · 2011 [cited by applicant]
US 8286102B1 · Wilensky · 2012 [cited by examiner]
US 8391697B2 · Cho et al. · 2013 [cited by applicant]
US 9075520B2 · Park et al. · 2015 [cited by applicant]
US 9332182B2 · Nonaka et al. · 2016 [cited by applicant]
US 9350924B2 · Posa · 2016 [cited by applicant]
US 9541407B1 · Mohler · 2017 [cited by applicant]
US 9600153B2 · Roh · 2017 [cited by applicant]
US 9900515B2 · Kim et al. · 2018 [cited by applicant]
US 9996976B2 · Zhou et al. · 2018 [cited by applicant]
US 10444975B2 · Murphy et al. · 2019 [cited by applicant]
US 10488218B2 · Kim et al. · 2019 [cited by applicant]
US 10503820B2 · Duggan et al. · 2019 [cited by applicant]
US 10534475B2 · Yoo et al. · 2020 [cited by applicant]
US 10572215B1 · Cooper et al. · 2020 [cited by applicant]
US 10656823B2 · Mukherjee et al. · 2020 [cited by applicant]
US 10671834B2 · Adato et al. · 2020 [cited by applicant]
US 10748345B2 · Zhou · 2020 [cited by applicant]
US 10762716B1 · Paul et al. · 2020 [cited by applicant]
US 10882613B2 · Sharma et al. · 2021 [cited by applicant]
US 10891800B1 · Stoyles et al. · 2021 [cited by applicant]
US 10902277B2 · Agarwal · 2021 [cited by examiner]
US 10929443B2 · Grochocki et al. · 2021 [cited by applicant]
US 10943382B2 · Shapiro et al. · 2021 [cited by applicant]
US 11107219B2 · Cohen · 2021 [cited by examiner]
US 11112963B2 · Chaudhri et al. · 2021 [cited by applicant]
US 11223728B2 · Kim et al. · 2022 [cited by applicant]
US 11227494B1 · Stoyles et al. · 2022 [cited by applicant]
US 11231832B2 · Yang et al. · 2022 [cited by applicant]
US 11670023B2 · Xu · 2023 [cited by examiner]
US 12001642B2 · Paul et al. · 2024 [cited by applicant]
US 20040201720A1 · Robins et al. · 2004 [cited by applicant]
US 20050171926A1 · Thione et al. · 2005 [cited by applicant]
US 20070074133A1 · Hara et al. · 2007 [cited by applicant]
US 20070175998A1 · Lev · 2007 [cited by applicant]
US 20080253656A1 · Schwartzberg et al. · 2008 [cited by applicant]
US 20090313584A1 · Kerr et al. · 2009 [cited by applicant]
US 20100110108A1 · Alexandersson et al. · 2010 [cited by applicant]
US 20100208999A1 · Oh et al. · 2010 [cited by applicant]
US 20110076003A1 · Cho et al. · 2011 [cited by applicant]
US 20110257958A1 · Kildevaeld · 2011 [cited by applicant]
US 20130016042A1 · Makinen et al. · 2013 [cited by applicant]
US 20130093833A1 · Al-Asaaed et al. · 2013 [cited by applicant]
US 20130117025A1 · Park et al. · 2013 [cited by applicant]
US 20130194254A1 · Miyoshi · 2013 [cited by examiner]
US 20130212470A1 · Karunamuni et al. · 2013 [cited by applicant]
US 20140056475A1 · Jang et al. · 2014 [cited by applicant]
US 20140062962A1 · Jang et al. · 2014 [cited by applicant]
US 20140109004A1 · Sadhvani et al. · 2014 [cited by applicant]
US 20140117076A1 · Eberlein · 2014 [cited by applicant]
US 20140156412A1 · Tse · 2014 [cited by applicant]
US 20140168056A1 · Swaminathan et al. · 2014 [cited by applicant]
US 20140201023A1 · Tang · 2014 [cited by examiner]
US 20140267796A1 · Jang et al. · 2014 [cited by applicant]
US 20150268928A1 · Park et al. · 2015 [cited by applicant]
US 20160005189A1 · Gray et al. · 2016 [cited by applicant]
US 20160057363A1 · Posa · 2016 [cited by examiner]
US 20160063339A1 · Kwon et al. · 2016 [cited by applicant]
US 20160188181A1 · Smith · 2016 [cited by applicant]
US 20160210602A1 · Siddique · 2016 [cited by examiner]
US 20160301813A1 · Swire · 2016 [cited by examiner]
US 20160316147A1 · Bernstein et al. · 2016 [cited by applicant]
US 20160378277A1 · Cho · 2016 [cited by applicant]
US 20160378311A1 · Kim et al. · 2016 [cited by applicant]
US 20170039765A1 · Zhou et al. · 2017 [cited by applicant]
US 20170052939A1 · Seol et al. · 2017 [cited by applicant]
US 20170090693A1 · Ku et al. · 2017 [cited by applicant]
US 20170134605A1 · Ju et al. · 2017 [cited by applicant]
US 20170336926A1 · Chaudhri et al. · 2017 [cited by applicant]
US 20170336960A1 · Chaudhri et al. · 2017 [cited by applicant]
US 20170365097A1 · Lim et al. · 2017 [cited by applicant]
US 20180066956A1 · Kim et al. · 2018 [cited by applicant]
US 20180284892A1 · Kwon et al. · 2018 [cited by applicant]
US 20180302568A1 · Kim et al. · 2018 [cited by applicant]
US 20180322076A1 · Prasad et al. · 2018 [cited by applicant]
US 20180349008A1 · Manzari · 2018 [cited by examiner]
US 20180350144A1 · Rathod · 2018 [cited by applicant]
US 20190025999A1 · Murphy et al. · 2019 [cited by applicant]
US 20190080498A1 · Horie · 2019 [cited by examiner]
US 20190084670A1 · Sharma et al. · 2019 [cited by applicant]
US 20190121522A1 · Davis et al. · 2019 [cited by applicant]
US 20190179423A1 · Rose et al. · 2019 [cited by applicant]
US 20190213212A1 · Adato et al. · 2019 [cited by applicant]
US 20190324546A1 · Lee et al. · 2019 [cited by applicant]
US 20190347144A1 · Chen et al. · 2019 [cited by applicant]
US 20200050906A1 · Mathai · 2020 [cited by applicant]
US 20200106965A1 · Malia et al. · 2020 [cited by applicant]
US 20200175975A1 · Kong · 2020 [cited by examiner]
US 20200184478A1 · Peled et al. · 2020 [cited by applicant]
US 20200267267A1 · Kim et al. · 2020 [cited by applicant]
US 20200285379A1 · George-svahn · 2020 [cited by applicant]
US 20200302135A1 · Nirmala · 2020 [cited by applicant]
US 20200341610A1 · Quintana et al. · 2020 [cited by applicant]
US 20210027471A1 · Cohen · 2021 [cited by examiner]
US 20210193187A1 · Phillips et al. · 2021 [cited by applicant]
US 20210208741A1 · Yang et al. · 2021 [cited by applicant]
US 20210227145A1 · Kasugai · 2021 [cited by applicant]
US 20210263962A1 · Chang · 2021 [cited by examiner]
US 20210272253A1 · Lin · 2021 [cited by examiner]
US 20210279409A1 · Karunamuni et al. · 2021 [cited by applicant]
US 20210389868A1 · Crowder · 2021 [cited by applicant]
US 20220070385A1 · Van Os · 2022 [cited by examiner]
US 20220078294A1 · Kim et al. · 2022 [cited by applicant]
US 20220138913A1 · Huang · 2022 [cited by examiner]
US 20220179665A1 · Rathod · 2022 [cited by examiner]
US 20220240408A1 · Faulkner et al. · 2022 [cited by applicant]
US 20220269887A1 · Chee et al. · 2022 [cited by applicant]
US 20220319493A1 · Ohishi et al. · 2022 [cited by applicant]
US 20220334683A1 · Paul et al. · 2022 [cited by applicant]
US 20220334693A1 · De Vries et al. · 2022 [cited by applicant]
US 20220337741A1 · Paul et al. · 2022 [cited by applicant]
US 20220377248A1 · Minifie et al. · 2022 [cited by applicant]
US 20220391603A1 · Pham et al. · 2022 [cited by applicant]
US 20230082876A1 · Guzman et al. · 2023 [cited by applicant]
US 20230136913A1 · Zhao · 2023 [cited by examiner]
US 20230229279A1 · Paul et al. · 2023 [cited by applicant]
US 20230379427A1 · Manzari et al. · 2023 [cited by applicant]
US 20230393865A1 · Fleizach et al. · 2023 [cited by applicant]
US 20240078375A1 · Karunamuni et al. · 2024 [cited by applicant]
US 20240220009A1 · Dryer et al. · 2024 [cited by applicant]
US 20240256100A1 · Paul et al. · 2024 [cited by applicant]
US 20240406304A1 · Foss et al. · 2024 [cited by applicant]
US 20250093947A1 · Bedard et al. · 2025 [cited by applicant]
US 20250113095A1 · Alonso et al. · 2025 [cited by applicant]
US 20250238127A1 · Alonso et al. · 2025 [cited by applicant]
US 20250238128A1 · Manzari et al. · 2025 [cited by applicant]
US 20250238129A1 · Moussette et al. · 2025 [cited by applicant]
US 20250240516A1 · Zumbrunnen et al. · 2025 [cited by applicant]
CN 101609505A · 2009 [cited by applicant]
CN 103677618A · 2014 [cited by applicant]
CN 105654532A · 2016 [cited by applicant]
CN 111860479A · 2020 [cited by applicant]
EP 1826724B1 · 2015 [cited by applicant]
EP 3833002A1 · 2021 [cited by applicant]
EP 3958101A1 · 2022 [cited by applicant]
JP 2013541107A · 2013 [cited by applicant]
JP 2015228009A · 2015 [cited by applicant]
JP 2016519377A · 2016 [cited by applicant]
JP 2017513143A · 2017 [cited by applicant]
JP 2018128955A · 2018 [cited by applicant]
JP 202057204A · 2020 [cited by applicant]
KR 1020150135844A · 2015 [cited by applicant]
WO 2013169849A2 · 2013 [cited by applicant]
WO 2014159998A1 · 2014 [cited by applicant]
WO 2015105649A1 · 2015 [cited by applicant]
WO 2019054999A1 · 2019 [cited by applicant]
Galaxy S21 Ultra Tips for Editing Photos and Videos Jonathan Casey Feb. 12, 2021 https://www.youtube.com/watch?v=CuymTnn0ias (Year: 2021). [cited by examiner]
Intention to Grant received for European Patent Application No. 22720880.8, mailed on Sep. 30, 2024, 10 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2023/014177, mailed on Sep. 19, 2024, 15 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/484,856, mailed on Apr. 24, 2023, 4 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/484,856, mailed on Oct. 25, 2023, 5 pages. [cited by applicant]
amazon.com, “Visual ID on Echo Show”, Online Available at: <https://www.amazon.com/b?ie=UTF8&node=23615589011>, retrieved on Aug. 16, 2023, 3 pages. [cited by applicant]
Corrected Notice of Allowance received for U.S. Appl. No. 17/484,714, mailed on Dec. 5, 2023, 3 pages. [cited by applicant]
Corrected Notice of Allowance received for U.S. Appl. No. 17/547,065, mailed on May 1, 2023, 9 pages. [cited by applicant]
Examiner-Initiated Interview Summary received for U.S. Appl. No. 17/484,856, mailed on Sep. 6, 2023, 4 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/484,856, mailed on Jun. 1, 2023. 31 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/484,856, mailed on Nov. 16, 2023, 29 pages. [cited by applicant]
Han Sangwoo, “AR Glasses interaction prototype”, Available Online at: https://sangwoohan.cargo.site/AR-Glasses-interaction-prototype, Oct. 2020, 4 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2022/025096, mailed on Nov. 2, 2023, 14 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2022/044236, mailed on Mar. 27, 2023, 17 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2023/014177, mailed on Sep. 1, 2023, 21 pages. [cited by applicant]
Invitation to Pay Additional Fees and Partial International Search Report received for PCT Patent Application No. PCT/US2023/014177, mailed on Jul. 11, 2023, 13 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/484,714, mailed on Mar. 30, 2023. 19 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/484,856, mailed on Sep. 21, 2023, 32 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 18/125,070, mailed on Sep. 14, 2023, 13 pages. [cited by applicant]
Notice of Acceptance received for Australian Patent Application No. 2022261717, mailed on Dec. 20, 2023, 4 pages. [cited by applicant]
Notice of Allowance received for Korean Patent Application No. 10-2023-7033711, mailed on Nov. 29, 2023, 9 pages (2 pages of English Translation and 7 pages of Official Copy). [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/484,714, mailed on May 30, 2023, 6 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/484,714, mailed on Oct. 31, 2023, 7 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 18/125,070, mailed on Feb. 6, 2024, 7 pages. [cited by applicant]
Office Action received for Australian Patent Application No. 2022261717, mailed on Nov. 6, 2023, 3 pages,. [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2022/044236, mailed on Apr. 4, 2024, 12 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 18/125,070, mailed on Apr. 23, 2024, 6 pages. [cited by applicant]
Apple Previews Powerful Software Updates Designed for People with Disabilities, Available online at: https://www.apple.com/newsroom/2021/05/apple-previews-powerful-software-updates-designed-for-people-with-disabilities/… [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/140,211, mailed on Feb. 13, 2020, 3 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/140,211, mailed on Sep. 3, 2020, 4 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/140,286, mailed on Feb. 20, 2020, 5 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/484,714, mailed on Apr. 28, 2022, 2 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/484,714, mailed on Nov. 10, 2022, 2 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/484,856, mailed on Jul. 27, 2022, 7 pages. [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/484,856, mailed on Mar. 10, 2022, 3 pages. [cited by applicant]
Decision on Appeal received for U.S. Appl. No. 16/140,211, mailed on Jul. 1, 2021, 8 pages. [cited by applicant]
Ex Parte Quayle Action received for U.S. Appl. No. 17/484,844, mailed on Sep. 8, 2022, 8 pages. [cited by applicant]
Examiner's Answer to Appeal Brief received for U.S. Appl. No. 16/140,211, mailed on Mar. 25, 2021, 21 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 16/140,211, mailed on May 26, 2020, 22 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/484,714, mailed on May 23, 2022, 22 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/484,856, mailed on Mar. 30, 2022, 26 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2022/025096, mailed on Sep. 26, 2022, 19 pages. [cited by applicant]
Invitation to Pay Additional Fees received for PCT Patent Application No. PCT/US2022/025096, mailed on Aug. 1, 2022, 11 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 16/140,211, mailed on Oct. 3, 2019, 15 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 16/140,286, mailed on Oct. 3, 2019, 14 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 16/897,551, mailed on Jun. 25, 2020, 12 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/142,134, mailed on Jul. 22, 2021, 11 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/484,714, mailed on Dec. 1, 2021, 19 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/484,856, mailed on Dec. 8, 2021, 24 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/484,856, mailed on Feb. 22, 2023, 26 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 16/140,211, mailed on Sep. 10, 2021, 10 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 16/140,286, mailed on Mar. 12, 2020, 5 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 16/897,551, mailed on Oct. 16, 2020, 5 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/142,134, mailed on Jan. 4, 2022, 5 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/484,844, mailed on Jan. 17, 2023, 10 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/547,065, mailed on Feb. 16, 2023, 16 pages. [cited by applicant]
Supplemental Notice of Allowance received for U.S. Appl. No. 17/142,134, mailed on Jan. 12, 2022, 2 pages. [cited by applicant]
Text of 2nd CD Mixed and Augmented Reality (MAR) Reference Model, International Organisation for Standardisation Organisation Internationale De Normalisation, ISO/IEC JTC 1/SC 29/WG 11, Coding of Moving Pictures and Aud… [cited by applicant]
Stone Zeda, “Could AR Be the Unlikely Savior of Print?”, Online available at: https://adage.com/article/digitalnext/ar-savior-print/308923, May 11, 2017, 4 pages. [cited by applicant]
Aprio Editorial Department, “[Line] Useful ways to use the OCR feature, and how to easily copy and translate text within images”, Available online at: <https://appllio.com/line-how-to-use-ocr>, May 15, 2019, 14 pages (O… [cited by applicant]
Office Action received for Chinese Patent Application No. 202311577936.6, mailed on May 23, 2024, 20 pages (10 pages of English Translation and 10 pages of Official Copy). [cited by applicant]
Smahoto.JP, “An application for capturing unreadable characters in books and signboards with a camera!”, Available Online at: <https://www.kitamura.jp/smahoto/photolife/app/items/205.html>, Oct. 15, 2015, 8 pages (Offic… [cited by applicant]
Takafumi, Yamazoe, “Development of character recognition technology that achieves highly accurate recognition”, Technology Reports, NTT DOCOMO Technical Journal, vol. 20, No. 1. Telecommunications Association, Apr. 1, 2… [cited by applicant]
Corrected Notice of Allowance received for U.S. Appl. No. 18/125,070, mailed on Apr. 29, 2024, 2 pages. [cited by applicant]
Notice of Allowance received for Japanese Patent Application No. 2023-560220, mailed on Mar. 1, 2024, 4 pages (1 page of English Translation and 3 pages of Official Copy). [cited by applicant]
Corrected Notice of Allowance received for U.S. Appl. No. 17/484,856, mailed on Nov. 6, 2024, 2 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/484,856, mailed on Oct. 30, 2024, 9 pages. [cited by applicant]
Intention to Grant received for European Patent Application No. 22720880.8, mailed on Nov. 20, 2024, 11 pages. [cited by applicant]
Office Action received for Australian Patent Application No. 2024201515, mailed on Dec. 11, 2024, 3 pages. [cited by applicant]
Decision to Grant received for European Patent Application No. 22720880.8, mailed on Mar. 27, 2025, 4 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2024/043090, mailed on Jan. 28, 2025, 21 pages. [cited by applicant]
Invitation to Pay Additional Fees and Partial International Search Report received for PCT Patent Application No. PCT/US2024/043090, mailed on Dec. 4, 2024, 12 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 18/441,971, mailed on Apr. 10, 2025, 39 pages. [cited by applicant]
Notice of Allowance received for Chinese Patent Application No. 202311577936.6, mailed on Jan. 22, 2025, 4 pages (1 page of English Translation and 3 pages of Official Copy). [cited by applicant]
Notice of Allowance received for Japanese Patent Application No. 2024-049961, mailed on Apr. 7, 2025, 4 pages (1 page of English Translation and 3 pages of Official Copy). [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 18/611,216, mailed on May 12, 2025, 8 pages. [cited by applicant]
Office Action received for Japanese Patent Application No. 2024-049961, mailed on Feb. 28, 2025, 8 pages (4 pages of English Translation and 4 pages of Official Copy). [cited by applicant]
Applicant-Initiated Interview Summary received for U.S. Appl. No. 18/441,971, mailed on Jul. 15, 2025, 4 pages. [cited by applicant]
Corrected Notice of Allowance received for U.S. Appl. No. 18/611,216, mailed on Jul. 31, 2025, 5 pages. [cited by applicant]
Corrected Notice of Allowance received for U.S. Appl. No. 18/611,216, mailed on Jun. 24, 2025, 2 pages. [cited by applicant]
Extended European Search Report received for European Patent Application No. 25164608.9, mailed on Jul. 4, 2025, 9 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2025/010440, mailed on Jul. 4, 2025, 20 pages. [cited by applicant]
Invitation to Pay Additional Fees and Partial International Search Report received for PCT Patent Application No. PCT/US2025/010440, maiied on May 13, 2025, 15 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 18/892,251, mailed on Jul. 11, 2025, 28 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 18/441,971, mailed on Aug. 5, 2025, 11 pages. [cited by applicant]
Office Action received for Australian Patent Application No. 2024201515, mailed on May 28, 2025, 3 pages. [cited by applicant]
Corrected Notice of Allowance received for U.S. Appl. No. 18/441,971, mailed on Aug. 21, 2025, 2 pages. [cited by applicant]
Corrected Notice of Allowance received for U.S. Appl. No. 18/611,216, mailed on Aug. 11, 2025, 2 pages. [cited by applicant]