IP Library › Granted Patent US 11,632,600
Granted Patent B2
US 11,632,600 · App. 17/716,984 · Granted Apr 18, 2023

Devices, methods, and graphical user interfaces for depth-based annotation

Inventors: Joseph A. Malia (Isle of Wight, GB); Mark K. Hauenstein (San Francisco, CA); Praveen Sharma (Brooklyn, NY); Matan Stauber (San Francisco, CA); Julian K. Missig (Burlingame, CA); Jeffrey T. Bernstein (San Francisco, CA); Lukas Robert Tom Girling (Bristol, GB); Matthaeus Krenn (Sunnyvale, CA)
Assignee: APPLE INC.
H04N23/631G06T11/00H04N23/633G06F3/0488G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,632,600
App. No.
17/716,984
Granted
Apr 18, 2023
Kind
B2
Abstract

While displaying playback of a first portion of a video in a video playback region, a device receives a request to add a first annotation to the video playback. In response to receiving the request, the device pauses playback of the video at a first position in the video and displays a still image that corresponds to the first, paused position of the video. While displaying the still image, the device receives the first annotation on a first portion of a physical environment captured in the still image. After receiving the first annotation, the device displays, in the video playback region, a second portion of the video that corresponds to a second position in the video, where the first portion of the physical environment is captured in the second portion of the video and the first annotation is displayed in the second portion of the video.

Claims (80)

1. A method, comprising:

at a device having a display generation component and one or more input devices:

displaying, via the display generation component, a user interface that includes a video playback region;

while displaying playback of a first portion of a video in the video playback region, receiving, via the one or more input devices, a first request to add a first annotation to the video playback;

in response to receiving the first request to add the first annotation:

pausing playback of the video at a first position in the video; and

displaying a still image that corresponds to the first, paused position of the video;

while displaying the still image, receiving, via the one or more input devices, the first annotation on a first portion of a physical environment captured in the still image; and

after receiving the first annotation, displaying, in the video playback region, a second portion of the video that corresponds to a second position in the video, distinct from the first position in the video, wherein the first portion of the physical environment is captured in the second portion of the video and the first annotation is displayed in the second portion of the video.

2. The method of claim 1 , wherein:

the video was captured by a camera during relative movement of the camera and the physical environment,

a third portion of the video was captured between the first portion and the second portion of the video, and does not include the first portion of the physical environment, during the relative movement of the camera and the physical environment,

the first annotation received on the still image is directed to a first object located in the first portion of the physical environment, and is displayed at a location corresponding to the first object in the second portion of the video, and

the first annotation is not displayed in the third portion of the video that does not include the first object.

3. The method of claim 1 , including:

displaying a timeline of the video, wherein displaying the second portion of the video is performed in response to a user input scrubbing through the timeline of the video to the second position in the video.

4. The method of claim 1 , including:

displaying the second portion of the video is performed as a result of rewinding of the video from the first position to the second position.

5. The method of claim 1 , including:

displaying the second portion of the video is performed as a result of fast-forwarding of the video from the first position to the second position.

6. The method of claim 1 , including:

displaying the second portion of the video is performed as a result of normal playback of the video from the first position to the second position.

7. The method of claim 1 , including:

displaying, via the display generation component, a listing of media content objects, including the video;

receiving an input selecting the video from the listing of media content objects; and

in response to receiving the input selecting the video, displaying a user interface object with the display of the video in the video playback region, wherein the user interface object is configured to receive one or more requests to add one or more annotations to the video during playback of the video.

8. A computer system, comprising:

a display generation component;

one or more input devices;

one or more processors; and

memory storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, the one or more programs including instructions for:

displaying, via the display generation component, a user interface that includes a video playback region;

while displaying playback of a first portion of a video in the video playback region, receiving, via the one or more input devices, a first request to add a first annotation to the video playback;

in response to receiving the first request to add the first annotation:

pausing playback of the video at a first position in the video; and

displaying a still image that corresponds to the first, paused position of the video;

while displaying the still image, receiving, via the one or more input devices, the first annotation on a first portion of a physical environment captured in the still image; and

after receiving the annotation, displaying, in the video playback region, a second portion of the video that corresponds to a second position in the video, distinct from the first position in the video, wherein the first portion of the physical environment is captured in the second portion of the video and the annotation is displayed in the second portion of the video.

9. The computer system of claim 8 , wherein:

the video was captured by a camera during relative movement of the camera and the physical environment,

a third portion of the video was captured between the first portion and the second portion of the video, and does not include the first portion of the physical environment, during the relative movement of the camera and the physical environment,

the first annotation received on the still image is directed to a first object located in the first portion of the physical environment, and is displayed at a location corresponding to the first object in the second portion of the video, and

the first annotation is not displayed in the third portion of the video that does not include the first object.

10. The computer system of claim 8 , wherein the one or more programs include instructions for:

displaying a timeline of the video, wherein displaying the second portion of the video is performed in response to a user input scrubbing through the timeline of the video to the second position in the video.

11. The computer system of claim 8 , wherein the one or more programs include instructions for:

displaying the second portion of the video is performed as a result of rewinding of the video from the first position to the second position.

12. The computer system of claim 8 , wherein the one or more programs include instructions for:

displaying the second portion of the video is performed as a result of fast-forwarding of the video from the first position to the second position.

13. The computer system of claim 8 , wherein the one or more programs include instructions for:

displaying the second portion of the video is performed as a result of normal playback of the video from the first position to the second position.

14. The computer system of claim 8 , wherein the one or more programs include instructions for:

displaying, via the display generation component, a listing of media content objects, including the video;

receiving an input selecting the video from the listing of media content objects; and

in response to receiving the input selecting the video, displaying a user interface object with the display of the video in the video playback region, wherein the user interface object is configured to receive one or more requests to add one or more annotations to the video during playback of the video.

15. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by a computer system with a display generation component and one or more input devices, cause the computer system to:

display, via the display generation component, a user interface that includes a video playback region;

while displaying playback of a first portion of a video in the video playback region, receive, via the one or more input devices, a first request to add a first annotation to the video playback;

in response to receiving the first request to add the first annotation:

pause playback of the video at a first position in the video; and

display a still image that corresponds to the first, paused position of the video;

while displaying the still image, receive, via the one or more input devices, the first annotation on a first portion of a physical environment captured in the still image; and

after receiving the first annotation, display, in the video playback region, a second portion of the video that corresponds to a second position in the video, distinct from the first position in the video, wherein the first portion of the physical environment is captured in the second portion of the video and the first annotation is displayed in the second portion of the video.

16. The non-transitory computer-readable storage medium of claim 15 , wherein:

the video was captured by a camera during relative movement of the camera and the physical environment,

a third portion of the video was captured between the first portion and the second portion of the video, and does not include the first portion of the physical environment, during the relative movement of the camera and the physical environment,

the first annotation received on the still image is directed to a first object located in the first portion of the physical environment, and is displayed at a location corresponding to the first object in the second portion of the video, and

the first annotation is not displayed in the third portion of the video that does not include the first object.

17. The non-transitory computer readable storage medium of claim 15 , wherein the one or more programs include instructions, which, when executed by the computer system, cause the computer system to:

display a timeline of the video, wherein displaying the second portion of the video is performed in response to a user input scrubbing through the timeline of the video to the second position in the video.

18. The non-transitory computer readable storage medium of claim 15 , wherein the one or more programs include instructions, which, when executed by the computer system, cause the computer system to:

display the second portion of the video is performed as a result of rewinding of the video from the first position to the second position.

19. The non-transitory computer readable storage medium of claim 15 , wherein the one or more programs include instructions, which, when executed by the computer system, cause the computer system to:

display the second portion of the video is performed as a result of fast-forwarding of the video from the first position to the second position.

20. The non-transitory computer readable storage medium of claim 15 , wherein the one or more programs include instructions, which, when executed by the computer system, cause the computer system to:

display the second portion of the video is performed as a result of normal playback of the video from the first position to the second position.

21. The non-transitory computer readable storage medium of claim 15 , wherein the one or more programs include instructions, which, when executed by the computer system, cause the computer system to:

display, via the display generation component, a listing of media content objects, including the video;

receive an input selecting the video from the listing of media content objects; and

in response to receiving the input selecting the video, display a user interface object with the display of the video in the video playback region, wherein the user interface object is configured to receive one or more requests to add one or more annotations to the video during playback of the video.

Continuity (4)
Continuation 16997860 · Aug 19, 2020
Continuation 16574029 · Sep 17, 2019
Provisional Application 62739178 · Sep 29, 2018
Related Publication 20220239842A1 · Jul 28, 2022