IP Library Granted Patent US 11,538,232
Granted Patent B2
US 11,538,232 · App. 16/583,041 · Granted Dec 27, 2022

Tracker assisted image capture

Inventors: Xin Zhong (San Diego, CA); Dashan Gao (San Diego, CA); Ning Bi (San Diego, CA); Steven Douglas Laver (San Diego, CA); Scott David Beith (Carlsbad, CA); Diarmuid MacCormack (Montreal, CA)
Assignee: QUALCOMM Incorporated
G06V10/25G06T7/20G06V20/49G08B13/196G11B27/02H04N5/23222H04N5/23238H04N5/23254H04N5/232945
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,538,232
App. No.
16/583,041
Granted
Dec 27, 2022
Kind
B2
Abstract

A method for picture processing is described. A first tracking area is obtained. A second tracking area is also obtained. The method includes beginning to track the first tracking area and the second tracking area. Picture processing is performed once a portion of the first tracking area overlapping the second tracking area passes a threshold.

Claims (66)

1. A method, comprising:

tracking a first tracking area corresponding to a first object associated with at least a first frame of a video sequence;

identifying a second area corresponding to a second object associated with at least the first frame of the video sequence;

determining, in the first frame, an amount of overlap between the first tracking area in the first frame and the second area in the first frame; and

replacing, in one or more frames of the video sequence, at least a portion of the first object within the first tracking area with at least a portion of the second object in response to determining that the amount of overlap between the first tracking area and the second area passes a threshold.

2. The method of claim 1 , wherein at least the portion of the first object is replaced with at least the portion of the second object once the amount of overlap becomes greater than the threshold.

3. The method of claim 1 , wherein at least the portion of the first object is replaced with at least the portion of the second object once the amount of overlap becomes less than the threshold.

4. The method of claim 1 , wherein determining the amount of overlap is based on whether the first tracking area is larger than the second area.

5. The method of claim 1 , further comprising capturing a photograph in response to determining that the amount of overlap passes the threshold.

6. The method of claim 1 , further comprising:

selecting a second frame of the video sequence, wherein the first tracking area does not overlap a corresponding replacement area in the second frame;

wherein replacing at least the portion of the first object with at least the portion of the second object includes replacing the first tracking area in the first frame with the corresponding replacement area from the second frame.

7. The method of claim 6 , wherein the second frame occurs later in time than the first frame.

8. The method of claim 6 , wherein the second frame occurs earlier in time than the first frame.

9. The method of claim 1 , further comprising:

storing the first frame as part of an edited video sequence.

10. The method of claim 1 , further comprising receiving a first user selection of the first tracking area.

11. The method of claim 10 , further comprising receiving a second user selection of the second area.

12. The method of claim 10 , wherein the first user selection is based on a shape.

13. The method of claim 12 , wherein the shape is selected by a user.

14. The method of claim 10 , wherein the first user selection is based on a selection of an object.

15. The method of claim 1 , wherein a shape associated with at least one of the first tracking area and the second area is changed based on a state of at least one of the first tracking area and the second area.

16. The method of claim 1 , wherein the second area comprises an action line, wherein the amount of overlap passes the threshold upon the first tracking area crossing the action line.

17. The method of claim 16 , wherein the action line is set by a user.

18. The method of claim 1 , wherein the second object tracked within the second area is not removed from the video sequence in response to determining that the amount of overlap between the first tracking area in the first frame and the second area in the first frame passes the threshold.

19. The method of claim 1 , wherein tracking the first tracking area includes tracking the first object, and wherein identifying the second area includes tracking the second object.

20. A device, comprising:

a memory; and

a processor coupled to the memory, the processor configured to:

track a first tracking area corresponding to a first object associated with at least a first frame of a video sequence;

identify a second area corresponding to a second object associated with at least the first frame of the video sequence;

determine, in a first frame, an amount of overlap between the first tracking area in the first frame and the second area in the first frame; and

replacing, in one or more frames of the video sequence, at least a portion of the first object within the first tracking area with at least a portion of the second object in response to determining that the amount of overlap between the first tracking area and the second area passes a threshold.

21. The device of claim 20 , wherein the processor is configured to replace at least the portion of the first object with at least the portion of the second object once the amount of overlap becomes greater than the threshold.

22. The device of claim 20 , wherein the processor is configured to replace at least the portion of the first object with at least the portion of the second object once the amount of overlap becomes less than the threshold.

23. The device of claim 20 , wherein the processor is configured to determine the amount of overlap based on whether the first tracking area is larger than the second area.

24. The device of claim 20 , wherein the processor is configured to capture a photograph in response to determining that the amount of overlap passes the threshold.

25. The device of claim 20 , wherein the processor is further configured to:

select a second frame of the video sequence, wherein the first tracking area does not overlap a corresponding replacement area in the second frame;

wherein replacing at least the portion of the first object with at least the portion of the second object includes replace the first tracking area in the first frame with the corresponding replacement area from the second frame.

26. The device of claim 25 , wherein the second frame occurs later in time than the first frame.

27. The device of claim 25 , wherein the second frame occurs earlier in time than the first frame.

28. The device of claim 20 , wherein the processor is further configured to:

store the first frame as part of an edited video sequence.

29. The device of claim 20 , wherein the processor is further configured to:

receive a first user selection of the first tracking area.

30. The device of claim 29 , wherein the processor is further configured to:

receive a second user selection of the second area.

31. The device of claim 29 , wherein the first user selection is based on a shape.

32. The device of claim 31 , wherein the shape is selected by a user.

33. The device of claim 29 , wherein the first user selection is based on a selection of an object.

34. The device of claim 20 , wherein a shape associated with at least one of the first tracking area and the second area is changed based on a state of at least one of the first tracking area and the second area.

35. The device of claim 20 , wherein the second area comprises an action line, wherein the amount of overlap passes the threshold upon the first tracking area crossing the action line.

36. The device of claim 35 , wherein the action line is set by a user.

37. The device of claim 20 , wherein the second object tracked within the second area is not removed from the video sequence in response to determining that the amount of overlap between the first tracking area in the first frame and the second area in the first frame passes the threshold.

38. The device of claim 20 , wherein, to track the first tracking area, the processor is configured to track the first object, and wherein, to identify the second area, the processor is configured to track the second object.

39. An apparatus, comprising:

means for tracking a first tracking area corresponding to a first object associated with at least a first frame of a video sequence;

means for identifying a second area corresponding to a second object associated with at least the first frame of the video sequence;

means for determining, in a first frame, an amount of overlap between the first tracking area in the first frame and the second area in the first frame; and

means for replacing, in one or more frames of the video sequence, at least a portion of the first object within the first tracking area with at least a portion of the second object in response to determining that the amount of overlap between the first tracking area and the second area passes a threshold.

40. A computer-program product, comprising a non-transitory computer-readable medium having instructions thereon, the instructions comprising:

code for causing a device to track a first tracking area corresponding to a first object associated with at least a first frame of a video sequence;

code for causing the device to identify a second area corresponding to a second object associated with at least the first frame of the video sequence;

code for causing the device to determine, in a first frame, an amount of overlap between the first tracking area in the first frame and the second area in the first frame; and

code for causing the device to replace, in one or more frames of the video sequence, at least a portion of the first object within the first tracking area with at least a portion of the second object in response to determining that the amount of overlap between the first tracking area and the second area passes a threshold.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 15, 2019
From: ZHONG, XIN; GAO, DASHAN; BI, NING; LAVER, STEVEN DOUGLAS; BEITH, SCOTT DAVID; MACCORMACK, DIARMUID
To: QUALCOMM INCORPORATED
Reel/Frame 051025/0567 →
Continuity (3)
Continuation 14036947 · Sep 25, 2013
Provisional Application 61835414 · Jun 14, 2013
Related Publication 20200019806A1 · Jan 16, 2020
Cited By (1)
US 12,423,985