IP Library Granted Patent US 10,592,762
Granted Patent B2
US 10,592,762 · App. 15/886,653 · Granted Mar 17, 2020

Metadata based interest point detection

Inventors: David Parry (Mountain View, CA); Aaron Meyers (Menlo Park, CA); Bobby Yang (San Jose, CA)
Assignee: SMUGMUG, INC.
G06K9/3233G06F16/438G06F16/9577G06K9/00228G06K9/00677G06T1/0007G06T7/10H04L67/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,592,762
App. No.
15/886,653
Granted
Mar 17, 2020
Kind
B2
Abstract

Embodiments disclosed herein generally relate to a method, system, and computer readable medium for generating a thumbnail for a media file. A web client application server receives the media file having metadata associated therewith. The web client application server generates an interest point area. The interest point area includes one or more interest points in the media file. The web client application server aligns a thumbnail area with respect to the interest point area. The web client application server displays a portion of the media file in the thumbnail area. The portion of the media file that is displayed includes at least a portion of the interest point area.

Claims (172)

1. A method of generating a thumbnail for a media file, comprising:

receiving the media file having metadata associated therewith;

generating an interest point area, wherein the interest point area includes one or more interest points in the media file;

aligning a thumbnail area with respect to the interest point area, wherein aligning a thumbnail area with respect to the interest point area comprises:

determining an orientation of the media file;

responsive to determining that the orientation is a landscape orientation, preserving a height of the media file;

determining a width of both the thumbnail area and the interest point area; and

responsive to determining that the width of the interest point area is greater than or equal to a scalar multiple of the width of the thumbnail area, aligning a center of the thumbnail area with a center of the interest point area; and

displaying a portion of the media file in the thumbnail area, wherein the portion of the media file that is displayed includes at least a portion of the interest point area.

2. The method of claim 1 , wherein generating an interest point area comprises:

scanning the metadata associated with the media file to determine the one or more interest points.

3. The method of claim 1 , wherein aligning a thumbnail area with respect to the interest point area, comprises:

generating an offset of the thumbnail area, comprising:

determining whether there is a non-zero translation value; and

responsive to determining that there is a non-zero translation value, translating the thumbnail area to offset the non-zero translation value.

4. The method of claim 1 , further comprising:

scaling the thumbnail area.

5. A method of generating a thumbnail for a media file, comprising:

receiving the media file having metadata associated therewith;

generating an interest point area, wherein the interest point area includes one or more interest points in the media file;

aligning a thumbnail area with respect to the interest point area, wherein aligning a thumbnail area with respect to the interest point area comprises:

determining an orientation of the media file;

responsive to determining that the orientation is a portrait orientation, preserving a width of the media file;

determining a height of both the thumbnail area and the interest point area; and

responsive to determining that the height of the interest point area is greater than or equal to a scalar multiple of the height of the thumbnail area, aligning a center of the thumbnail area with a center of the interest point area; and

displaying a portion of the media file in the thumbnail area, wherein the portion of the media file that is displayed includes at least a portion of the interest point area.

6. The method of claim 5 , wherein generating an interest point area comprises:

scanning the metadata associated with the media file to determine the one or more interest points.

7. The method of claim 5 , wherein aligning a thumbnail area with respect to the interest point area, comprises:

generating an offset of the thumbnail area, comprising:

determining whether there is a non-zero translation value; and

responsive to determining that there is a non-zero translation value, translating the thumbnail area to offset the non-zero translation value.

8. The method of claim 5 , further comprising:

scaling the thumbnail area.

9. A method of generating a thumbnail for a media file, comprising:

receiving the media file having metadata associated therewith;

generating an interest point area, wherein the interest point area includes one or more interest points in the media file;

aligning a thumbnail area with respect to the interest point area, wherein aligning a thumbnail area with respect to the interest point area comprises:

determining an orientation of the media file;

responsive to determining that the orientation is a landscape orientation, preserving a height of the media file;

determining a width of both the thumbnail area and the interest point area; and

responsive to determining that the width of the interest point area is less than a scalar multiple of the width of the thumbnail area, aligning a center of the thumbnail area with the interest point area according to a predefined set of rules; and

displaying a portion of the media file in the thumbnail area, wherein the portion of the media file that is displayed includes at least a portion of the interest point area.

10. The method of claim 9 , wherein generating an interest point area comprises:

scanning the metadata associated with the media file to determine the one or more interest points.

11. The method of claim 9 , wherein aligning a thumbnail area with respect to the interest point area, comprises:

generating an offset of the thumbnail area, comprising:

determining whether there is a non-zero translation value; and

responsive to determining that there is a non-zero translation value, translating the thumbnail area to offset the non-zero translation value.

12. The method of claim 9 , further comprising:

scaling the thumbnail area.

13. A method of generating a thumbnail for a media file, comprising:

receiving the media file having metadata associated therewith;

generating an interest point area, wherein the interest point area includes one or more interest points in the media file;

aligning a thumbnail area with respect to the interest point area, wherein aligning a thumbnail area with respect to the interest point area comprises:

determining an orientation of the media file;

positioning the thumbnail area vertically, comprising:

determining a width of both the thumbnail area and the interest point area; and

responsive to determining that the width of the interest point area is greater than or equal to a scalar multiple of the width of the thumbnail area, aligning a center of the thumbnail area with a center of the interest point area; and

positioning the thumbnail area horizontally, comprising:

determining a height of both the thumbnail area and the interest point area; and

responsive to determining that the height of the interest point area is greater than or equal to a scalar multiple of the height of the thumbnail area, aligning a center of the thumbnail area with a center of the interest point area; and

displaying a portion of the media file in the thumbnail area, wherein the portion of the media file that is displayed includes at least a portion of the interest point area.

14. The method of claim 13 , wherein generating an interest point area comprises:

scanning the metadata associated with the media file to determine the one or more interest points.

15. The method of claim 13 , wherein aligning a thumbnail area with respect to the interest point area, comprises:

generating an offset of the thumbnail area, comprising:

determining whether there is a non-zero translation value; and

responsive to determining that there is a non-zero translation value, translating the thumbnail area to offset the non-zero translation value.

16. The method of claim 13 , further comprising:

scaling the thumbnail area.

17. A system, comprising:

a processor; and

a memory having instructions stored thereon, which, when executed by the processor, performs an operation of generating a thumbnail for a media file, comprising:

receiving the media file having metadata associated therewith;

generating an interest point area, wherein the interest point area includes one or more interest points in the media file;

aligning a thumbnail area with respect to the interest point area, wherein aligning a thumbnail area with respect to the interest point area comprises:

determining an orientation of the media file;

responsive to determining that the orientation is a landscape orientation, preserving a height of the media file;

determining a width of both the thumbnail area and the interest point area; and

responsive to determining that the width of the interest point area is greater than or equal to a scalar multiple of the width of the thumbnail area, aligning a center of the thumbnail area with a center of the interest point area; and

displaying a portion of the media file in the thumbnail area, wherein the portion of the media file that is displayed includes at least a portion of the interest point area.

18. The system of claim 17 , wherein generating an interest point area comprises:

scanning the metadata associated with the media file to determine the one or more interest points.

19. The system of claim 17 , wherein aligning a thumbnail area with respect to the interest point area, comprises:

generating an offset of the thumbnail area, comprising:

determining whether there is a non-zero translation value; and

responsive to determining that there is a non-zero translation value, translating the thumbnail area to offset the non-zero translation value.

20. The system of claim 17 , further comprising:

scaling the thumbnail area.

21. A system, comprising:

a processor; and

a memory having instructions stored thereon, which, when executed by the processor, performs an operation of generating a thumbnail for a media file, comprising:

receiving the media file having metadata associated therewith;

generating an interest point area, wherein the interest point area includes one or more interest points in the media file;

aligning a thumbnail area with respect to the interest point area, wherein aligning a thumbnail area with respect to the interest point area comprises:

determining an orientation of the media file;

responsive to determining that the orientation is a portrait orientation, preserving a width of the media file;

determining a height of both the thumbnail area and the interest point area; and

responsive to determining that the height of the interest point area is greater than or equal to a scalar multiple of the height of the thumbnail area, aligning a center of the thumbnail area with a center of the interest point area; and

displaying a portion of the media file in the thumbnail area, wherein the portion of the media file that is displayed includes at least a portion of the interest point area.

22. The system of claim 21 , wherein generating an interest point area comprises:

scanning the metadata associated with the media file to determine the one or more interest points.

23. The system of claim 21 , wherein aligning a thumbnail area with respect to the interest point area, comprises:

generating an offset of the thumbnail area, comprising:

determining whether there is a non-zero translation value; and

responsive to determining that there is a non-zero translation value, translating the thumbnail area to offset the non-zero translation value.

24. The system of claim 21 , further comprising:

scaling the thumbnail area.

25. A system, comprising:

a processor; and

a memory having instructions stored thereon, which, when executed by the processor, performs an operation of generating a thumbnail for a media file, comprising:

receiving the media file having metadata associated therewith;

generating an interest point area, wherein the interest point area includes one or more interest points in the media file;

aligning a thumbnail area with respect to the interest point area, wherein aligning a thumbnail area with respect to the interest point area comprises:

determining an orientation of the media file;

responsive to determining that the orientation is a landscape orientation, preserving a height of the media file;

determining a width of both the thumbnail area and the interest point area; and

responsive to determining that the width of the interest point area is less than a scalar multiple of the width of the thumbnail area, aligning a center of the thumbnail area with the interest point area according to a predefined set of rules; and

displaying a portion of the media file in the thumbnail area, wherein the portion of the media file that is displayed includes at least a portion of the interest point area.

26. The system of claim 25 , wherein generating an interest point area comprises:

scanning the metadata associated with the media file to determine the one or more interest points.

27. The system of claim 25 , wherein aligning a thumbnail area with respect to the interest point area, comprises:

generating an offset of the thumbnail area, comprising:

determining whether there is a non-zero translation value; and

responsive to determining that there is a non-zero translation value, translating the thumbnail area to offset the non-zero translation value.

28. The system of claim 25 , further comprising:

scaling the thumbnail area.

29. A system, comprising:

a processor; and

a memory having instructions stored thereon, which, when executed by the processor, performs an operation of generating a thumbnail for a media file, comprising:

receiving the media file having metadata associated therewith;

generating an interest point area, wherein the interest point area includes one or more interest points in the media file;

aligning a thumbnail area with respect to the interest point area, wherein aligning a thumbnail area with respect to the interest point area comprises:

determining an orientation of the media file;

positioning the thumbnail area vertically, comprising:

determining a width of both the thumbnail area and the interest point area; and

responsive to determining that the width of the interest point area is greater than or equal to a scalar multiple of the width of the thumbnail area, aligning a center of the thumbnail area with a center of the interest point area; and

positioning the thumbnail area horizontally, comprising:

determining a height of both the thumbnail area and the interest point area; and

responsive to determining that the height of the interest point area is greater than or equal to a scalar multiple of the height of the thumbnail area, aligning a center of the thumbnail area with a center of the interest point area; and

displaying a portion of the media file in the thumbnail area, wherein the portion of the media file that is displayed includes at least a portion of the interest point area.

30. The system of claim 29 , wherein generating an interest point area comprises:

scanning the metadata associated with the media file to determine the one or more interest points.

31. The system of claim 29 , wherein aligning a thumbnail area with respect to the interest point area, comprises:

generating an offset of the thumbnail area, comprising:

determining whether there is a non-zero translation value; and

responsive to determining that there is a non-zero translation value, translating the thumbnail area to offset the non-zero translation value.

32. The system of claim 29 , further comprising:

scaling the thumbnail area.

33. A non-transitory computer readable medium having instructions stored thereon, which, when executed by a processor, cause the processor to perform a method of generating a thumbnail for a media file, comprising:

receiving the media file having metadata associated therewith;

generating an interest point area, wherein the interest point area includes one or more interest points in the media file;

aligning a thumbnail area with respect to the interest point area, wherein aligning a thumbnail area with respect to the interest point area comprises:

determining an orientation of the media file;

responsive to determining that the orientation is a landscape orientation, preserving a height of the media file;

determining a width of both the thumbnail area and the interest point area; and

responsive to determining that the width of the interest point area is greater than or equal to a scalar multiple of the width of the thumbnail area, aligning a center of the thumbnail area with a center of the interest point area; and

displaying a portion of the media file in the thumbnail area, wherein the portion of the media file that is displayed includes at least a portion of the interest point area.

34. The non-transitory computer readable medium of claim 33 , wherein generating an interest point area comprises:

scanning the metadata associated with the media file to determine the one or more interest points.

35. A non-transitory computer readable medium having instructions stored thereon, which, when executed by a processor, cause the processor to perform a method of generating a thumbnail for a media file, comprising:

receiving the media file having metadata associated therewith;

generating an interest point area, wherein the interest point area includes one or more interest points in the media file;

aligning a thumbnail area with respect to the interest point area, wherein aligning a thumbnail area with respect to the interest point area comprises:

determining an orientation of the media file;

responsive to determining that the orientation is a portrait orientation, preserving a width of the media file;

determining a height of both the thumbnail area and the interest point area; and

responsive to determining that the height of the interest point area is greater than or equal to a scalar multiple of the height of the thumbnail area, aligning a center of the thumbnail area with a center of the interest point area; and

displaying a portion of the media file in the thumbnail area, wherein the portion of the media file that is displayed includes at least a portion of the interest point area.

36. The non-transitory computer readable medium of claim 35 , wherein generating an interest point area comprises:

scanning the metadata associated with the media file to determine the one or more interest points.

Assignments (3)
SECURITY INTEREST Recorded Jul 30, 2025
From: AWES.ME, INC.
To: AVIDBANK
Reel/Frame 071884/0090 →
CHANGE OF NAME Recorded Mar 30, 2022
From: SMUGMUG, INC.
To: AWES.ME, INC.
Reel/Frame 059554/0609 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 26, 2019
From: PARRY, DAVID; MEYERS, AARON; YANG, BOBBY
To: SMUGMUG, INC.
Reel/Frame 050499/0993 →
Continuity (3)
Provisional Application 62539965 · Aug 1, 2017
Provisional Application 62457732 · Feb 10, 2017
Related Publication 20180232594A1 · Aug 16, 2018