IP Library Granted Patent US 11,645,325
Granted Patent B2
US 11,645,325 · App. 17/030,130 · Granted May 9, 2023

Systems and methods for spatial thumbnails and companion maps for media objects

Inventor: John R. Frank (Cambridge, MA)
Assignee: NOKIA TECHNOLOGIES OY
G06F16/48G06F16/00G06F16/29G06F16/40G06F16/438G06F16/58G06F16/951G06F16/9537
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,645,325
App. No.
17/030,130
Granted
May 9, 2023
Kind
B2
Abstract

Under one aspect, a computer-implemented method includes obtaining one or more media objects having location-related content in response to a search query, wherein the location-related content represents one or more locations corresponding to one or more spatial references in the one or more media objects, obtaining respective spatial thumbnails for the one or more spatial references, obtaining respective summaries of the one or more media objects, obtaining a respective one or more hyperlinks referencing to the one or more media objects, and causing to display for the one or more media objects the respective spatial thumbnails, the respective summaries, and the respective one or more hyperlinks.

Claims (53)

1. A method comprising:

obtaining one or more media objects comprising one or more web pages, one or more text documents, one or more email messages, or one or more videos in response to a search query, wherein the one or more media objects comprise location-related content representing one or more locations corresponding to one or more spatial references extracted from the one or more media objects;

obtaining respective one or more spatial thumbnails comprising a visual summary of the one or more media objects and representing the one or more spatial references extracted from the one or more media objects comprising the one or more web pages, the one or more text documents, the one or more email messages, or the one or more videos;

obtaining respective one or more summaries of the one or more media objects comprising an excerpt from the one or more media objects, a review of the one or more media objects, an image of the one or more media objects, or a portion of the one or more media objects;

obtaining respective one or more hyperlinks referencing to the one or more media objects; and

causing to display for the one or more media objects the respective one or more spatial thumbnails, the respective one or more summaries, and the respective one or more hyperlinks.

2. The method of claim 1 , wherein the one to more hyperlinks provide access to the respective one or more media objects via the World Wide Web.

3. The method of claim 1 , wherein the one or more respective summaries are one or more excerpts of the one or more media objects.

4. The method of claim 1 , wherein the one or more respective spatial references are coordinate system references.

5. The method of claim 1 , wherein the location-related content is extracted from the one or more media objects.

6. The method of claim 1 , wherein the one or more respective spatial thumbnails are one or more images that depict spatial relationships of the one or more spatial references.

7. The method of claim 1 , wherein the one or more respective spatial thumbnails are one or more maps that depict spatial relationships of the one or more spatial references.

8. The method of claim 1 , wherein the one or more spatial thumbnails comprise one or more visual indicators that depict spatial relationship represented by the one or more spatial thumbnails.

9. The method of claim 1 , wherein the location-related content further represents at least one of a geographical reference and a spatial relationship within the media object.

10. The method of claim 1 , wherein the one or more spatial thumbnails further comprise an image with visual indicators representing the one or more spatial references, and wherein the image with visual indicators is generated based on the location-related content.

11. The method of claim 1 , wherein causing to display comprises causing to display for the one or more media objects (i) a first summary area comprising a first spatial thumbnail associated with a first sub-media object from the one or more media objects and (ii) a second summary area comprising a second spatial thumbnail associated with a second sub-media object from the one or more media objects.

12. The method of claim 1 , wherein the one or more spatial thumbnails comprise a list of the one or more spatial references or an image depicting the one or more spatial references.

13. The method of claim 1 , wherein the one or more spatial references are extracted from the one or more media objects by a geoparsing engine.

14. The method of claim 1 , wherein the one or more spatial references are extracted from text within the one or more media objects.

15. The method of claim 14 , wherein the one or more spatial references are extracted from the text using a natural language processing engine.

16. The method of claim 1 , wherein the one or more spatial references are extracted from latitude-longitude coordinate metadata within the one or more media objects.

17. The method of claim 1 , wherein the media objects are obtained from a document repository.

18. The method of claim 17 , wherein the media objects are obtained from a document repository according to search results provided by a search engine subsystem.

19. A computer system, comprising:

a processor; and a memory including a computer program, the memory and the computer program configured to, with the processor, cause the computer system to perform at least the following:

obtain one or more media objects comprising one or more web pages, one or more text documents, one or more email messages, or one or more videos in response to a search query, wherein the one or more media objects comprise location-related content representing one or more locations corresponding to one or more spatial references extracted from the one or more media objects;

obtain respective one or more spatial thumbnails comprising a visual summary of the one or more media objects and representing the one or more spatial references extracted from the one or more media objects comprising the one or more web pages, the one or more text documents, the one or more email messages, or the one or more videos;

obtain respective one or more summaries of the one or more media objects comprising an excerpt from the one or more media objects, a review of the one or more media objects, an image of the one or more media objects, or a portion of the one or more media objects;

obtain respective one or more hyperlinks referencing to the one or more media objects; and

cause to display for the one or more media objects the respective one or more spatial thumbnails, the respective one or more summaries, and the respective one or more hyperlinks.

20. The computer system of claim 19 , wherein the one or more media objects comprises one or more images or one or more music.

21. The computer system of claim 19 , wherein the one to more hyperlinks provide access to the respective one or more media objects via the World Wide Web.

22. The computer system of claim 19 , wherein the one or more respective summaries are one or more excerpts of the one or more media objects.

23. The computer system of claim 19 , wherein the one or more respective spatial references are coordinate system references.

24. The computer system of claim 19 , wherein the one or more respective spatial thumbnails are one or more maps that depict spatial relationships of the one or more spatial references.

25. The computer system of claim 19 , wherein the one or more spatial references are extracted from the one or more media objects by a geoparsing engine.

26. The computer system of claim 19 , wherein the one or more spatial references are extracted from text within the one or more media objects.

27. The computer system of claim 26 , wherein the one or more spatial references are extracted from the text using a natural language processing engine.

28. The computer system of claim 19 , wherein the one or more spatial references are extracted from latitude-longitude coordinate metadata within the one or more media objects.

29. The computer system of claim 19 , wherein the media objects are obtained from a document repository.

30. The computer system of claim 19 , wherein the media objects are obtained from a document repository according to search results provided by a search engine subsystem.

31. A non-transitory computer-readable storage medium carrying one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to at least perform the following:

obtain one or more media objects comprising one or more web pages, one or more text documents, one or more email messages, or one or more videos in response to a search query, wherein the one or more media objects comprise location-related content representing one or more locations corresponding to one or more spatial references extracted from the one or more media objects;

obtain respective one or more spatial thumbnails comprising a visual summary of the one or more media objects and representing the one or more spatial references extracted from the one or more media objects comprising the one or more web pages, the one or more text documents, the one or more email messages, or the one or more videos;

obtain respective one or more summaries of the one or more media objects comprising an excerpt from the one or more media objects, a review of the one or more media objects, an image of the one or more media objects, or a portion of the one or more media objects;

obtain respective one or more hyperlinks referencing to the one or more media objects; and

cause to display for the one or more media objects the respective one or more spatial thumbnails, the respective one or more summaries, and the respective one or more hyperlinks.

32. The non-transitory computer-readable storage medium of claim 31 , wherein the one or more spatial references are extracted from the one or more media objects by a geoparsing engine.

33. The non-transitory computer-readable storage medium of claim 31 , wherein the one or more spatial references are extracted from text within the one or more media objects.

34. The non-transitory computer-readable storage medium of claim 33 , wherein the one or more spatial references are extracted from the text using a natural language processing engine.

35. The non-transitory computer-readable storage medium of claim 31 , wherein the one or more spatial references are extracted from latitude-longitude coordinate metadata within the one or more media objects.

36. The non-transitory computer-readable storage medium of claim 31 , wherein the media objects are obtained from a document repository.

37. The non-transitory computer-readable storage medium of claim 31 , wherein the media objects are obtained from a document repository according to search results provided by a search engine subsystem.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2020
From: FRANK, JOHN R.
To: METACARTA, INC.
Reel/Frame 054740/0596 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2020
From: METACARTA, INCORPORATED
To: NOKIA CORPORATION
Reel/Frame 054839/0868 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2020
From: NOKIA CORPORATION
To: NOKIA TECHNOLOGIES OY
Reel/Frame 054881/0313 →
Continuity (5)
Continuation 15628097 · Jun 20, 2017
Continuation 15226155 · Aug 2, 2016
Continuation 11705368 · Feb 12, 2007
Provisional Application 60772088 · Feb 10, 2006
Related Publication 20210073263A1 · Mar 11, 2021