IP Library › Granted Patent US 11,551,441
Granted Patent B2
US 11,551,441 · App. 16/467,382 · Granted Jan 10, 2023

Systems and methods for a chronological-based search engine

Inventor: Donn M. Gurule (Chicago, IL)
Assignee: Enviropedia, Inc.
G06V20/20G02B27/0093G02B27/017G06F16/9038G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,551,441
App. No.
16/467,382
Granted
Jan 10, 2023
Kind
B2
Abstract

Methods, apparatus, and database management systems are disclosed for providing, organizing, and present database search results and, more specifically, systems and methods for a chronological-based search engine. One method includes presenting live image data being captured by a camera of the end-user device. The method also includes determining a pose of the end-user device. The pose including a location of the end-user device. Additionally, the method includes sending the pose of the end-user device to an augmented reality platform entity and receiving closed captioning data from the augmented reality platform entity. The closed captioning data is based on the location of the end-user device and includes indications of first topics within the closed captioning data. The method includes superimposing the closed captioning data onto the live image data.

Claims (42)

1. A method comprising:

presenting, on a display of an end-user device, live image data being captured by a camera of the end-user device;

determining a pose of the end-user device, the pose including a location of the end-user device;

sending the pose of the end-user device to an augmented reality platform entity;

receiving closed captioning data from the augmented reality platform entity, the closed captioning data based on the location of the end-user device and including an indication of a first topic embedded within the closed captioning data; and

superimposing the closed captioning data incorporating an interactive element associated with the first topic onto the live image data, wherein the first topic includes a query panel associating the first topic with the interactive element.

2. The method of claim 1 , including highlighting objects of interest in the displayed live image data being captured by the camera, the objects of interest associated with a topic.

3. The method of claim 2 , wherein highlighting the objects of interest in the displayed live image data being captured by the camera includes:

sending the pose of the end-user device to an augmented reality platform entity, the pose including the location and orientation of the end-user device;

receiving the objects of interest from the augmented reality platform entity based on the pose of the end-user device.

4. The method of claim 2 , wherein superimposing the closed captioning data onto the live image data includes superimposing the closed captioning data onto one of the objects of interest.

5. The method of claim 2 , including in response to receiving a selection of one of the objects of interest associated with second topics, sending a query to the augmented reality platform entity that includes the corresponding one of the second topics.

6. The method of claim 5 , including, in response to receiving a query result from the augmented reality platform entity:

presenting a scrubber track, a scrubber, and a plurality of event points, the plurality of event points indicative chronological categories associated with the query result; and

displaying a first hierarchy of a plurality of hierarchies associated with records included in the query result associated with one of the chronological categories selected by a position of the scrubber on the scrubber track corresponding to an associated one of the plurality of event points.

7. The method of claim 1 , including in response to receiving a selection of the interactive element within the displayed closed captioning data, sending a query to the augmented reality platform entity that includes the corresponding first topic.

8. The method of claim 1 , wherein receiving the closed captioning data from the augmented reality platform entity includes receiving the closed captioning data in response to being within an area defined by a geofence.

9. The method of claim 1 , wherein content of the closed captioning data is based on the location of the end-user device and a pose of the end-user device.

10. An end-user device comprising:

memory with an application; and

a processor communicatively coupled to the memory, the application, when executed, causing the processor to:

present, on a display, live image data being captured by a camera of the end-user device; determine a pose of the end-user device, the pose including a location of the end-user device;

send the pose of the end-user device to an augmented reality platform entity;

receive closed captioning data from the augmented reality platform entity, the closed captioning data based on the location of the end-user device and including an indication of a first topic embedded within the closed captioning data; and

superimpose the closed captioning data incorporating an interactive element associated with the first topic onto the live image data, wherein the first topic includes a query panel associating the first topic with the interactive element.

11. The end-user device of claim 10 , wherein the application, when executing, causes the processor to highlight objects of interest in the displayed live image data being captured by the camera, the objects of interest associated with a topic.

12. The end-user device of claim 11 , wherein to highlight the objects of interest in the displayed live image data being captured by the camera, the application, when executing, causes the processor to:

send the pose of the end-user device to an augmented reality platform entity, the pose including the location and orientation of the end-user device;

receive the objects of interest from the augmented reality platform entity based on the pose of the end-user device.

13. The end-user device of claim 11 , wherein to superimpose the closed captioning data onto the live image data, the application, when executing, causes the processor to superimpose the closed captioning data onto one of the objects of interest.

14. The end-user device of claim 11 , wherein the application, when executing, causes the processor to, in response to receiving a selection of one of the objects of interest associated with second topics, send a query to the augmented reality platform entity that includes the corresponding one of the second topics.

15. The end-user device of claim 10 , wherein the application, when executing, causes the processor to, in response to receiving a selection of interactive element within the displayed closed captioning data, send a query to the augmented reality platform entity that includes the corresponding first topic.

16. The end-user device of claim 15 , wherein the application, when executing, causes the processor to, in response to receiving a query result from the augmented reality platform entity:

present a scrubber track, a scrubber, and a plurality of event points, the plurality of event points indicative chronological categories associated with the query result; and

display a first hierarchy of a plurality of hierarchies associated with records included in the query result associated with one of the chronological categories selected by a position of the scrubber on the scrubber track corresponding to an associated one of the plurality of event points.

17. A tangible computer readable medium comprising instructions that, when executed, cause an end-user device to:

present, on a display of an end-user device, live image data being captured by a camera of the end-user device;

determine a pose of the end-user device, the pose including a location of the end-user device;

send the pose of the end-user device to an augmented reality platform entity;

receive closed captioning data from the augmented reality platform entity, the closed captioning data based on the location of the end-user device and including a visual indication of a first topic embedded within the closed captioning data; and

superimpose the closed captioning data incorporating an interactive element associated with the first topic onto the live image data, the visual indication linking the first topic with the interactive element.

18. The tangible computer readable medium of claim 17 , wherein the visual indication includes a query panel.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 6, 2019
From: GURULE, DONN M
To: ENVIROPEDIA, INC
Reel/Frame 049396/0858 →
Continuity (3)
Provisional Application 62556916 · Sep 11, 2017
Provisional Application 62430584 · Dec 6, 2016
Related Publication 20200097726A1 · Mar 26, 2020