IP Library Granted Patent US 8,930,490
Granted Patent B2
US 8,930,490 · App. 13/345,023 · Granted Jan 6, 2015

Lifestream annotation method and system

Inventors: Stephen J. Brown (Woodside, CA); Andreas Schobel (San Francisco, CA)
Assignee: Apple Inc.
G06F17/30731
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,930,490
App. No.
13/345,023
Granted
Jan 6, 2015
Kind
B2
Abstract

A method and system for collecting information, enriching the collected information and linking the enriched information is provided. The system includes an application server that is accessible by users via their computer device for performing a variety of functions encompassed in a lifestream data function. Lifestreams (or lifestream data) contains notes, recordings and annotation data elements. The goal of the lifestream data functions is to ultimately enrich the individual data elements in each lifestream which then form a network of enriched lifestreams or aspects of enriched lifestreams to provide a user with: (a) a better organization of his/her data, notes, thoughts and intentions, (b) a better search or filter tool to search for data, notes, thoughts and intentions, and/or (c) a better ranking mechanism for ranking or determining relevance of data, notes, thoughts and intentions.

Claims (40)

1. A method for collecting information, enriching said information and linking said enriched information, comprising:

(a) on a computer device providing a lifestream data function to allow a user to collect a plurality of lifestreams, wherein said lifestream data function comprises:

(i) a note taking function to allow said user to create a plurality of notes on said computer device,

(ii) a recording function for collecting, recording or storing a plurality of recordings on said computer device, wherein said recordings are, in any combination, audio data recordings, video data recordings, or audio-video data recordings, and

(iii) an annotation function for collecting, recording or storing a plurality of annotation data elements on said computer device, wherein said annotation data elements are externally sensed data of the environment of said user or physiological sensed data of said user, whereby said sensed data is either captured by said user or from said user using a data capture device;

(b) on said computer device, or by a computer server or an online service each of them communicatively coupled with said computer device enriching each of said lifestreams and therewith creating a linked network of enriched lifestreams available to said user on said computer device by, in any combination:

(j) linking one or more segments in each of said recordings with one or more annotation data elements, one or more notes, or a combination thereof,

(jj) linking each of said notes with one or more annotation data elements, one or more segments of said recordings, or a combination thereof, or

(jjj) linking each of said annotation data elements with one or more notes, one or more segments of said recordings, or a combination thereof; and

(c) said computer device providing a filter or search function to said user for filtering or searching said enriched lifestreams or aspects of said enriched lifestreams on said computer device.

2. The method as set forth in claim 1 , wherein each of said notes comprise text, audio media, visual media, audio-visual media, recorded data, a weblink, a pointer to an information source, or any combination thereof.

3. The method as set forth in claim 1 , wherein said one or more segments in each of said recordings are automatically derived by said computer device, said computer server or said online service based on context sensing or sensing changes in context in said recordings which annotates said derived segment with its corresponding contextually sensed data.

4. The method as set forth in claim 3 , wherein said context sensing or sensing changes in context is sensing information or changes related people, faces, location, direction, keywords, logical content blocks, or a combination thereof.

5. The method as set forth in claim 1 , wherein said externally sensed annotation data elements pertains to direction, location, identity of person or place said user is looking at.

6. The method as set forth in claim 5 , wherein said one or more externally sensed annotation data elements are automatically derived by said computer device, said computer server or said online service based on context sensing or sensing changes in context in said externally sensed data.

7. The method as set forth in claim 1 , wherein said physiological sensed data of said user is obtained using physiological sensors or biosensors.

8. The method as set forth in claim 7 , wherein said one or more physiological sensed annotation data elements are automatically derived by said computer device, said computer server or said online service based on context sensing or sensing changes in said physiological sensed data.

9. The method as set forth in claim 1 , further comprising on said computer device, by said computer server or by said online service determining relevance of said enriched lifestreams or aspects of said enriched lifestreams in said network of enriched lifestreams.

10. The method as set forth in claim 1 , further comprising on said computer device, by said computer server or by said online service ranking of said enriched lifestreams or aspects of said enriched lifestreams in said network of enriched lifestreams.

11. A system for collection information, enriching the information, and linking the said enriched information, comprising:

(a) an application server, wherein a plurality of users are communicatively connected to said application server to create a plurality of lifestreams; and

(b) a database for storing said lifestreams created by said users,

wherein said application server operates a plurality of lifestream data functions, said functions comprising:

(i) a note taking function to allow said user to create a plurality of notes on a computer device,

(ii) a recording function for collecting, recording or storing a plurality of recordings on said computer device, wherein said recordings are, in any combination, audio data recordings, video data recordings, or audio-video data recordings,

(iii) an annotation function for collecting, recording or storing a plurality of annotation data elements on said computer device, wherein said annotation data elements are externally sensed data of the environment of said user or physiological sensed data of said user, whereby said sensed data is either captured by said user or from said user using a data capture device,

(iv) an enriching function for enriching each of said lifestreams and therewith creating a linked network of enriched lifestreams available to said user on said computer device by, in any combination:

(j) linking one or more segments in each of said recordings with one or more annotation data elements, one or more notes, or a combination thereof,

(jj) linking each of said notes with one or more annotation data elements, one or more segments of said recordings, or a combination thereof, or

(jjj) linking each of said annotation data elements with one or more notes, one or more segments of said recordings, or a combination thereof; and

(v) a filter or search function for filtering or searching said enriched lifestreams or aspects of said enriched lifestreams on said computer device.

12. The system as set forth in claim 11 , wherein each of said notes comprise text, audio media, visual media, audio-visual media, recorded data, a weblink, a pointer to an information source, or any combination thereof.

13. The system as set forth in claim 11 , wherein said one or more segments in each of said recordings are automatically derived by said computer device, said application server or an online service based on context sensing or sensing changes in context in said recordings which annotates said derived segment with its corresponding contextually sensed data.

14. The system as set forth in claim 13 , wherein said context sensing or sensing changes in context is sensing information or changes related people, faces, location, direction, keywords, logical content blocks, or a combination thereof.

15. The system as set forth in claim 11 , wherein said externally sensed annotation data elements pertains to direction, location, identity of person or place said user is looking at.

16. The system as set forth in claim 15 , wherein said one or more externally sensed annotation data elements are automatically derived by said computer device, said application server or an online service based on context sensing or sensing changes in context in said externally sensed data.

17. The system as set forth in claim 11 , wherein said physiological sensed data of said user is obtained using physiological sensors or biosensors.

18. The method as set forth in claim 17 , wherein said one or more physiological sensed annotation data elements are automatically derived by said computer device, said application server or an online service based on context sensing or sensing changes in said physiological sensed data.

19. The system as set forth in claim 11 , further comprising on said computer device, by said application server or by an online service determining relevance of said enriched lifestreams or aspects of said enriched lifestreams in said network of enriched lifestreams.

20. The system as set forth in claim 11 , further comprising on said computer device, by said application server or by an online service ranking of said enriched lifestreams or aspects of said enriched lifestreams in said network of enriched lifestreams.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 4, 2014
From: CATCH.COM, INC.
To: APPLE INC.
Reel/Frame 032137/0558 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED ON REEL 027621 FRAME 0162. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT OF ASSIGNORS INTEREST. Recorded Jul 25, 2013
From: BROWN, STEPHEN J; SCHOBEL, ANDREAS
To: CATCH.COM, INC.
Reel/Frame 030889/0733 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2012
From: BROWN, STEPHEN J.; SCHOBEL, ANDREAS
To: CATCH, INC.
Reel/Frame 027621/0162 →
Continuity (3)
Continuation In Part 12322046 · Jan 27, 2009
Provisional Application 61460813 · Jan 7, 2011
Related Publication 20120110082A1 · May 3, 2012