IP Library › Granted Patent US 10,379,718
Granted Patent B2
US 10,379,718 · App. 15/853,434 · Granted Aug 13, 2019

System and method for providing ambient information to user through layered visual montage

Inventor: Gregory Michael Youngblood (San Jose, CA)
Assignee: PALO ALTO RESEARCH CENTER INCORPORATED
G06F3/04842H04N21/8456H04N21/854
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,379,718
App. No.
15/853,434
Granted
Aug 13, 2019
Kind
B2
Abstract

Embodiments described herein provide a system for generating a visual montage. During operation, the system may determine a plurality of layers in the visual montage. A respective layer is associated with a time range and a plurality of predetermined slots for assigning graphical objects. The system may obtain data representing a set of graphical objects and constraints associated with the graphical objects. The system may then obtain information associated with an event and a respective time from an ambient environment of a user. The system may determine that the respective time is within the time range of a specific layer. The system may assign at least one graphical object to the specific layer according to the constraints associated with the graphical object to generate the visual montage. The system may then display the visual montage with the graphical object representing the event on a display screen.

Claims (59)

1. A computer-implemented method for generating a visual montage, the method comprising:

determining a plurality of layers in the visual montage, wherein a respective layer is associated with a time range and a plurality of predetermined slots for assigning graphical objects;

obtaining data representing a set of graphical objects and constraints associated with the graphical objects;

obtaining information associated with an event and a respective time from an ambient environment of a user;

determining that the respective time is within the time range of a specific layer;

assigning at least one graphical object to the specific layer according to the constraints associated with the graphical object to generate the visual montage; and

displaying the visual montage with the graphical object representing the event on a display screen.

2. The method of claim 1 , further comprising:

determining rules which specify responses to user interaction with one or more graphical objects; and

in response to receiving user input interacting with a selected graphical object, executing a rule associated with the selected graphical object to provide a response to the user.

3. The method of claim 1 , further comprising:

in response to receiving user input interacting with a selected graphical object, controlling a device represented by the graphical object.

4. The method of claim 1 , further comprising:

in response to determining a change in a time associated with a specific graphical object, moving the graphical object to another layer of the visual montage.

5. The method of claim 1 , wherein the plurality of layers includes at least a foreground layer and a background layer, the foreground layer is associated with a most recent time range, and the background layer is associated with a least recent time range.

6. The method of claim 5 , further comprising:

in response to determining that a difference between a current time and a time associated with a second event is decreasing, moving a second graphical object from another layer to the foreground layer; and

in response to determining that a difference between the current time and a time associated with the second event is increasing, moving the second graphical object from the foreground layer to a different layer.

7. The method of claim 1 , further comprising:

assigning at least one graphical object to an ornament slot associated with a layer.

8. The method of claim 1 , further comprising:

determining rules which specify how to transition between states for a sublayer of a respective layer.

9. The method of claim 1 , further comprising:

receiving user preference data indicating a type of information to display on the visual montage, wherein the information is associated with at least one of an event, an activity, a deadline, a user-specified logic function, and a communication from an application.

10. The method of claim 1 , further comprising:

performing at least one of a temporal-to-spatial mapping, a spatial-to-spatial mapping, and a logical-function-to-spatial mapping from information associated with the ambient environment to the visual montage.

11. A computing system for generating a visual montage, the system comprising:

one or more processors,

a non-transitory computer-readable medium coupled to the one or more processors having instructions stored thereon that, when executed by the one or more processors, cause the one or more processors to perform a method, the method comprising:

determining a plurality of layers in the visual montage, wherein a respective layer is associated with a time range and a plurality of predetermined slots for assigning graphical objects;

obtaining data representing a set of graphical objects and constraints associated with the graphical objects;

obtaining information associated with an event and a respective time from an ambient environment of a user;

determining that the respective time is within the time range of a specific layer;

assigning at least one graphical object to the specific layer according to the constraints associated with the graphical object to generate the visual montage; and

displaying the visual montage with the graphical object representing the event on a display screen.

12. The system of claim 11 , wherein the method further comprises:

determining rules which specify responses to user interaction with one or more graphical objects; and

in response to receiving user input interacting with a selected graphical object, executing a rule associated with the selected graphical object to provide a response to the user.

13. The system of claim 11 , wherein the method further comprises:

in response to receiving user input interacting with a selected graphical object, controlling a device represented by the graphical object.

14. The system of claim 11 , wherein the plurality of layers includes at least a foreground layer and a background layer, the foreground layer is associated with a most recent time range, and the background layer is associated with a least recent time range.

15. The system of claim 14 , wherein the method further comprises:

in response to determining that a difference between a current time and a time associated with a second event is decreasing, moving a second graphical object from another layer to the foreground layer; and

in response to determining that a difference between the current time and a time associated with the second event is increasing, moving the second graphical object from the foreground layer to a different layer.

16. A non-transitory computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for generating a visual montage, the method comprising:

determining a plurality of layers in the visual montage, wherein a respective layer is associated with a time range and a plurality of predetermined slots for assigning graphical objects;

obtaining data representing a set of graphical objects and constraints associated with the graphical objects;

obtaining information associated with an event and a respective time from an ambient environment of a user;

determining that the respective time is within the time range of a specific layer;

assigning at least one graphical object to the specific layer according to the constraints associated with the graphical object to generate the visual montage; and

displaying the visual montage with the graphical object representing the event on a display screen.

17. The computer-readable storage medium of claim 16 , wherein the method further comprises:

in response to receiving user input interacting with a selected graphical object, controlling a device represented by the graphical object.

18. The computer-readable storage medium of claim 16 , wherein the plurality of layers includes at least a foreground layer and a background layer, the foreground layer is associated with a most recent time range, and the background layer is associated with a least recent time range.

19. The computer-readable storage medium of claim 18 , wherein the method further comprises:

in response to determining that a difference between a current time and a time associated with a second event is decreasing, moving a second graphical object from another layer to the foreground layer; and

in response to determining that a difference between the current time and a time associated with the second event is increasing, moving the second graphical object from the foreground layer to a different layer.

20. The computer-readable storage medium of claim 16 , wherein the method further comprises:

assigning at least one graphical object to an ornament slot associated with a layer.

Assignments (10)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2025
From: XEROX CORPORATION
To: GENESEE VALLEY INNOVATIONS, LLC
Reel/Frame 073562/0677 →
SECOND LIEN NOTES PATENT SECURITY AGREEMENT Recorded Jul 2, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 071785/0550 →
FIRST LIEN NOTES PATENT SECURITY AGREEMENT Recorded Apr 11, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 070824/0001 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS RECORDED AT RF 064760/0389 Recorded Feb 13, 2024
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: XEROX CORPORATION
Reel/Frame 068261/0001 →
SECURITY INTEREST Recorded Feb 13, 2024
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 066741/0001 →
SECURITY INTEREST Recorded Nov 20, 2023
From: XEROX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 065628/0019 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVAL OF US PATENTS 9356603, 10026651, 10626048 AND INCLUSION OF US PATENT 7167871 PREVIOUSLY RECORDED ON REEL 064038 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jun 28, 2023
From: PALO ALTO RESEARCH CENTER INCORPORATED
To: XEROX CORPORATION
Reel/Frame 064161/0001 →
SECURITY INTEREST Recorded Jun 22, 2023
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 064760/0389 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 20, 2023
From: PALO ALTO RESEARCH CENTER INCORPORATED
To: XEROX CORPORATION
Reel/Frame 064038/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2017
From: YOUNGBLOOD, GREGORY MICHAEL
To: PALO ALTO RESEARCH CENTER INCORPORATED
Reel/Frame 044501/0158 →
Continuity (1)
Related Publication 20190196694A1 · Jun 27, 2019