IP Library Granted Patent US 10,331,777
Granted Patent B2
US 10,331,777 · App. 14/145,119 · Granted Jun 25, 2019

Merging annotations of paginated digital content

Inventors: Kourtny M. Hicks (Sunnyvale, CA); Amir Mesguich Havilio (Palo Alto, CA); Gerald B. Cueto (San Jose, CA)
Assignee: Barnes & Noble College Booksellers, LLC
G06F17/241G06F3/013G06F3/0482G06F3/0486G06F3/0488G06F3/04886
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,331,777
App. No.
14/145,119
Granted
Jun 25, 2019
Kind
B2
Abstract

Features and techniques are disclosed for interacting with paginated digital content, including a multi-purpose tool and an annotation mode. The multi-purpose tool, which may be represented by a graphic (e.g., a movable interactive graphic), can provide access to multiple modes (e.g., copy, define, note, and/or highlight modes) that a user can invoke. The mode invoked determines the functions performed by the tool when interacting with the paginated digital content. The annotation mode, which may be invoked using the multi-purpose tool or independently thereof, can allow a user to create and edit annotations, such as highlights and notes (e.g., sticky notes, margin notes, and/or highlight notes), for paginated digital content. Editing the annotations may include selecting a desired color for the annotation, for example. The annotation mode may also allow a user to intuitively merge and delete annotations previously added to paginated digital content.

Claims (41)

1. An electronic device, comprising:

a display for presenting paginated digital content to a user; and

a user interface operable on the device and including an annotation mode, the annotation mode configured to

create a first sticky note in response to a tap gesture on the paginated digital content, wherein the first sticky note is represented in a first state by an edit box and a second state by a movable graphic, the edit box of the first state being displayed over the paginated digital content and further being configured to receive first user generated content, wherein a tap gesture performed outside the edit box on the paginated digital content causes the first sticky note to transition from the first state to the second state, wherein the first user generated content presented in the edit box of the first sticky note in the first state is not visible in the second state while the moveable graphic is displayed over the paginated digital content, and

merge the first sticky note having a first location in the paginated digital content with a second sticky note having a second location in the paginated digital content in response to at least dragging and dropping the first sticky note while displayed in its second state in which the first user generated content is not visible onto the second sticky note to create a merged sticky note, and

display a merged sticky note edit box in response to creating the merged sticky note, wherein the merged sticky note edit box is presented over the paginated digital content, wherein the second user generated content of the second sticky note and the first user generated content are visible within the merged sticky note edit box, and wherein the merged sticky note inherits color properties from at least one of the first sticky note and the second sticky note and inherits the location of the second sticky note, and

save the merged sticky note at the location of the second sticky note in response to one of a tap gesture performed outside the merged sticky note edit box on the paginated digital content and an input performed on a save button presented in the merged sticky note edit box;

wherein in response to merging the first sticky note with the second sticky note, the first sticky note is no longer present at the first location within the paginated digital content.

2. The device of claim 1 wherein when the first sticky note is hovering over the second sticky note, the first sticky note grows and includes a border to indicate that the first sticky note has been grabbed.

3. The device of claim 1 wherein the annotation mode is configured to undo a most recent merge in response to an undo input.

4. The device of claim 1 wherein the merged sticky note inherits color properties from the second sticky note.

5. The device of claim 1 wherein the first sticky note is a first highlight note associated with a first highlight and the second sticky note is a second highlight note associated with a second highlight, wherein the first highlight note is merged with the second highlight note, in response to dragging and dropping the first highlight onto the second highlight to create a merged highlight note associated with a merged highlight.

6. The device of claim 5 wherein the merged highlight note inherits color from the first sticky note.

7. The device of claim 5 wherein one of the first highlight and the second highlight includes handles on either end of the highlight that allow the highlight to be dragged to expand or contract the highlight from either end.

8. The device of claim 5 wherein when the dragged first highlight is positioned over the second highlight, the first highlight displays a visual feedback to indicate that the first highlight is selected.

9. The device of claim 1 wherein the first sticky note is merged with a highlight note that is associated with a highlight, in response to dragging and dropping the first sticky note on the highlight note to create a merged highlight note associated with the highlight.

10. The device of claim 1 wherein the first sticky note is merged with a highlight in response to at least dragging and dropping the first sticky note on at least a portion of the highlight to create a highlight note.

11. The device of claim 1 wherein a highlight is merged with the first sticky note in response to at least dragging and dropping the highlight on at least a portion of the first sticky note to create a highlight note.

12. The device of claim 1 wherein in response to an undo input the merged sticky note is undone by one of:

returning the first sticky note to the first location in the paginated digital content; or

returning the second sticky note to the second location in the paginated digital content.

13. The device of claim 12 wherein the undo input includes at least one of a shake input and a Z-shaped gesture input.

14. A mobile computing device, comprising: a processor; a touch screen display for displaying paginated digital content to a user and allowing user input; and a user interface executable by the processor and including an annotation mode, the annotation mode configured to:

create a first highlight note associated with a first highlight in response to dragging a first highlight note over the first highlight, wherein the first highlight note is represented in a first state by an edit box and a second state by a movable graphic, the edit box of the first state being displayed over the paginated digital content and further being configured to receive first user generated content, wherein a tap gesture performed outside the edit box on the paginated digital content causes the first highlight note to transition from the first state to the second state, wherein the first user generated content presented in the edit box of the first highlight note in the first state is not visible in the second state while the moveable graphic is displayed over the paginated digital content;

the first highlight note located adjacent to or on the first highlight within the paginated digital content, and

merge the first highlight note having a first location in the paginated digital content with a second highlight note associated with a second highlight and having a second location in the paginated digital content in response to at least dragging and dropping the first highlight note while displayed in its second state in which the first user generated content is not visible onto the second highlight note to create a merged highlight note, and display a merged highlight note edit box in response to creating the merged highlight note, wherein the merged highlight note edit box is presented over the paginated digital content, wherein the second user generated content of the second highlight note and the first user generated content are visible within the merged highlight note edit box, and wherein the merged highlight note inherits color properties from the first or second highlight note and is located in front of the merged highlight within the paginated digital content and includes the second user generated content and the first user generated content, such that the first user generated content is after the second user generated content;

save the merged highlight note at the location of the second highlight note in response to one of a tap gesture performed outside the merged highlight note edit box on the paginated digital content and an input performed on a save button presented in the merged highlight note edit box;

wherein in response to merging the first highlight note with the second highlight note, the first highlight note is no longer present at the first location within the paginated digital content.

15. The device of claim 14 wherein at least one of visual, aural, and tactile feedback is provided:

in response to the press-and-hold input performed on the first highlight to select the first highlight note and before dropping the selected first highlight on the second highlight to create the merged highlight note, wherein merging of the first highlight note and the second highlight note is not allowed prior to the feedback being given.

16. A computer program product including one or more non-transitory processor readable mediums encoded with instructions that when executed facilitate operation of an electronic device according to a process, the process comprising:

in response to a tap gesture on the paginated digital content create a first sticky note wherein the first sticky note is represented in a first state by an edit box and a second state by a movable graphic, the edit box being displayed over the paginated digital content and further being configured to receive first user generated content, wherein a tap gesture performed outside the edit box on the paginated digital content causes the first sticky note to transition from the first state to the second state, wherein the first user generated content presented in the edit box of the first sticky note in the first state is not visible in the second state while the movable graphic is displayed;

in response to a press-and-hold input performed on the first sticky note previously added to a first location in the paginated digital content and in its second state, allow the first sticky note to be dragged; and

in response to dragging and dropping the first sticky note while displayed in its second state in which the first user generated content is not visible onto a second sticky note previously added to a second location in the paginated digital content, the second sticky note having a second user generated content, merge the first and second sticky notes to create a merged sticky note and display a merged sticky note edit box, wherein the merged sticky note edit box is presented over the paginated digital content, wherein the second user generated content and the first user generated content are visible within the merged sticky note edit box, and the merged sticky note inherits color properties from one or both of the first sticky note and the second sticky note and inherits the location of the second sticky note; and

in response to one of a tap gesture performed outside the merge edit box on the paginated digital content and an input performed on a save button presented in the merge edit box, save the merged sticky note at the location of the second sticky note;

wherein in response to merging the first sticky note with the second sticky note, the first sticky note is no longer present at the first location within the paginated digital content.

17. The computer program product of claim 16 , wherein the process is further configured to undo the merged sticky note in response to an undo input, wherein the merged sticky note is undone by causing the first sticky note to return to the first location.

18. The computer program product of claim 17 , wherein the undo input includes at least one of a shake input and a Z-shaped gesture input.

19. The computer program product of claim 16 , wherein the process is further configured to present a dialog requesting to undo the merged sticky note in response to merging the first sticky note with the second sticky note.

20. The computer program product of claim 16 , wherein the process is further configured to provide at least one of visual, aural, and tactile feedback:

in response to the press-and-hold input performed on the first sticky note to indicate that the first sticky note is allowed to be dragged and dropped on the second sticky note to create the merged sticky note, wherein merging of the first sticky note and the second sticky note would not be allowed prior to the feedback being given.

Assignments (10)
RELEASE OF SECURITY INTEREST Recorded Jun 13, 2024
From: TOPLIDS LENDCO, LLC, AS COLLATERAL AGENT
To: BARNES & NOBLE COLLEGE BOOKSELLERS, LLC; BNED LOUDCLOUD, LLC
Reel/Frame 067724/0314 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REPLACE THE GRANT OF SECURITY INTEREST IN PATENTS AND SCHEDULE I ATTACHED TO FILING PREVIOUSLY RECORDED AT REEL: 056784 FRAME: 0426. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Jun 8, 2022
From: BARNES & NOBLE COLLEGE BOOKSELLERS, LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 060312/0169 →
SECURITY INTEREST Recorded Jun 7, 2022
From: BARNES & NOBLE COLLEGE BOOKSELLERS, LLC; BNED LOUDCLOUD, LLC
To: TOPLIDS LENDCO, LLC AS COLLATERAL AGENT
Reel/Frame 060306/0191 →
SECURITY INTEREST Recorded Jul 7, 2021
From: BARNES & NOBLE COLLEGE BOOKSELELRS, LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 056784/0426 →
CORRECTIVE ASSIGNMENT TO REMOVE APPLICATION NUMBERS 13924129 AND 13924362 PREVIOUSLY RECORDED ON REEL 035187 FRAME 0476. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded May 29, 2015
From: NOOK DIGITAL LLC
To: NOOK DIGITAL, LLC
Reel/Frame 036131/0801 →
CORRECTIVE ASSIGNMENT TO REMOVE APPLICATION NUMBERS 13924129 AND 13924362 PREVIOUSLY RECORDED ON REEL 035187 FRAME 0469. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded May 29, 2015
From: BARNESANDNOBLE.COM LLC
To: NOOK DIGITAL LLC
Reel/Frame 036131/0409 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 10, 2015
From: NOOK DIGITAL, LLC
To: BARNES & NOBLE COLLEGE BOOKSELLERS, LLC
Reel/Frame 035399/0325 →
CHANGE OF NAME Recorded Mar 11, 2015
From: BARNESANDNOBLE.COM LLC
To: NOOK DIGITAL LLC
Reel/Frame 035187/0469 →
CHANGE OF NAME Recorded Mar 11, 2015
From: NOOK DIGITAL LLC
To: NOOK DIGITAL, LLC
Reel/Frame 035187/0476 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2014
From: HICKS, KOURTNY M.; MESGUICH HAVILIO, AMIR; CUETO, GERALD B.
To: BARNESANDNOBLE.COM LLC
Reel/Frame 031948/0873 →
Continuity (1)
Related Publication 20150186349A1 · Jul 2, 2015
Cited By (4)
US 12,236,537 US 12,248,635 US 12,416,967 US 12,455,622