IP Library Granted Patent US 10,318,611
Granted Patent B2
US 10,318,611 · App. 15/661,105 · Granted Jun 11, 2019

Automatically creating at-a-glance content

Inventors: Bin Ni (Fremont, CA); Jia Li (Santa Clara, CA)
Assignee: OATH INC.
G06F17/211G06F16/345G06T3/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,318,611
App. No.
15/661,105
Granted
Jun 11, 2019
Kind
B2
Abstract

Generating notifications comprising text and image data for client devices with limited display screens is disclosed. An image to be included in the notification is resized and reshaped using image processing techniques. The resized image is further analyzed to identify optimal portions for placing the text data. The text data can also be analyzed and shortened for including at the identified portion of resized image to generate a notification. The resulting notification displays the text and image data optimally within the limited screen space of the client device so that a user observing the notification can obtain the information at a glance.

Claims (66)

1. A method comprising:

receiving, by a processor, an image to be forwarded to a client device of a user;

retrieving, by the processor, a device specification of the client device from a device profile database, said device specification comprising a screen size and shape associated with a display screen of the client device;

resizing, by the processor, the image based on the retrieved device specification;

determining, by the processor, textual content to be forwarded to the client device with the resized image;

identifying, by the processor, a location within the resized image for placement of the textual content, said identification comprising determining if a predetermined position is associated with a content category of the resized image:

when the resized image has an associated predetermined position, the identified location is associated with the predetermined position,

when the resized image does not have the associated predetermined position, the identified location is based on positions of location elements within the resized image; and

transmitting, by the processor to the client device, the resized image with the textual content positioned at the identified location.

2. The method of claim 1 , further comprising:

producing, by the processor, a notification comprising the resized image and the textual content positioned at the identified location; and

transmitting, by the processor, the notification for display at the client device.

3. The method of claim 1 , wherein the device specification of the client device comprising a screen size of the client device.

4. The method of claim 3 , determining textual content further comprises:

comparing, by the processor, a length of text data of the textual content with a predetermined threshold length associated with the screen size of the client device; and

determining, by the processor, the text data as the textual content to be forwarded to the client device if the length of the text data is less than the predetermined threshold length.

5. The method of claim 4 , determining textual content further comprises:

generating, by the processor, a summary of the text data if the length of the text data is greater than the predetermined threshold length; and

identifying, by the processor, the summary as the textual content to be forwarded to the client device.

6. The method of claim 5 , the summary is generated using natural language processing.

7. The method of claim 1 , the image is resized by the processor using seam carving techniques.

8. The method of claim 1 , further comprising:

identifying, by the processor using image processing techniques, significant elements of the resized image; and

identifying, by the processor using image processing techniques, positions of the significant elements within the resized image.

9. The method of claim 8 , identifying the location within the resized image for placing the textual content further comprises:

categorizing, by the processor, the resized image into one or more content categories based on the significant elements.

10. The method of claim 9 , wherein the location within the resized image for the placement of the textual content is identified based on the content categories of the resized image and the positions of the significant elements within the received image.

11. The method of claim 9 , the location within the resized image for the placement of the textual content is a center of the resized image for content categories that include generic images.

12. The method of claim 1 , further comprising:

providing, by the processor, training data to a classifier to train the classifier for categorizing images into one or more content categories.

13. The method of claim 1 , the client device comprising a smartwatch.

14. An apparatus comprising:

at least one processor;

a non-transitory computer-readable storage medium for tangibly storing thereon program logic for execution by the processor, the program logic comprising:

image receiving logic, executed by the processor, for receiving an image to be forwarded to a client device of a user;

text retrieving logic, executed by the processor, for retrieving a device specification of the client device from a device profile database, said device specification comprising a screen size and shape associated with a display screen of the client device;

resizing logic, executed by the processor, for resizing the image based on the retrieved device specification;

determining logic, executed by the processor, for determining textual content to be forwarded to the client device with the resized image;

identifying logic, executed by the processor, for identifying a location within the resized image for placement of the textual content, said identification comprising determining if a predetermined position is associated with a content category of the resized image:

when the resized image has an associated predetermined position, the identified location is associated with the predetermined position,

when the resized image does not have the associated predetermined position, the identified location is based on positions of location elements within the resized image; and

transmitting logic, executed by the processor, for transmitting, to the client device, the resized image with the textual content positioned at the identified location.

15. The apparatus of claim 14 , further comprising:

producing logic, executed by the processor, for producing a notification comprising the resized image and the textual content positioned at the identified location.

16. The apparatus of claim 15 , the transmitting logic further comprising:

notification transmitting logic, executed by the processor, for transmitting the notification for display at the client device.

17. The apparatus of claim 14 , the identifying logic further comprising:

element identifying logic, executed by the processor, for identifying, using image processing techniques, significant elements of the resized image; and

position identifying logic, executed by the processor, for using image processing techniques, positions of the significant elements within the resized image.

18. The apparatus of claim 17 , the identifying logic further comprises:

categorizing logic, executed by the processor, for categorizing the resized image into one or more content categories based on the significant elements.

19. The apparatus of claim 14 , the identifying logic further comprises:

location identifying logic, executed by the processor, for identifying location within the resized image for the placement of the textual data based on the content categories of the resized image and the positions of the significant elements within the received image.

20. The apparatus of claim 14 , wherein the device specification of the client device comprising a screen size of the client device.

21. The apparatus of claim 14 , the determining logic further comprises:

comparing logic, executed by the processor, for comparing a length of text data of the textual content with a predetermined threshold length associated with the screen size of the client device; and

text data determining logic, executed by the processor, for determining the text data as the textual content to be forwarded to the client device if the length of the text data is less than the predetermined threshold length.

22. A non-transitory computer readable storage medium tangibly encoded with computer-executable instructions that when executed by a processor a computing device, perform a method comprising:

receiving an image to be forwarded to a client device of a user;

retrieving a device specification of the client device from a device profile database, said device specification comprising a screen size and shape associated with a display screen of the client device;

resizing the image based on the retrieved device specification;

determining textual content to be forwarded to the client device with the resized image;

identifying a location within the resized image for placement of the textual content, said identification comprising determining if a predetermined position is associated with a content category of the resized image:

when the resized image has an associated predetermined position, the identified location is associated with the predetermined position,

when the resized image does not have the associated predetermined position, the identified location is based on positions of location elements within the resized image; and

transmitting, to the client device, the resized image with the textual content positioned at the identified location.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2021
From: VERIZON MEDIA INC.
To: VERIZON PATENT AND LICENSING INC.
Reel/Frame 057453/0431 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2020
From: OATH INC.
To: VERIZON MEDIA INC.
Reel/Frame 054258/0635 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 2, 2018
From: YAHOO HOLDINGS, INC.
To: OATH INC.
Reel/Frame 045240/0310 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 15, 2017
From: NI, BIN; LI, JIA
To: YAHOO! INC.
Reel/Frame 043288/0625 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 15, 2017
From: YAHOO! INC.
To: YAHOO HOLDINGS, INC.
Reel/Frame 043550/0396 →
Continuity (2)
Continuation 14548852 · Nov 20, 2014
Related Publication 20170322908A1 · Nov 9, 2017