IP Library Granted Patent US 9,495,608
Granted Patent B2
US 9,495,608 · App. 14/354,956 · Granted Nov 15, 2016

Smart feeling sensing tag for pictures

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,495,608
App. No.
14/354,956
Granted
Nov 15, 2016
Kind
B2
Abstract

The invention is directed to systems, methods and computer program products for determining a mood and a strength of an image. An exemplary method comprises: determining a mood of an image based on a color tone and a color saturation of the image; determining a strength of an image based on a brightness of the image; determining a mood-strength distribution of the image based on the mood of the image and the strength of the image; and selecting a music piece based on the mood-strength distribution of the image.

Claims (44)

1. A method for determining a mood and a strength of an image, the method comprising:

determining a mood index for an image based at least on a color tone of the image, a color saturation of the image and an image pattern coefficient associated with an image pattern that is matched to a human face present in the image;

determining a strength of an image based on a brightness of the image;

determining a mood-strength distribution of the image based on the mood index of the image and the strength of the image; and

selecting, using a computing device, a music piece based on the mood-strength distribution of the image.

2. The method of claim 1 , further comprising:

plotting the mood index of the image and the strength of the image on a dual-axis chart, wherein the chart comprises a mood index axis and a strength axis, and wherein the plotted image represents a mood-strength distribution of the image.

3. The method of claim 1 , wherein a hue of the image represents the color tone of the image and a chroma of the image represents the color saturation of the image.

4. The method of claim 1 , wherein the mood index is associated with a happiness scale.

5. The method of claim 4 , wherein an image that has a predominantly cyan color tone is placed lower on the happiness scale compared to an image that has a predominantly red color tone.

6. The method of claim 4 , wherein an image that has higher color saturation level is placed higher on the happiness scale compared to an image that has a lower color saturation level.

7. The method of claim 1 , further comprising determining a grid for the image, wherein the grid divides the image into a grid of blocks, and wherein a size of the grid is based on a size of the image.

8. The method of claim 7 , further comprising:

determining a color tone and a color saturation for each block in the grid of blocks; and

plotting a hue and chroma color space based on the determined color tone and the color saturation for each block in the grid of blocks.

9. The method of claim 7 , further comprising:

determining an intermediary mood index for each block in the grid of blocks; and

determining the mood index based on a summation of the intermediary mood indices.

10. The method of claim 9 , further comprising:

determining whether the human face is present in the image;

in response to determining the human face is present in the image, determining whether an image pattern associated with the face substantially matches the image pattern in a database of image patterns;

determining the image pattern coefficient associated with the matched image pattern; and

using the image pattern coefficient in determining the intermediary mood index.

11. The method of claim 1 , wherein the strength of the image is associated with a strength scale, and wherein an image with a higher brightness level is placed higher on the strength scale compared to an image that a lower brightness level.

12. The method of claim 1 , wherein the brightness of the image is determined based on histogram information associated with the image, wherein the histogram information is a graphical representation of an energy distribution of the image.

13. The method of claim 1 , wherein the computing device comprises a portable mobile communication device.

14. The method of claim 1 , wherein the selecting step comprises determining a music piece such that a mood-strength distribution of the music piece substantially matches the mood-strength distribution of the image.

15. The method of claim 1 , further comprising:

presenting the image as part of an image slideshow, wherein the slideshow comprises at least two images; and

playing the music piece simultaneously with the presentation of the image slideshow.

16. An apparatus for determining a mood and a strength of an image, the apparatus comprising:

a memory;

a processor; and

a module stored in the memory, executable by the processor, and configured to:

determine a mood index for an image based at least on a color tone of the image, a color saturation of the image and an image pattern coefficient associated with an image pattern that is matched to a human face present in the image;

determine a strength of an image based on a brightness of the image;

determine a mood-strength distribution of the image based on the mood index of the image and the strength of the image; and

select a music piece based on the mood-strength distribution of the image.

17. A computer program product for determining a mood and a strength of an image, the computer program product comprising:

a non-transitory computer-readable medium comprising a set of codes for causing a computer to:

determine a mood index for an image based at least on a color tone of the image, a color saturation of the image and an image pattern coefficient associated with an image pattern that is matched to a human face present in the image;

determine a strength of an image based on a brightness of the image;

determine a mood-strength distribution of the image based on the mood of the image and the strength of the image; and

select a music piece based on the mood-strength distribution of the image.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 25, 2019
From: SONY MOBILE COMMUNICATIONS, INC.
To: SONY CORPORATION
Reel/Frame 048691/0134 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2016
From: SONY CORPORATION
To: SONY MOBILE COMMUNICATIONS INC.
Reel/Frame 038542/0224 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2014
From: WANG, JING
To: SONY CORPORATION
Reel/Frame 033323/0493 →