IP Library › Granted Patent US 11,157,549
Granted Patent B2
US 11,157,549 · App. 16/293,812 · Granted Oct 26, 2021

Emotional experience metadata on recorded images

Inventors: Ilse M. Breedvelt-Schouten (Manotick, CA); Jana H. Jenkins (Raleigh, NC); Jeffrey A. Kusnitz (Campbell, CA); John A. Lyons (Ottawa, CA)
Assignee: International Business Machines Corporation
G06F16/583A61B5/16G06F16/783G06K9/00302
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,157,549
App. No.
16/293,812
Granted
Oct 26, 2021
Kind
B2
Abstract

Provided are techniques for enhancing images with emotion information, comprising capturing a plurality of images; identifying an individual in the plurality of images; analyzing the plurality of images for emotional content; converting the emotional content into emotion metadata; correlating the emotional content with the individual to produce associated emotion metadata; and storing the associated emotion metadata in conjunction with the captured image in a computer-readable storage medium. The disclosed techniques may also include capturing physiological data corresponding to an individual that captures the image; analyzing the physiological data for a second emotional content; converting the second emotional content into a second emotion metadata; storing the second emotion metadata in conjunction with the captured image in the computer-readable storage medium.

Claims (41)

1. A system for enhancing images with emotion information, comprising:

a processor;

a non-transitory, computer-readable storage medium coupled to the processor; and

instructions stored on the computer-readable storage medium and executed on the processor for performing a method, the method comprising:

capturing an image;

capturing physiological data corresponding to an individual that captures the image, wherein the physiological data comprises at least finger pressure of the individual during image capture of the image;

identifying an individual in the image;

analyzing the image for a first emotional content, wherein the analyzing comprises evaluating a facial expression of the individual and prioritizing emotions based on data from one or more sensors;

converting the first emotional content into emotion metadata;

correlating the first emotional content with the individual to produce a first associated emotion metadata;

storing the first associated emotion metadata in conjunction with the image in

the computer-readable storage medium

analyzing the physiological data for a second emotional content; converting the second emotional content into a second emotion metadata; and

storing the second emotion metadata in conjunction with the image in the computer-readable storage medium.

2. The system of claim 1 , wherein the system is a smartphone.

3. The system of claim 1 , the method further comprising retrieving a subset of stored images with a search based upon the emotion metadata, wherein the subset of stored images have an individual emotional metadata associated with each individual image within the subset of stored images.

4. The system of claim 1 , wherein the physiological data further comprises at least one of the following:

heartrate;

skin temperature;

skin conductivity;

skin electricity; and

moisture.

5. A computer programming product for enhancing images with emotion information, comprising a non-transitory computer-readable storage medium having program code embodied therewith, the program code executable by a plurality of processors to perform a method comprising:

capturing an image;

capturing physiological data corresponding to an individual that captures the image, wherein the physiological data comprises at least finger pressure of the individual during image capture of the image;

identifying an individual in the image;

analyzing the image for a first emotional content, wherein the analyzing comprises evaluating a facial expression of the individual and prioritizing emotions based on data from one or more sensors;

converting the first emotional content into emotion metadata;

correlating the first emotional content with the individual to produce a first associated emotion metadata;

storing the first associated emotion metadata in conjunction with the image in

the computer-readable storage medium

analyzing the physiological data for a second emotional content;

converting the second emotional content into a second emotion metadata; and

storing the second emotion metadata in conjunction with the image in the computer-readable storage medium.

6. The computer programming product of claim 5 , wherein the physiological data further comprises at least one of the following:

heartrate;

skin temperature;

skin conductivity;

skin electricity; and

moisture.

7. The computer programming product of claim 5 , the method further comprising retrieving a subset of stored images with a search based upon the emotion metadata, wherein the subset of stored images have an individual emotional metadata associated with each individual image within the subset of stored images.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 6, 2019
From: BREEDVELT-SCHOUTEN, ILSE M.; JENKINS, JANA H.; KUSNITZ, JEFFREY A.; LYONS, JOHN A.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 048514/0280 →
Continuity (1)
Related Publication 20200285668A1 · Sep 10, 2020