IP Library › Granted Patent US 11,163,822
Granted Patent B2
US 11,163,822 · App. 16/525,718 · Granted Nov 2, 2021

Emotional experience metadata on recorded images

Inventors: Ilse M. Breedvelt-Schouten (Manotick, CA); Jana H. Jenkins (Raleigh, NC); Jeffrey A. Kusnitz (Campbell, CA); John A. Lyons (Ottawa, CA)
Assignee: International Business Machines Corporation
G06F16/583A61B5/16G06F16/783G06K9/00302
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,163,822
App. No.
16/525,718
Filed
Jul 30, 2019
Granted
Nov 2, 2021
Kind
B2
Art Unit
2669
USPC
382/100
Abstract

Provided are techniques for enhancing images with emotion information, comprising capturing a plurality of images; identifying an individual in the plurality of images; analyzing the plurality of images for emotional content; converting the emotional content into emotion metadata; correlating the emotional content with the individual to produce associated emotion metadata; and storing the associated emotion metadata in conjunction with the captured image in a computer-readable storage medium. The disclosed techniques may also include capturing physiological data corresponding to an individual that captures the image; analyzing the physiological data for a second emotional content; converting the second emotional content into a second emotion metadata; storing the second emotion metadata in conjunction with the captured image in the computer-readable storage medium.

Claims (19)

1. A method for enhancing images with emotion information, comprising:

capturing an image;

capturing physiological data corresponding to an individual that captures the image, wherein the physiological data comprises at least finger pressure of the individual during image capture of the image;

identifying an individual in the image;

analyzing the image for a first emotional content, wherein the analyzing comprises evaluating a facial expression of the individual and prioritizing emotions based on data from one or more sensors;

converting the first emotional content into emotion metadata;

correlating the first emotional content with the individual to produce a first associated emotion metadata;

storing the first associated emotion metadata in conjunction with the image in a computer-readable storage medium;

analyzing the physiological data for a second emotional content;

converting the second emotional content into a second emotion metadata; and

storing the second emotion metadata in conjunction with the image in the computer-readable storage medium.

2. The method of claim 1 , wherein the physiological data further comprises at least one of the following:

heartrate;

skin temperature;

skin conductivity;

skin electricity; and

moisture.

3. The method of claim 1 , wherein the method is implemented on a smartphone.

4. The method of claim 1 , further comprising retrieving a subset of stored images with a search based upon the emotion metadata, wherein the subset of stored images has an individual emotional metadata associated with each individual image within the subset of stored images.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 30, 2019
From: BREEDVELT-SCHOUTEN, ILSE M.; JENKINS, JANA H.; KUSNITZ, JEFFREY A.; LYONS, JOHN A.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 049897/0362 →
Continuity (2)
Continuation 16293812 · Mar 6, 2019
Related Publication 20200285669A1 · Sep 10, 2020