IP Library Granted Patent US 9,877,058
Granted Patent B2
US 9,877,058 · App. 14/956,534 · Granted Jan 23, 2018

Presenting personalized advertisements on smart glasses in a movie theater based on emotion of a viewer

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,877,058
App. No.
14/956,534
Granted
Jan 23, 2018
Kind
B2
Abstract

A method for presenting advertisements based on emotion of a viewer is provided. A first emotional state of a viewer wearing smart glasses is detected using first sensor data captured by a sensor of the glasses. A rate is set according to the detected first emotional state. A set of advertisements is displayed on the smart glasses according to the set rate while a movie is played so that the advertisements are perceived by the viewer as overlaying the movie.

Claims (48)

1. A method for presenting advertisements based on emotion of a viewer, the method comprising:

detecting a first emotional state of a viewer experienced in response to observing an initial advertisement, the viewer wearing smart glasses, the detecting using first sensor data captured by a sensor of the smart glasses;

setting a rate to a first rate when the first emotional state indicates the viewer is experiencing a negative emotion towards the initial advertisement;

setting the rate to a second rate when the first emotional state indicates the viewer is experiencing a positive emotion towards the initial advertisement, where the first rate is less than the second rate; and

displaying a set of advertisements on the smart glasses according to the set rate while a movie is played so that the set of advertisements are perceived by the viewer as overlaying the movie,

wherein the overlaying comprises:

mapping each advertisement of the set to a given frame of the movie and a position within the frame,

wherein the mapping comprises:

detecting an object displayed on the frame;

comparing meta-data of the movie associated with the detected object against meta-data of each advertisement of the set to select one of the advertisements of the set;

determining a background image of the frame; and

setting the position of the selected one advertisement to a first position in the frame that corresponds to the background image of the frame,

wherein the set rate is a number of advertisements to display during a given time period.

2. The method of claim 1 , further comprises:

querying the viewer to indicate whether to continue presentation of the advertisements when the detected first emotional state corresponds to the negative emotion;

setting the previously set rate to 0 when a response to the querying indicates that the presentation is not to continue; and

maintaining the previously set rate when the response to the querying indicates the presentation is to continue.

3. The method of claim 1 , wherein the positive emotion indicates the viewer is happy or excited.

4. The method of claim 1 , wherein the negative emotion indicates the viewer is bored.

5. The method of claim 1 , wherein the overlaying further comprises:

selecting the set of the advertisements from a larger set of advertisements based on the meta-data associated with the movie and meta-data associated with the larger set of advertisements.

6. The method of claim 5 , wherein the mapping further comprises:

comparing meta-data within user profile information of the viewer against the meta-data of the set of advertisements to select one of the advertisements.

7. The method of claim 6 , wherein the user profile information is downloaded from a mobile device that is in communication with the smart glasses.

8. An apparatus for presenting advertisements based on emotions of a viewer, the apparatus comprising:

a frame comprising a display glass;

an eye movement sensor;

a memory storing a computer program; and

a processor configured to execute the computer program,

wherein the computer program is configured to detect a first emotional state of a viewer experienced in response to observing an initial advertisement, the viewer wearing the frame, the detecting using first sensor data captured by the sensor, set a rate to a first rate when the first emotional state indicates the viewer is experiencing a negative emotion towards the initial advertisement, set the rate to a second rate when the first emotional state indicates the viewer is experiencing a positive emotion towards the initial advertisement, and display a set of advertisements on the display glass according to the set rate while a movie is played so that the set of advertisements are perceived by the viewer as overlaying the movie, where the first rate is less than the second rate,

wherein the display of the set of advertisements includes displaying a first advertisement, from among the set of advertisements, in a first frame of the movie,

wherein the first frame of the movie is analyzed by the computer program to detect an interesting area and an uninteresting area, wherein the interesting area includes more objects than the uninteresting area, and

wherein displaying the first advertisement includes placing the first advertisement in the uninteresting area,

wherein the set rate is a number of advertisements to display during a given time period.

9. The apparatus of claim 8 , wherein the positive emotion indicates the viewer is interested, and the negative emotion indicates the viewer is dis-interested.

10. The apparatus of claim 8 , wherein the computer program detects a second emotional state of the viewer after the advertisements have been overlayed using second sensor data captured by the sensor, and determines whether the rate should be adjusted based on the detected second emotional state.

11. The apparatus of claim 10 , wherein the computer program decreases the previously set rate when the detected second emotional state corresponds to a negative emotion, and maintains the previously set rate when the detected second emotional state does not correspond to a negative emotion.

12. The apparatus of claim 8 , further comprising a projector, wherein the computer program projects the movie onto the display glass using the projector.

13. The apparatus of claim 8 , wherein the sensor is a camera.

14. A system for presenting advertisements based on emotions of a viewer, the system comprising:

smart glasses configured to detect a first emotional state of a viewer experienced in response to observing an initial advertisement using first sensor data captured by a sensor, set a rate to a first rate when the first emotional state indicates the viewer is experiencing a positive emotion towards the initial advertisement, set the rate to a second rate when the first emotional state indicates the viewer is experiencing a negative emotion towards the initial advertisement, and display a subset of advertisements according to the set rate while a movie is played so that the subset of advertisements are perceived by the viewer as overlaying the movie, wherein the first rate is less than the second rate; and

a server configured to send a set of advertisements comprising the subset to the smart glasses,

wherein the display of the subset of advertisements includes displaying a first advertisement, from among the subset of advertisements in a first frame of the movie,

wherein the first frame of the movie is analyzed by the smart glasses to detect an interesting area and an uninteresting area,

wherein the interesting area includes more objects than the uninteresting area, and wherein displaying the first advertisement includes placing the first advertisement in the uninteresting area,

wherein the set rate is a number of advertisements to display during a given time period.

15. The system of claim 14 , wherein the smart glasses displays the advertisements by selecting the subset of the advertisements from the set of advertisements based on meta-data associated with the movie and meta-data associated with the set of advertisements, and maps each advertisement of the selected set to a given frame of the movie and a position within the frame.

16. The system of claim 15 , wherein the smart glasses are configured to receive user profile information from a remote mobile device, and perform the mapping by comparing meta-data within the user profile information against meta-data of the subset of advertisements to select one of the advertisements, and set a position of the selected one advertisement to a position in the frame.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 15, 2021
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: AIRBNB, INC.
Reel/Frame 056427/0193 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2015
From: DEY, KUNTAL; EKAMBARAM, VIJAY; NAGAR, SEEMA; RALLAPALLI, SWATI
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 037187/0148 →