IP Library Granted Patent US 10,032,113
Granted Patent B2
US 10,032,113 · App. 14/693,314 · Granted Jul 24, 2018

Social media event detection and content-based retrieval

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,032,113
App. No.
14/693,314
Granted
Jul 24, 2018
Kind
B2
Abstract

Techniques for detecting an event via social media content. A method includes obtaining multiple images from at least one social media source; extracting at least one visual semantic concept from the multiple images; differentiating an event semantic concept signal from a background semantic concept signal to detect an event in the multiple images; retrieving one or more images associated with the event semantic concept signal; grouping the one or more images associated with the event semantic concept signal; annotating the group of one or more images with user feedback; and displaying the annotated group of one or more images as a visual description of the detected event.

Claims (34)

1. A method for detecting an event via social media content, the method comprising steps of:

obtaining multiple images from at least one social media source;

extracting at least one visual semantic concept from the multiple images;

differentiating an event semantic concept signal associated with the at least one visual semantic concept from a background semantic concept signal to detect an event in the multiple images, wherein said differentiating comprises measuring the deviation of a signal level of the event semantic concept signal from a background semantic concept signal level to detect the occurrence of the event in the multiple images, wherein a measured deviation of the signal level of the event semantic concept signal from the background semantic concept signal level that is above a predetermined threshold corresponds to the occurrence of the event;

retrieving one or more of the multiple images associated with the event semantic concept signal;

grouping the one or more images associated with the event semantic concept signal;

annotating the group of one or more images with user feedback; and

displaying the annotated group of one or more images as a visual description of the detected event;

wherein the steps are carried out by at least one computer device.

2. The method of claim 1 , wherein said differentiating is based on comparing signal strength of each of the at least one extracted visual semantic concept to a predetermined outlier threshold.

3. The method of claim 1 , comprising:

overlaying images annotated with a global position system (GPS) function onto a map to provide a geo-spatial representation of the event.

4. The method of claim 1 , wherein the multiple images from at least one social media source comprise images derived from photo input.

5. The method of claim 4 , wherein the photo input comprises user-posted images on at least one social media source.

6. The method of claim 1 , wherein the multiple images from at least one social media source comprise images derived from video input.

7. The method of claim 6 , wherein the video input comprises user-posted videos on at least one social media source.

8. The method of claim 1 , wherein said obtaining comprises streaming multiple images from the at least one social media source in real-time.

9. The method of claim 1 , wherein the at least one visual semantic concept characterizes an event.

10. The method of claim 1 , wherein said differentiating comprises using an interactive machine learning algorithm.

11. The method of claim 10 , comprising:

assessing which of the multiple images contributed most prominently to event detection as event-related.

12. The method of claim 1 , wherein said differentiating comprises performing a statistical analysis to compute a probability that an event has occurred.

13. The method of claim 1 , comprising:

measuring the signal of each semantic concept over time.

14. The method of claim 1 , comprising:

identifying one or more semantic concept signal peaks that signify a real-time event.

15. The method of claim 1 , comprising:

retrieving one or more additional images that are relevant to a detected event.

16. The method of claim 1 , comprising:

monitoring semantics of images uploaded to one or more social media websites over a specified time period.

17. The method of claim 16 , comprising:

streaming images to a parallel system which applies a set of generated semantic models to the images in real-time.

18. The method of claim 1 , comprising:

specifying a background time period and an event time period.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 15, 2021
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: AIRBNB, INC.
Reel/Frame 056427/0193 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 16, 2017
From: CODELLA, NOEL C.; NATSEV, APOSTOL; SMITH, JOHN R.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 041280/0778 →