IP Library Granted Patent US 9,424,471
Granted Patent B2
US 9,424,471 · App. 13/155,881 · Granted Aug 23, 2016

Enhanced information for viewer-selected video object

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,424,471
App. No.
13/155,881
Granted
Aug 23, 2016
Kind
B2
Abstract

The user of an Internet-enabled CE device such as a TV can select an object in a video presented on the display of the CE device by either touch sensitive screen or input device. The processor of the CE device can then determine the boundaries of the object, identify it using face/image recognition software, search for information/websites related to the object, and present those information/websites to the viewer on the display screen.

Claims (40)

1. CE device comprising:

display;

network interface;

processor controlling the display and communicating with the Internet through the network interface;

the processor executing logic including:

presenting video on the display;

receiving a user selection of an area of the display;

using image recognition, determining an object in the area of the display, the object being part of the video;

correlating the object to basic information relating thereto;

presenting the basic information on the display; and

along with the basic information, presenting a first user interface (UI) on the display usable by a person to select additional information pertaining to the object, wherein the first UI includes a general search engine selector element selectable without a user typing in an Internet address to automatically launch a general Internet search for the additional information pertaining to the object, the UI also including at least one website search selector element selectable to automatically launch a search for the additional information pertaining to the object only on a predetermined web site that is not a general search engine web site such that if the website search selector element is selected only results pertaining to the additional information pertaining on the predetermined web site are returned for presentation on the display.

2. The CE device of claim 1 , wherein the object is a person, the processor determining who the person is using a face recognition engine, the basic information including a name of the person.

3. The CE device of claim 1 , wherein the object is a product, the processor determining what the product is using an image recognition engine, the basic information including a name and manufacturer of the product.

4. The CE device of claim 1 , wherein the display is a touch sensitive display and the user selection of an area of the display is a tactile touch on the display.

5. The CE device of claim 1 , wherein the user selection of an area of the display is a screen cursor selection.

6. The CE device of claim 1 , wherein responsive to the user selection of an area of the display, a second UI is presented on the display enabling a person to select to identify the object prior to using image recognition to determine the object in the area of the display.

7. Method, comprising:

presenting a video stream on a touch sensitive display;

receiving a touch signal from the display representing a display location;

responsive to the touch signal, determining an identity of an object in the video stream at the display location;

responsive to determining the identity, presenting information related to the object;

along with the information, presenting a first selector which when selected by a user allows a user to search for additional data related to the object from one and only one website, and simultaneously presenting a second selector which when selected by the user allows the user to search for additional data related to the object by invoking a general Internet search engine; and

responsive to user input selecting the first selector automatically searching the one and only one website for the additional data and responsive to user input selecting the second selector, automatically searching the Internet using a general Internet search engine for the additional data.

8. The method of claim 7 , wherein the information is presented on the display.

9. The method of claim 7 , wherein the object is a person.

10. The method of claim 7 , wherein the object is not a person.

11. CE device comprising:

touch sensitive display; and

processor controlling the display;

the processor executing logic including:

presenting video on the display;

receiving from the display a user selection of an area of the display;

determining an object in the area of the display, the object being part of the video;

presenting information on the display pertaining to the object; and

along with the information, presenting a first user interface (UI) on the display usable by a person to select additional information pertaining to the object, wherein the first UI enables selection of a general search engine pertaining to the object and simultaneously enables selection of a search related to the object on a predetermined vendor web site which if selected returns only results pertaining to the object available on the vendor web site.

12. The CE device of claim 11 , wherein the object is a person, the processor determining who the person is using a face recognition engine, the information including a name of the person.

13. The CE device of claim 11 , wherein the object is a product, the processor determining what the product is using an image recognition engine, the information including a name and manufacturer of the product.

14. The CE device of claim 11 , wherein the display is a touch sensitive display and the user selection of an area of the display is a tactile touch on the display.

15. The CE device of claim 11 , wherein the user selection of an area of the display is a screen cursor selection.

16. The CE device of claim 11 , wherein responsive to the user selection of an area of the display, a second UI is presented on the display enabling a person to select to identify the object prior to using image recognition to determine the object in the area of the display.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2022
From: SONY GROUP CORPORATION
To: SATURN LICENSING LLC
Reel/Frame 062072/0850 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 11, 2022
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 062048/0427 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 8, 2011
From: HILL, SETH GUY; NGUYEN, DJUNG; ASAM, ARAVIND BABU; YU, XUDONG; SUGIYAMA, NOBUKAZU; KIM, DONGWOOK; HSIAO, ERIC; SAHA, DIPENDU; AGNIHOTRI, TANMAY; SCHUPP, WILLIAM ARTHUR
To: SONY CORPORATION
Reel/Frame 026410/0443 →