IP Library Granted Patent US 11,516,532
Granted Patent B2
US 11,516,532 · App. 16/886,448 · Granted Nov 29, 2022

Detection of items in a home

Inventor: Aleksey Tumanov (Kremenchuk, UA)
Assignee: Dish Ukraine L.L.C.
H04N21/4223G06Q30/0242H04N21/251H04N21/25891H04N21/2668H04N21/44213H04N21/4532H04N21/812G06Q30/0269
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,516,532
App. No.
16/886,448
Granted
Nov 29, 2022
Kind
B2
Abstract

Various arrangements for detecting items in home are presented. Imaging devices may capture images of a user's home. The images may be analyzed and compared against a user approved list of item definitions. Using the definitions, items, brands, trademarks, and the like may be identified in the images. The items identified in the images may be used to determine preferences of a user and provide targeted marketing content using the television receiver. In some cases, analysis of items in a home may be used to determine the effectiveness of marketing content by determining causality or correlations between marketing content viewed by a user and items in the home.

Claims (62)

1. A method for customer preference detection, comprising:

activating an imaging device using a user device disposed in a user premises, the activating comprising directing the imaging device to capture raw images of an area of the user premises in view of a television coupled with the user device;

analyzing the raw images, locally by the user device in response to the imaging device capturing the raw images, the analyzing comprising:

comparing the raw images against one or more locally stored background images of the area of the user premises to determine whether there is at least a threshold difference between the raw images and the background images; and

detecting, in response to determining that there is at least the threshold difference, one or more identified items as present in the area in accordance with a database of image signatures stored locally by the user device, the image signatures corresponding to a plurality of identifiable items comprising the one or more identified items;

generating, locally by the user device, a list of the one or more identified items; and

reporting the one or more identified items to a service provider as detected in the user premises, the reporting comprising transmitting the list of the one or more identified items from the user device to the service provider via a service provider network and monitoring output of the user device to prevent transmitting the raw images from the user device via the service provider network while maintaining the raw images locally at the user device.

2. The method of claim 1 , further comprising:

activating, by the user device, a local security mechanism of the user device prior to the reporting,

wherein the monitoring is by the local security mechanism.

3. The method of claim 2 , wherein the local security mechanism comprises a security policy and/or a firewall.

4. The method of claim 1 , further comprising:

storing the list of the one or more identified items in a historical record maintained locally by the user device.

5. The method of claim 1 , wherein the generating the list of the one or more identified items comprises:

detecting a plurality of identifiable items; and

filtering the plurality of identifiable items according to user preferences to obtain a set of filtered identified items, the list of the one or more identified items indicating the set of filtered identified items.

6. The method of claim 5 , wherein the user preferences direct the filtering to be based on: field of view for imaging, a portion of the area defined as off limits for imaging, types of item definition, product brand, and/or specified times.

7. The method of claim 1 , further comprising:

updating a stored historical record of identified items in the user premises based on the generating; and

analyzing the historical record to detect an effectiveness of marketing content by comparing an expected response of the marketing content with an observed effect of the marketing content derived from the historical record.

8. The method of claim 1 , further comprising:

updating a stored historical record of identified items in the user premises based on the generating; and

analyzing the historical record to detect coincidence or correlation between identified items in the user premises and programming content being watched by users in the user premises.

9. The method of claim 1 , wherein the generating the list of the one or more identified items comprises:

associating the one or more identified items with a user profile.

10. The method of claim 9 , further comprising:

updating a stored historical record of identified items in the user premises based on the associating; and

analyzing the historical record to detect a life change, a trends, and/or a change in user product preference for the user profile.

11. The method of claim 1 , further comprising:

receiving marketing content by the user device from the service provider, the marketing content based on the list of the one or more identified items and responsive to the transmitting.

12. The method of claim 1 , wherein the analyzing comprises:

processing the raw images to detect a word, a letter, a mark indicative of a brand name, a mark indicative of a product, a product barcodes, and/or a machine readable code located on a product.

13. A user device to couple with a television in a user premises, and to couple with a service provider via a service provider network, the user device comprising:

one or more processors; and

a non-transient memory communicatively coupled with the one or more processors and having stored therein:

a database of image signatures stored locally by the user device, the image signatures corresponding to a plurality of identifiable items; and

processor-readable instructions which, when executed by the one or more processors, cause the one or more processors to:

activate an imaging device by directing the imaging device to capture raw images of an area of the user premises in view of the television;

analyze the raw images locally by:

comparing the raw images against one or more locally stored background images of the area of the user premises to determine whether there is at least a threshold difference between the raw images and the background images; and

detecting, in response to determining that there is at least the threshold difference, one or more identified items as present in the area in accordance with the database of image signatures, the plurality of identifiable items comprising the one or more identified items;

generate, locally, a list of the one or more identified items; and

report the one or more identified items to a service provider as detected in the user premises, the reporting comprising transmitting the list of the one or more identified items to the service provider via the service provider network and monitoring output to prevent transmitting the raw images via the service provider network while maintaining the raw images locally at the user device.

14. The user device of claim 13 , wherein the processor-readable instructions, when executed by the one or more processors, cause the one or more processors further to:

activate a local security mechanism of the user device prior to the reporting,

wherein the monitoring is by the local security mechanism.

15. The user device of claim 13 , further comprising the imaging device integrated in the user device.

16. The user device of claim 13 , wherein:

the non-transient memory further has, stored therein, a historical record of identified devices in the user premises over time; and

the processor-readable instructions, when executed by the one or more processors, cause the one or more processors further to store the list of the one or more identified items in the historical record.

17. The user device of claim 13 , wherein the processor-readable instructions, when executed by the one or more processors, cause the one or more processors to generate the list of the one or more identified items by:

detecting a plurality of identifiable items; and

filtering the plurality of identifiable items according to user preferences to obtain a set of filtered identified items, the list of the one or more identified items indicating the set of filtered identified items.

18. The user device of claim 13 , wherein the processor-readable instructions, when executed by the one or more processors, cause the one or more processors further to:

update a stored historical record of identified items in the user premises based on the generating; and

analyze the historical record to detect an effectiveness of marketing content by comparing an expected response of the marketing content with an observed effect of the marketing content derived from the historical record.

19. The user device of claim 13 , wherein the processor-readable instructions, when executed by the one or more processors, cause the one or more processors further to:

update a stored historical record of identified items in the user premises based on the generating; and

analyze the historical record to detect coincidence or correlation between identified items in the user premises and programming content being watched by users in the user premises.

20. The user device of claim 13 , wherein the processor-readable instructions, when executed by the one or more processors, cause the one or more processors further to:

update a stored historical record of identified items in the user premises based on associating the one or more identified items with a user profile; and

analyze the historical record to detect a life change, a trends, and/or a change in user product preference for the user profile.

Assignments (2)
CHANGE OF NAME Recorded Sep 16, 2022
From: ECHOSTAR UKRAINE L.L.C.
To: DISH UKRAINE L.L.C.
Reel/Frame 061766/0349 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 8, 2022
From: TUMANOV, ALEKSEY
To: ECHOSTAR UKRAINE L.L.C.
Reel/Frame 061100/0623 →
Continuity (3)
Continuation 16182556 · Nov 6, 2018
Continuation 15508070
Related Publication 20200296445A1 · Sep 17, 2020