IP Library Granted Patent US 10,796,411
Granted Patent B2
US 10,796,411 · App. 16/040,775 · Granted Oct 6, 2020

Super-resolution imaging for a multi-sensor internet of things environment

Inventors: Kfir Wolfson (Beer Sheva, IL); Assaf Natanzon (Tel Aviv, IL); Jehuda Shemer (Kfar Saba, IL)
Assignee: EMC IP Holding Company LLC
G06T3/4053G06T3/4038G06T5/002
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,796,411
App. No.
16/040,775
Granted
Oct 6, 2020
Kind
B2
Abstract

Image combination techniques are provided for a multi-sensor Internet of Things environment. An exemplary method comprises: dynamically determining an image resolution for at least a portion of an image to be collected by and/or transmitted by a plurality of image sensors within a distributed network based on one or more predefined image resolution rules with respect to an available bandwidth; and combining the image portions from the plurality of image sensors to generate at least one higher resolution image, such as a super-resolution image. The predefined image resolution rules specify, for example, that the portions of an image that have changed should be transmitted with a higher resolution relative to portions of the image that have not changed; and/or that multiple versions of a given image should be combined when the given image is degraded by noise. A plurality of low resolution images having a substantially similar alignment are optionally obtained and combined to obtain at least one high resolution image.

Claims (28)

1. A method, comprising:

dynamically determining, by at least one processing device within a distributed network comprised of a plurality of image sensors, an image resolution for at least a portion of an image to be transmitted by the plurality of image sensors within the distributed network based on one or more predefined image resolution rules with respect to an available bandwidth; and

combining, by the at least one processing device, the image portions from the plurality of image sensors to generate at least one higher resolution image.

2. The method of claim 1 , further comprising the steps of obtaining a plurality of low resolution images having a substantially similar alignment and combining the plurality of low resolution images to obtain at least one high resolution image.

3. The method of claim 2 , wherein the one or more predefined image resolution rules specify that the plurality of low resolution images is collected over time.

4. The method of claim 2 , wherein the substantially similar alignment of the low resolution images is determined based on previously obtained images.

5. The method of claim 2 , wherein one or more of the low resolution images are obtained based on one or more of an instruction from at least one aggregation device and one or more predefined policies.

6. The method of claim 1 , wherein the one or more predefined image resolution rules specify that the portions of an image that have changed should be transmitted with a higher resolution relative to portions of the image that have not changed.

7. The method of claim 1 , wherein the one or more predefined image resolution rules specify that multiple versions of a given image should be combined when the given image is degraded by noise.

8. The method of claim 1 , further comprising the step of determining a location of an image source by computing a centroid of a light distribution extending over a plurality of adjacent pixels in the image portions from at least one of the image sensors.

9. The method of claim 1 , wherein the one or more predefined image resolution rules are based on one or more predefined policies.

10. A system, comprising:

a memory; and

at least one processing device, coupled to the memory, operative to implement the following steps:

dynamically determining an image resolution for at least a portion of an image to be transmitted by a plurality of image sensors within a distributed network based on one or more predefined image resolution rules with respect to an available bandwidth; and

combining the image portions from the plurality of image sensors to generate at least one higher resolution image.

11. The system of claim 10 , further comprising the steps of obtaining a plurality of low resolution images having a substantially similar alignment and combining the plurality of low resolution images to obtain at least one high resolution image.

12. The system of claim 10 , wherein the one or more predefined image resolution rules specify that the portions of an image that have changed should be transmitted with a higher resolution relative to portions of the image that have not changed.

13. The system of claim 10 , wherein the one or more predefined image resolution rules specify that multiple versions of a given image should be combined when the given image is degraded by noise.

14. The system of claim 10 , further comprising the step of determining a location of an image source by computing a centroid of a light distribution extending over a plurality of adjacent pixels in the image portions from at least one of the image sensors.

15. The system of claim 10 , wherein the one or more predefined image resolution rules are based on one or more predefined policies.

16. A computer program product, comprising a non-transitory machine-readable storage medium having encoded therein executable code of one or more software programs, wherein the one or more software programs when executed by at least one processing device perform the following steps:

dynamically determining an image resolution for at least a portion of an image to be transmitted by a plurality of image sensors within a distributed network based on one or more predefined image resolution rules with respect to an available bandwidth; and

combining the image portions from the plurality of image sensors to generate at least one higher resolution image.

17. The computer program product of claim 16 , further comprising the steps of obtaining a plurality of low resolution images having a substantially similar alignment and combining the plurality of low resolution images to obtain at least one high resolution image.

18. The computer program product of claim 16 , wherein the one or more predefined image resolution rules specify that the portions of an image that have changed should be transmitted with a higher resolution relative to portions of the image that have not changed.

19. The computer program product of claim 16 , wherein the one or more predefined image resolution rules specify that multiple versions of a given image should be combined when the given image is degraded by noise.

20. The computer program product of claim 16 , wherein the one or more predefined image resolution rules are based on one or more predefined policies.

Assignments (8)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (047648/0422) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060160/0862 →
RELEASE OF SECURITY INTEREST AT REEL 047648 FRAME 0346 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 058298/0510 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Oct 12, 2018
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 047648/0422 →
PATENT SECURITY AGREEMENT (CREDIT) Recorded Oct 12, 2018
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 047648/0346 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 24, 2018
From: WOLFSON, KFIR; NATANZON, ASSAF; SHEMER, JEHUDA
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 046440/0223 →