IP Library Granted Patent US 10,902,577
Granted Patent B2
US 10,902,577 · App. 15/977,085 · Granted Jan 26, 2021

System and method for hyperspectral image processing to identify object

Inventors: Lars Gustav Magnus Nipe (Uppsala, SE); Abilasha Ramanan (London, GB)
Assignee: Apeel Technology, Inc.
G06T7/0004G01N33/02G06K9/00664G06K9/42G06K9/46G06K9/6202G06K9/628G06K9/6274G06T7/11G06K2009/4657G06K2209/17G06T2207/10036G06T2207/20081G06T2207/30128
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,902,577
App. No.
15/977,085
Granted
Jan 26, 2021
Kind
B2
Abstract

A system includes a memory and at least one processor to acquire a hyperspectral image of an object by an imaging device, the hyperspectral image of the object comprising a three-dimensional set of images of the object, each image in the set of images representing the object in a wavelength range of the electromagnetic spectrum, normalize the hyperspectral image of the object, select a region of interest in the hyperspectral image, the region of interest comprising at least one image in the set of images, extract spectral features from the region of interest in the hyperspectral image, and compare the spectral features from the region of interest with a plurality of images in a training set to determine particular characteristics of the object.

Claims (43)

1. A system comprising:

a memory; and

at least one processor to:

generate a synthetic training set comprising a plurality of hyperspectral images, the plurality of hyperspectral images based on actual hyperspectral images of an object, synthetic hyperspectral images of the object that include data added to the actual hyperspectral images of the object, and synthetic hyperspectral images of the object rendered in one of a different position and orientation;

acquire a hyperspectral image of the object by an imaging device, the hyperspectral image of the object comprising a three-dimensional set of images of the object, each image in the set of images representing the object in a wavelength range of the electromagnetic spectrum;

normalize the hyperspectral image of the object;

select a region of interest in the hyperspectral image, the region of interest comprising a subset of at least one image in the set of images;

extract spectral features from the region of interest in the hyperspectral image;

compare the spectral features from the region of interest with the plurality of hyperspectral images in the synthetic training set to determine particular characteristics of the object and determine a value for at least one quality parameter for the object; and

identify the object based on the spectral features.

2. The system of claim 1 , the at least one processor further to train an object model using data comprising the plurality of hyperspectral images in the synthetic training set and ground truth measurements associated with the object and determine the particular characteristics of the object based on the object model.

3. The system of claim 1 , the at least one processor further to determine dry matter content of the object, firmness of the object, and sugar content of the object.

4. The system of claim 1 , wherein the imaging device comprises a hyperspectral imaging device and the system further comprises at least one illumination device that illuminates the object and a conveyor belt that moves the object past the imaging device as the hyperspectral imaging device captures the hyperspectral image.

5. The system of claim 1 , wherein the object comprises a perishable food item.

6. The system of claim 5 , wherein the perishable food item comprises an avocado.

7. The system of claim 1 , wherein the object comprises an avocado and the at least one processor further to determine at least one of dry matter content of the avocado, firmness of the avocado, and sugar content of the avocado, based on the spectral features from the region of interest.

8. A method comprising:

generating, by a processor, a synthetic training set comprising a plurality of hyperspectral images, the plurality of images based on actual hyperspectral images of an object, synthetic hyperspectral images of the object that include data added to the actual hyperspectral images of the object, and synthetic hyperspectral images of the object rendered in one of a different position and orientation;

acquiring, by the processor, a hyperspectral image of the object by an imaging device, the hyperspectral image of the object comprising a three-dimensional set of images of the object, each image in the set of images representing the object in a wavelength range of the electromagnetic spectrum;

normalizing, by the processor, the hyperspectral image of the object;

selecting, by the processor, a region of interest in the hyperspectral image, the region of interest comprising a subset of at least one image in the set of images;

extracting, by the processor, spectral features from the region of interest in the hyperspectral image;

comparing, by the processor, the spectral features from the region of interest with the plurality of hyperspectral images in the synthetic training set to determine particular characteristics of the object and determining a value for at least one quality parameter for the object; and

identifying, by the processor, the object based on the spectral features.

9. The method of claim 8 , further comprising training an object model using data comprising the plurality of hyperspectral images in the synthetic training set and ground truth measurements associated with the object and determining the particular characteristics of the object based on the object model.

10. The method of claim 8 , further comprising determining dry matter content of the object, firmness of the object, and sugar content of the object.

11. The method of claim 8 , the imaging device comprising a hyperspectral imaging device and the method further comprising illuminating the object by at least one illumination device and moving the object past the imaging device by a conveyor belt as the hyperspectral imaging device captures the hyperspectral image.

12. The method of claim 8 , wherein the object comprises a perishable food item.

13. The method of claim 12 , wherein the perishable food item comprises an avocado.

14. The method of claim 8 , wherein the object comprises an avocado and the method further comprising determining at least one of dry matter content of the avocado, firmness of the avocado, and sugar content of the avocado, based on the spectral features from the region of interest.

15. A non-transitory computer-readable storage medium, having instructions stored thereon that, when executed by a computing device cause the computing device to perform operations, the operations comprising:

generating a synthetic training set comprising a plurality of hyperspectral images, the plurality of images based on actual hyperspectral images of an object, synthetic hyperspectral images of the object that include data added to the actual hyperspectral images of the object, and synthetic hyperspectral images of the object rendered in one of a different position and orientation;

acquiring a hyperspectral image of the object by an imaging device, the hyperspectral image of the object comprising a three-dimensional set of images of the object, each image in the set of images representing the object in a wavelength range of the electromagnetic spectrum;

normalizing the hyperspectral image of the object;

selecting a region of interest in the hyperspectral image, the region of interest comprising a subset of at least one image in the set of images;

extracting spectral features from the region of interest in the hyperspectral image;

comparing the spectral features from the region of interest with the plurality of hyperspectral images in the synthetic training set to determine particular characteristics of the object and determining a value for at least one quality parameter for the object; and

identifying the object based on the spectral features.

16. The non-transitory computer-readable storage medium of claim 15 , the operations further comprising training an object model using data comprising the plurality of hyperspectral images in the synthetic training set and ground truth measurements associated with the object and determining the particular characteristics of the object based on the object model.

17. The non-transitory computer-readable storage medium of claim 15 , the operations further comprising determining dry matter content of the object, firmness of the object, and sugar content of the object.

18. The non-transitory computer-readable storage medium of claim 15 , the imaging device comprising a hyperspectral imaging device and the operations further comprising illuminating the object by at least one illumination device and moving the object past the imaging device by a conveyor belt as the hyperspectral imaging device captures the hyperspectral image.

19. The non-transitory computer-readable storage medium of claim 15 , wherein the object comprises a perishable food item.

20. The non-transitory computer-readable storage medium of claim 19 , wherein the perishable food item comprises an avocado.

Assignments (4)
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT AT REEL/FRAME NO. 60562/0503 Recorded Dec 15, 2023
From: SLR INVESTMENT CORP., AS AGENT
To: APEEL TECHNOLOGY, INC.
Reel/Frame 066045/0001 →
SECURITY INTEREST Recorded Jul 1, 2022
From: APEEL TECHNOLOGY, INC.
To: SLR INVESTMENT CORP., AS COLLATERAL AGENT
Reel/Frame 060562/0503 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2020
From: IMPACTVISION, INC.
To: APEEL TECHNOLOGY, INC.
Reel/Frame 054424/0367 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2019
From: NIPE, LARS GUSTAV MAGNUS; RAMANAN, ABILASHA
To: IMPACTVISION, INC.
Reel/Frame 050135/0261 →
Continuity (2)
Provisional Application 62521950 · Jun 19, 2017
Related Publication 20180365820A1 · Dec 20, 2018
Cited By (1)
US 12,490,526