IP Library Granted Patent US 11,922,678
Granted Patent B2
US 11,922,678 · App. 18/139,824 · Granted Mar 5, 2024

Carbon estimation

Inventors: Kyle Tyler Story (Burlingame, CA); Jason David Schatz (Santa Fe, NM); Manuel Weber (San Francisco, CA)
Assignee: Descartes Labs, Inc.
G06V10/774G06V20/13G06V20/194G06V20/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,922,678
App. No.
18/139,824
Granted
Mar 5, 2024
Kind
B2
Abstract

Training an estimation model using soft labels includes receiving an image. It further includes generating a continuous target map corresponding to the image that includes hard labels and soft labels. A model is trained using the corresponding continuous target map.

Claims (36)

1. A system, comprising:

a processor configured to:

receive an image comprising a plurality of pixels;

receive a partial label map including hard labels corresponding to a first subset of pixels of the image;

determine soft labels corresponding to a second subset of pixels of the image that is unlabeled, wherein determining a soft label for an unlabeled pixel in the second subset of pixels of the image comprises comparing a set of characteristics of the unlabeled pixel against a set of characteristics of a labeled pixel in the first subset of pixels of the image;

generate an output label map that includes both the hard labels included in the partial label map corresponding to the first subset of pixels of the image and the soft labels determined for the second subset of pixels of the image; and

train a model using both the image and the output label map that includes both the hard labels and the soft labels; and

a memory coupled to the processor and configured to provide the processor with instructions.

2. The system of claim 1 , wherein the soft label for the unlabeled pixel is determined based at least in part on a determined similarity of the unlabeled pixel to the labeled pixel in the first subset of pixels of the image.

3. The system of claim 2 , wherein a corresponding hard label of the labeled pixel is assigned as the soft label for the unlabeled pixel.

4. The system of claim 2 , wherein the similarity is determined based at least in part on a determined spectral similarity.

5. The system of claim 4 , wherein the spectral similarity is determined based at least in part on a cosine similarity.

6. The system of claim 1 , wherein the image comprises a multi-band satellite image.

7. The system of claim 1 , wherein during training of the model, a weight is applied to a contribution of the soft label in a loss function.

8. The system of claim 7 , wherein the weight applied to the contribution of the soft label in the loss function is different from a weight applied to a contribution of a hard label in the loss function.

9. The system of claim 7 , wherein the weight applied to the contribution of the soft label is adjusted based at least in part on a stage of the training.

10. A method, comprising:

receiving an image comprising a plurality of pixels;

receiving a partial label map including hard labels corresponding to a first subset of pixels of the image;

determining soft labels corresponding to a second subset of pixels of the image that is unlabeled, wherein determining a soft label for an unlabeled pixel in the second subset of pixels of the image comprises comparing a set of characteristics of the unlabeled pixel against a set of characteristics of a labeled pixel in the first subset of pixels of the image;

generating an output label map that includes both the hard labels included in the partial label map corresponding to the first subset of pixels of the image and the soft labels determined for the second subset of pixels of the image; and

training a model using both the image and the output label map that includes both the hard labels and the soft labels.

11. The method of claim 10 , wherein the soft label for the unlabeled pixel is determined based at least in part on a determined similarity of the unlabeled pixel to the labeled pixel in the first subset of pixels of the image.

12. The method of claim 11 , wherein a corresponding hard label of the labeled pixel is assigned as the soft label for the unlabeled pixel.

13. The method of claim 11 , wherein the similarity is determined based at least in part on a determined spectral similarity.

14. The method of claim 13 , wherein the spectral similarity is determined based at least in part on a cosine similarity.

15. The method of claim 10 , wherein the image comprises a multi-band satellite image.

16. The method of claim 10 , wherein during training of the model, a weight is applied to a contribution of the soft label in a loss function.

17. The method of claim 16 , wherein the weight applied to the contribution of the soft label in the loss function is different from a weight applied to a contribution of a hard label in the loss function.

18. The method of claim 16 , wherein the weight applied to the contribution of the soft label is adjusted based at least in part on a stage of the training.

19. A computer program product embodied in a non-transitory computer readable medium and comprising computer instructions for:

receiving an image comprising a plurality of pixels;

receiving a partial label map including hard labels corresponding to a first subset of pixels of the image;

determining soft labels corresponding to a second subset of pixels of the image that is unlabeled, wherein determining a soft label for an unlabeled pixel in the second subset of pixels of the image comprises comparing a set of characteristics of the unlabeled pixel against a set of characteristics of a labeled pixel in the first subset of pixels of the image;

generating an output label map that includes both the hard labels included in the partial label map corresponding to the first subset of pixels of the image and the soft labels determined for the second subset of pixels of the image; and

training a model using both the image and the output label map that includes both the hard labels and the soft labels.

Assignments (3)
SECURITY INTEREST Recorded Jun 10, 2025
From: GEOSYS-INTL, INC.; EARTHDAILY ANALYTICS USA, INC.; EARTHDAILY ANALYTICS CORP.; SKYFOREST INC.
To: TRINITY CAPITAL INC., AS COLLATERAL AGENT
Reel/Frame 071379/0919 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 11, 2025
From: DESCARTES LABS, INC.
To: EARTHDAILY ANALYTICS USA, INC.
Reel/Frame 070478/0433 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 25, 2023
From: STORY, KYLE TYLER; SCHATZ, JASON DAVID; WEBER, MANUEL
To: DESCARTES LABS, INC.
Reel/Frame 065010/0365 →
Continuity (3)
Provisional Application 63403263 · Sep 1, 2022
Provisional Application 63335363 · Apr 27, 2022
Related Publication 20230351732A1 · Nov 2, 2023