IP Library Granted Patent US 11,875,562
Granted Patent B2
US 11,875,562 · App. 17/713,639 · Granted Jan 16, 2024

Method, system, and medium having stored thereon instructions that cause a processor to execute a method for obtaining image information of an organism comprising a set of optical data

Inventors: Morio Ogura (Kanagawa, JP); Hirofumi Sumi (Kanagawa, JP)
Assignee: Sony Group Corporation
G06V20/188A01G7/00G01J3/36G01J3/513G01N21/251G01N21/255G01N21/314G06Q30/00G06Q50/02G06T7/0004H04N13/204H04N23/11G01J2003/2826G01N21/359G01N33/0098G01N2021/0118G01N2021/1797G01N2021/3155G01N2021/8466G06T2207/30128G06T2207/30188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,875,562
App. No.
17/713,639
Granted
Jan 16, 2024
Kind
B2
Abstract

The present disclosure relates to methods and systems for obtaining image information of an organism including a set of optical data; calculating a growth index based on the set of optical data; and calculating an anticipated harvest time based on the growth index, where the image information includes at least one of: (a) visible image data obtained from an image sensor and non-visible image data obtained from the image sensor, and (b) a set of image data from at least two image capture devices, where the at least two image capture devices capture the set of image data from at least two positions.

Claims (26)

1. A method comprising:

obtaining image information of an organism comprising a set of image data;

calculating a growth index based on the set of image data;

calculating an anticipated harvest time based on the growth index, wherein the set of image data is obtained from at least two image capture devices, wherein the at least two image capture devices capture the set of image data from at least two different positions; and

calculating a size of the organism based on the set of image data,

wherein the set of image data is obtained using an image sensor comprising a set of RGB color filters provided over a set of infrared (IR) cut filters, wherein the set of IR cut filters is provided over a set of RGB sensors,

wherein the image sensor further comprises a black filter provided over a NIR (near infrared) sensor with no IR cut filter provided over the NIR sensor and therefore with no blocking of NIR from the NIR sensor, and

wherein an image captured from the RGB sensors and the NIR sensor is representative of the organism.

2. The method of claim 1 , wherein the image information comprises visible image data and non-visible image data and wherein the visible image data is generated by demosaicing of a RGB pixel signal to provide R, G and B component image signals and wherein the non-visible image data is generated based on a demosaiced R and IR signal.

3. The method of claim 1 , wherein the image information comprises visible image data and non-visible image data and wherein the visible image data is generated by demosaicing of a RGB pixel signal to provide R, G and B component image signals and wherein the non-visible image data is generated based on a R and IR signal without demosaicing.

4. The method of claim 1 , wherein the image sensor used to obtain the set of image data comprises a stack type image sensor, wherein the stack type image sensor has a blue light sensor layer stacked on a green light sensor layer, wherein the green light sensor layer is stacked on a red light sensor layer, and wherein the red light sensor layer is stacked on a near-infrared ray (NIR) sensor layer.

5. The method of claim 1 , wherein the image sensor used to obtain the set of image data comprises the set of RGB color filters provided over a laminated film, wherein the laminated film comprises at least one of SiO and SiN, and wherein the set of RGB color filters comprises a FR color filter, a FG color filter, and a FB color filter.

6. The method of claim 1 , further comprising calculating parallax image data based on at least two of the image data from the set of image data obtained from the at least two image capture devices; and calculating the growth index based on the parallax image data.

7. A method comprising:

obtaining image information of an organism comprising a set of image data;

calculating a growth index based on the set of image data; and

calculating an anticipated harvest time based on the growth index,

wherein the set of image data is obtained from at least two image capture devices, wherein the at least two image capture devices capture the set of image data from at least two different positions,

wherein the set of image data is obtained using an image sensor comprising a set of RGB color filters provided over a set of infrared (IR) cut filters, wherein the set of IR cut filters is provided over a set of RGB sensors,

wherein the image sensor further comprises a black filter provided over a NIR (near infrared) sensor with no IR cut filter provided over the NIR sensor and therefore with no blocking of NIR from the NIR sensor, and

wherein an image captured from the RGB sensors and the NIR sensor is representative of the organism.

8. The method of claim 7 , wherein the image information comprises visible image data and non-visible image data and wherein the visible image data is generated by demosaicing of a RGB pixel signal to provide R, G and B component image signals and wherein the non-visible image data is generated based on a demosaiced R and IR signal.

9. The method of claim 7 , wherein the image information comprises visible image data and non-visible image data and wherein the visible image data is generated by demosaicing of a RGB pixel signal to provide R, G and B component image signals and wherein the non-visible image data is generated based on a R and IR signal without demosaicing.

10. The method of claim 7 , wherein the image sensor used to obtain the set of image data comprises a stack type image sensor, wherein the stack type image sensor has a blue light sensor layer stacked on a green light sensor layer, wherein the green light sensor layer is stacked on a red light sensor layer, and wherein the red light sensor layer is stacked on a near-infrared ray (NIR) sensor layer.

11. The method of claim 7 , wherein the image sensor used to obtain the set of image data comprises the set of RGB color filters provided over a laminated film, wherein the laminated film comprises at least one of SiO and SiN, and wherein the set of RGB color filters comprises a FR color filter, a FG color filter, and a FB color filter.

12. The method of claim 7 , further comprising calculating parallax image data based on at least two of the image data from the set of image data obtained from the at least two image capture devices; and calculating the growth index based on the parallax image data.

Assignments (2)
CHANGE OF NAME Recorded Jul 15, 2022
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 060667/0521 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 15, 2022
From: OGURA, MORIO; SUMI, HIROFUMI
To: SONY CORPORATION
Reel/Frame 060671/0813 →
Priority Claims (1)
JP 2013-062017 · Mar 25, 2013 · national
Continuity (3)
Continuation 16812678 · Mar 9, 2020
Continuation 14777549
Related Publication 20220230431A1 · Jul 21, 2022