IP Library Granted Patent US 12,014,538
Granted Patent B2
US 12,014,538 · App. 18/132,309 · Granted Jun 18, 2024

Method, system, and medium having stored thereon instructions that cause a processor to execute a method for obtaining image information of an organism comprising a set of optical data

Inventors: Morio Ogura (Kanagawa, JP); Hirofumi Sumi (Kanagawa, JP)
Assignee: Sony Group Corporation
G06V20/188A01G7/00G01J3/36G01J3/513G01N21/251G01N21/255G01N21/314G06Q30/00G06Q50/02G06T7/0004H04N13/204H04N23/11G01J2003/2826G01N2021/0118G01N2021/1797G01N2021/3155G01N21/359G01N2021/8466G01N33/0098G06T2207/30128G06T2207/30188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,014,538
App. No.
18/132,309
Granted
Jun 18, 2024
Kind
B2
Abstract

The present disclosure relates to methods and systems for obtaining image information of an organism including a set of optical data; calculating a growth index based on the set of optical data; and calculating an anticipated harvest time based on the growth index, where the image information includes at least one of: (a) visible image data obtained from an image sensor and non-visible image data obtained from the image sensor, and (b) a set of image data from at least two image capture devices, where the at least two image capture devices capture the set of image data from at least two positions.

Claims (36)

1. Information processing apparatus comprising:

processing circuitry configured to:

acquire image information of an organism comprising a set of image data;

calculate a growth index based on the set of image data;

calculate an anticipated harvest time based on the growth index, wherein the set of image data is obtained from at least two image capture devices, wherein the at least two image capture devices capture the set of image data from at least two different positions; and

calculate a size of the organism based on the set of image data,

wherein the set of image data is obtained using an image sensor comprising a set of RGB color filters provided over a set of infrared (IR) cut filters, wherein the set of IR cut filters is provided over a set of RGB sensors,

wherein the image sensor further comprises a black filter provided over a NIR (near infrared) sensor with no IR cut filter provided over the NIR sensor and therefore with no blocking of NIR from the NIR sensor, and

wherein an image captured from the RGB sensors and the NIR sensor is representative of the organism.

2. The information processing apparatus of claim 1 , wherein the image information comprises visible image data and non-visible image data and wherein the visible image data is generated by demosaicing of a RGB pixel signal to provide R, G and B component image signals and wherein the non-visible image data is generated based on a demosaiced R and IR signal.

3. The information processing apparatus of claim 1 , wherein the image information comprises visible image data and non-visible image data and wherein the visible image data is generated by demosaicing of a RGB pixel signal to provide R, G and B component image signals and wherein the non-visible image data is generated based on a R and IR signal without demosaicing.

4. The information processing apparatus of claim 1 , wherein the image sensor used to obtain the set of image data comprises a stack type image sensor, wherein the stack type image sensor has a blue light sensor layer stacked on a green light sensor layer, wherein the green light sensor layer is stacked on a red light sensor layer, and wherein the red light sensor layer is stacked on a near-infrared ray sensor layer.

5. The information processing apparatus of claim 1 , wherein the image sensor used to obtain the set of image data comprises the set of RGB color filters provided over a laminated film, wherein the laminated film comprises at least one of SiO and SiN, and wherein the set of RGB color filters comprises a FR color filter, a FG color filter, and a FB color filter.

6. The information processing apparatus of claim 1 , wherein the processing circuitry is configured to calculate parallax image data based on at least two of the image data from the set of image data obtained from the at least two image capture devices and to calculate the growth index based on the parallax image data.

7. Information processing apparatus comprising:

processing circuitry configured to:

acquire image information of an organism comprising a set of image data;

calculate a growth index based on the set of image data; and

calculate an anticipated harvest time based on the growth index,

wherein the set of image data is obtained from at least two image capture devices, wherein the at least two image capture devices capture the set of image data from at least two different positions,

wherein the set of image data is obtained using an image sensor comprising a set of RGB color filters provided over a set of infrared (IR) cut filters, wherein the set of IR cut filters is provided over a set of RGB sensors,

wherein the image sensor further comprises a black filter provided over a NIR (near infrared) sensor with no IR cut filter provided over the NIR sensor and therefore with no blocking of NIR from the NIR sensor, and

wherein an image captured from the RGB sensors and the NIR sensor is representative of the organism.

8. The information processing apparatus of claim 7 , wherein the image information comprises visible image data and non-visible image data and wherein the visible image data is generated by demosaicing of a RGB pixel signal to provide R, G and B component image signals and wherein the non-visible image data is generated based on a demosaiced R and IR signal.

9. The information processing apparatus of claim 7 , wherein the image information comprises visible image data and non-visible image data and wherein the visible image data is generated by demosaicing of a RGB pixel signal to provide R, G and B component image signals and wherein the non-visible image data is generated based on a Rand IR signal without demosaicing.

10. The information processing apparatus of claim 7 , wherein the image sensor used to obtain the set of optical data comprises a stack type image sensor, wherein the stack type image sensor has a blue light sensor layer stacked on a green light sensor layer, wherein the green light sensor layer is stacked on a red light sensor layer, and wherein the red light sensor layer is stacked on a near-infrared ray sensor layer.

11. The information processing apparatus of claim 7 , wherein the image sensor used to obtain the set of optical data comprises the set of RGB color filters provided over a laminated film, wherein the laminated film comprises at least one of SiO and SiN, and wherein the set of RGB color filters comprises a FR color filter, a FG color filter, and a FB color filter.

12. The information processing apparatus of claim 7 , wherein the processing circuitry is configured to calculate parallax image data based on at least two of the image data from the set of image data obtained from the at least two image capture devices and to calculate the growth index based on the parallax image data.

13. An image sensor comprising:

RGB sensors;

a NIR (near infrared) sensor;

IR (infrared) cut filters over the RGB sensors;

RGB color filters over the IR cut filters; and

a black filter over the NIR sensor with no IR cut filter over the NIR sensor and therefore with no blocking of NIR from the NIR sensor.

14. The image sensor of claim 13 , wherein the image sensor used to obtain the set of image data comprises a stack type image sensor, wherein the stack type image sensor has a blue light sensor layer stacked on a green light sensor layer, wherein the green light sensor layer is stacked on a red light sensor layer, and wherein the red light sensor layer is stacked on a near-infrared ray sensor layer.

15. The image sensor of claim 13 , wherein the image sensor used to obtain the set of image data comprises the set of RGB color filters provided over a laminated film, wherein the laminated film comprises at least one of SiO and SiN, and wherein the set of RGB color filters comprises a FR color filter, a FG color filter, and a FB color filter.

Assignments (2)
CHANGE OF NAME Recorded Sep 19, 2023
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 064952/0679 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2023
From: OGURA, MORIO; SUMI, HIROFUMI
To: SONY CORPORATION
Reel/Frame 065329/0409 →
Priority Claims (1)
JP 2013-062017 · Mar 25, 2013 · national
Continuity (4)
Continuation 17713639 · Apr 5, 2022
Continuation 16812678 · Mar 9, 2020
Continuation 14777549
Related Publication 20230245446A1 · Aug 3, 2023