IP Library Granted Patent US 11,699,286
Granted Patent B2
US 11,699,286 · App. 16/812,678 · Granted Jul 11, 2023

Method, system, and medium having stored thereon instructions that cause a processor to execute a method for obtaining image information of an organism comprising a set of optical data

Inventors: Morio Ogura (Kanagawa, JP); Hirofumi Sumi (Kanagawa, JP)
Assignee: Sony Corporation
G06V20/188A01G7/00G01J3/36G01J3/513G01N21/251G01N21/255G01N21/314G06Q30/00G06Q50/02G06T7/0004H04N13/204H04N23/11G01J2003/2826G01N21/359G01N33/0098G01N2021/0118G01N2021/1797G01N2021/3155G01N2021/8466G06T2207/30128G06T2207/30188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,699,286
App. No.
16/812,678
Granted
Jul 11, 2023
Kind
B2
Abstract

The present disclosure relates to methods and systems for obtaining image information of an organism including a set of optical data; calculating a growth index based on the set of optical data; and calculating an anticipated harvest time based on the growth index, where the image information includes at least one of: (a) visible image data obtained from an image sensor and non-visible image data obtained from the image sensor, and (b) a set of image data from at least two image capture devices, where the at least two image capture devices capture the set of image data from at least two positions.

Claims (50)

1. A system comprising:

a plurality of imaging devices, each configured to capture a subject image including agricultural produce; and

a server coupled to the imaging devices,

wherein the server is configured to:

obtain image information of agricultural produce as a set of optical data;

calculate a growth index based on the set of optical data; and

calculate a proper harvest time based on the growth index,

wherein the image information comprises visible image data and non-visible image data obtained from one of the imaging devices,

wherein the set of optical data is obtained using an image sensor comprising a set of RGB color filters provided over a set of infrared (IR) cut filters, wherein the set of IR cut filters is provided over a set of RGB sensors, and

wherein the image sensor further comprises a black filter provided over a NIR (near infrared) sensor with no IR cut filter provided over the NIR sensor and therefore with no blocking of NIR from the NIR sensor.

2. The system according to claim 1 , wherein the visible image data is generated based on a demosaiced RGB pixel signal.

3. The system according to claim 1 , wherein the non-visible image data is generated based on a demosaiced R and IR signal.

4. The system according to claim 1 , wherein the non-visible image data is generated based on a R and IR signal without demosaicing.

5. The system according to claim 1 , wherein the visible image data is generated based on a demosaiced RGB pixel signal, and wherein the non-visible image data is generated based on a demosaiced R and IR signal.

6. The system according to claim 1 , wherein the visible image data is generated based on a demosaiced RGB pixel signal, and wherein the non-visible image data is generated based on a R and IR signal without demosaicing.

7. The system according to claim 1 , wherein the set of optical data is obtained using a stack type image sensor, wherein the stack type image sensor has a blue light sensor layer stacked on a green light sensor layer, wherein the green light sensor layer is stacked on a red light sensor layer, and wherein the red light sensor layer is stacked on a near-infrared ray (NIR) sensor layer.

8. The system according to claim 1 , wherein the set of optical data is obtained using an image sensor comprising a set of RGB color filters provided over a laminated film,

wherein the laminated film comprises at least one of SiO and SiN, and wherein the set of RGB color filters comprises a FR color filter, a FG color filter, and a FB color filter.

9. An information processing method comprising:

obtaining image information of agricultural produce comprising a set of optical data;

specifying a target region;

calculating a growth index based on the image information in the target region; and

calculating an anticipated harvest time based on the growth index,

wherein the set of optical data is obtained using an image sensor comprising a set of RGB color filters provided over a set of infrared (IR) cut filters, wherein the set of IR cut filters is provided over a set of RGB sensors, and

wherein the image sensor further comprises a black filter provided over a NIR (near infrared) sensor with no IR cut filter provided over the NIR sensor and therefore with no blocking of NIR from the NIR sensor.

10. The method according to claim 9 , wherein the visible image data is generated based on a demosaiced RGB pixel signal.

11. The method according to claim 9 , wherein the non-visible image data is generated based on a demosaiced R and IR signal.

12. The method according to claim 9 , wherein the non-visible image data is generated based on a R and IR signal without demosaicing.

13. The method according to claim 9 , wherein the visible image data is generated based on a demosaiced RGB pixel signal, and wherein the non-visible image data is generated based on a demosaiced R and IR signal.

14. The method according to claim 9 , wherein the visible image data is generated based on a demosaiced RGB pixel signal, and wherein the non-visible image data is generated based on a R and IR signal without demosaicing.

15. The method according to claim 9 , wherein the set of optical data is obtained using a stack type image sensor, wherein the stack type image sensor has a blue light sensor layer stacked on a green light sensor layer, wherein the green light sensor layer is stacked on a red light sensor layer, and wherein the red light sensor layer is stacked on a near-infrared ray (NIR) sensor layer.

16. The method according to claim 9 , wherein the set of optical data is obtained using an image sensor comprising a set of RGB color filters provided over a laminated film,

wherein the laminated film comprises at least one of SiO and SiN, and wherein the set of RGB color filters comprises a FR color filter, a FG color filter, and a FB color filter.

17. The method according to claim 9 , wherein the set of optical data is obtained using an image sensor comprising a set of RGB color filters provided over a set of infrared (IR) cut filters, wherein the set of IR cut filters is provided over a set of image sensors.

18. A method comprising:

obtaining image information of agricultural produce comprising a set of optical data;

calculating a growth index based on the set of optical data; and

calculating an anticipated harvest time based on the growth index,

wherein the image information comprises a set of stereoscopic image data from at least two image capture devices, wherein the at least two image capture devices capture the set of stereoscopic image data from at least two different positions and at least two different angles,

wherein the set of optical data is obtained using an image sensor comprising a set of RGB color filters provided over a set of infrared (IR) cut filters, wherein the set of IR cut filters is provided over a set of RGB sensors,

wherein the image sensor further comprises a black filter provided over a NIR (near infrared) sensor with no IR cut filter provided over the NIR sensor and therefore with no blocking of NIR from the NIR sensor and

wherein an image captured from the RGB sensors and the NIR sensor is representative of the agricultural produce.

19. An information processing apparatus comprising:

processing circuitry configured to:

obtain, from a plurality of imaging devices, image information of agricultural produce as a set of optical data;

calculate a growth index based on the set of optical data; and

calculate a proper harvest time based on the growth index,

wherein the image information comprises visible image data and non-visible image data obtained from one of the imaging devices,

wherein the set of optical data is obtained using an image sensor comprising a set of RGB color filters provided over a set of infrared (IR) cut filters, wherein the set of IR cut filters is provided over a set of RGB sensors, and

wherein the image sensor further comprises a black filter provided over a NIR (near infrared) sensor with no IR cut filter provided over the NIR sensor and therefore with no blocking of NIR from the NIR sensor.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 13, 2021
From: OGURA, MORIO; SUMI, HIROFUMI
To: SONY CORPORATION
Reel/Frame 056847/0894 →
Priority Claims (1)
JP 2013-062017 · Mar 25, 2013 · national
Continuity (2)
Continuation 14777549
Related Publication 20200210699A1 · Jul 2, 2020
Cited By (1)
US 12,198,425