IP Library › Granted Patent US 11,138,258
Granted Patent B2
US 11,138,258 · App. 16/221,263 · Granted Oct 5, 2021

System and method of grouping images

Inventors: Dixon De Sheng Deng (East Ryde, AU); Julie Rae Kowald (Dundas Valley, AU); Nicholas Grant Fulton (Turramurra, AU); Oscar Alejandro De Lellis (Drummoyne, AU)
Assignee: Canon Kabushiki Kaisha
G06F16/55G06F16/535G06F16/58G06K9/00624G06K9/3208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,138,258
App. No.
16/221,263
Granted
Oct 5, 2021
Kind
B2
Abstract

A system and method of grouping images captured using an image capture device. The method comprises receiving a plurality of images, each of the plurality of images having associated camera settings; and determining an inertial profile for the plurality of images based on acceleration data of the image capture device and an imaging entity at pre-determined length of time before and after capture of the each of the plurality of images. The method further comprises forming image groups from the received plurality of images based on the determined inertial profile, and the associated camera settings.

Claims (48)

1. A method of grouping images captured using an image capture device, the method comprising:

receiving a plurality of images, each of the plurality of images having associated camera settings;

determining an inertial profile for the plurality of images based on acceleration data of the image capture device or an imaging entity at pre-determined length of time before and after capture of the each of the plurality of images; and

forming image groups from the received plurality of images based on the determined inertial profile, and the associated camera settings; and

determining if the determined inertial profile over a time period prior to a current time matches a model to determine if an expected image has been missed.

2. The method according to claim 1 , wherein the associated camera settings comprise at least one of a focus distance value, focal length, exposure or brightness values, and focus depth data.

3. The method according to claim 1 , wherein the inertial profile comprises an orientation component relating to an orientation of the camera.

4. The method according to claim 1 , wherein the imaging entity comprises the image capture device.

5. The method according to claim 4 , wherein the imaging entity further comprises at least one of a person operating the image capture device, and a vehicle to which the image capture device is mounted.

6. The method according to claim 1 , wherein forming image groups is further based on interaction of a user of the image capture device with one or more shutter buttons of the image capture device.

7. The method according to claim 1 , wherein the image capture device comprises a plurality of shutter buttons configurable such that each shutter button records an image-subject type in metadata of the image.

8. The method according to claim 1 , further comprising associating each of the formed image groups with one of a pre-determined set of tasks.

9. The method according to claim 1 , further comprising grouping the images by distinguishing a task from a set of pre-determined tasks based on the determined inertial profile.

10. The method according to claim 1 , wherein forming image groups is further based on a task tag stored during capture of each of the plurality of images.

11. The method according to claim 1 , further comprising normalising inertial profiles determined for each of the plurality of images, and wherein the image groups are formed using the normalised inertial profiles.

12. The method according to claim 1 , wherein the imaging entity includes the image capturing device mounted on a tractor and the plurality of images are of crops.

13. The method according to claim 1 , wherein the image groups are formed further based on a frequency of interaction of a user of the image capture device with one or more shutter buttons of the image capture device.

14. The method according to claim 1 , wherein the image groups are formed further based on identifying a pattern of inertial profiles for images within each of the groups.

15. A method of grouping images captured using an image capture device, the method comprising:

receiving a plurality of images, each of the plurality of images having associated camera settings;

determining an inertial profile for the plurality of images based on acceleration data of the image capture device or an imaging entity at pre-determined length of time before and after capture of the each of the plurality of images;

forming image groups from the received plurality of images based on the determined inertial profile, and the associated camera settings; and

determining if a current inertial profile starts to differ from a previously known inertial profile, and alerting the imaging entity.

16. A method of grouping images captured using an image capture device, the method comprising:

receiving a plurality of images, each of the plurality of images having associated camera settings;

determining an inertial profile for the plurality of images based on acceleration data of the image capture device or an imaging entity at pre-determined length of time before and after capture of the each of the plurality of images;

forming image groups from the received plurality of images based on the determined inertial profile, and the associated camera settings; and

determining a matching score between a current inertial profile and a model to determine if the imaging entity is to be alerted.

17. A non-transitory computer readable storage medium storing program instructions for grouping images captured using an image capture device, the program comprising:

code for receiving a plurality of images, each of the plurality of images having associated camera settings;

code for determining an inertial profile for the plurality of images based on acceleration data of the image capture device or an imaging entity at pre-determined length of time before and after capture of the each of the plurality of images; and

code for forming image groups from the received plurality of images based on the determined inertial profile, and the associated camera settings; and

code for determining if the determined inertial profile over a time period prior to a current time matches a model to determine if an expected image has been missed.

18. Apparatus for grouping images captured using an image capture device, comprising:

one or more processors; and

one or more memory devices storing a software program for directing the one or more processors to perform a method comprising the steps of:

receiving a plurality of images, each of the plurality of images having associated camera settings;

determining an inertial profile for the plurality of images based on acceleration data of the image capture device or an imaging entity at pre-determined length of time before and after capture of the each of the plurality of images; and

forming image groups from the received plurality of images based on the determined inertial profile, and the associated camera settings; and

determining if the determined inertial profile over a time period prior to a current time matches a model to determine if an expected image has been missed.

19. A system comprising:

an image capture device;

one or more processors; and

one or more memory devices storing a software program for directing the one or more processors to perform a method comprising the steps of:

receiving a plurality of images captured by the image capture device, each of the plurality of images having associated camera settings;

determining an inertial profile for the plurality of images based on acceleration data of the image capture device or an imaging entity at pre-determined length of time before and after capture of the each of the plurality of images; and

forming image groups from the received plurality of images based on the determined inertial profile, and the associated camera settings; and

determining if the determined inertial profile over a time period prior to a current time matches a model to determine if an expected image has been missed.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2019
From: DENG, DIXON DE SHENG; KOWALD, JULIE RAE; FULTON, NICHOLAS GRANT; DE LELLIS, OSCAR ALEJANDRO
To: CANON KABUSHIKI KAISHA
Reel/Frame 048901/0038 →
Priority Claims (1)
AU 2017279562 · Dec 18, 2017 · national
Continuity (1)
Related Publication 20190188223A1 · Jun 20, 2019
Cited By (1)
US 12,593,753