IP Library Granted Patent US 12,229,986
Granted Patent B2
US 12,229,986 · App. 17/834,713 · Granted Feb 18, 2025

Information processing apparatus, information processing method, and storage medium for displaying am image indicating a pixel where a luminance change occurs based on a signal

Inventor: Kenta Igarashi (Kanagawa, JP)
Assignee: CANON KABUSHIKI KAISHA
G06T7/73G06T7/246H04N5/265H04N5/272
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,229,986
App. No.
17/834,713
Granted
Feb 18, 2025
Kind
B2
Abstract

An apparatus according to the present invention includes a detection unit configured to detect an event based on a signal indicating a location of a pixel where a luminance change occurs and time when the luminance change occurs, and a display control unit configured to display an image indicating the pixel where the luminance change occurs based on the signal. In a case where the event is not detected, the image includes additional information indicating the event previously detected.

Claims (34)

1. An apparatus comprising:

at least one memory storing instructions; and

at least one processor that executes the stored instructions that cause the at least one processor to:

acquire a signal indicating a location of a pixel where a luminance change occurs and time when the luminance change occurs from an image capture device;

acquire an event that is detected based on the signal;

cause a display device to display a first image indicating the pixel where the luminance change occurs based on the acquired signal in a case where the event is detected; and

cause the display device to display a second image, which includes a third image where the event was previously detected, in a case where the event is not detected.

2. The apparatus according to claim 1 , wherein the event depending on presence or absence of the pixel where the luminance change occurs is detected.

3. The apparatus according to claim 2 , wherein the event is detected in a case where the number of connected pixels indicating the number of continuous pixels in the signal acquired during a first period is more than or equal to a first threshold.

4. The apparatus according to claim 2 , wherein the event is detected in a case where the signal acquired during the first period is similar to feature point data indicating a contour of a subject, the feature point data being preliminarily stored.

5. The apparatus according to claim 1 , wherein the event is detection of a moving subject.

6. The apparatus according to claim 5 , wherein, in a case where the moving subject detected in a preceding frame is not detected in a current frame, the second image is displayed.

7. The apparatus according to claim 1 , wherein the stored instructions further cause the at least one processor to generate an image indicating a location of a pixel where a luminance change occurs based on the number of output event address signals in respective pixels acquired at intervals.

8. The apparatus according to claim 7 , wherein the third image is generated based on the signal acquired during a period.

9. The apparatus according to claim 8 , wherein the third image is generated based on the signal acquired during the period dynamically determined.

10. The apparatus according to claim 1 , wherein the third image is displayed with at least one of hue, saturation, and brightness of the third image changed.

11. The apparatus according to claim 10 , wherein the second image is displayed with at least one of hue, saturation, and brightness of a subject in the third image.

12. The apparatus according to claim 1 , wherein a frame corresponding to a subject is displayed in the second image.

13. The apparatus according to claim 1 , wherein the second image is generated by superposing the third image onto a fourth image based on a signal when the event is not detected.

14. The apparatus according to claim 1 , wherein the second image is generated by combining the third image with a fourth image based on a signal when the event is not detected.

15. The apparatus according to claim 1 , wherein the signal is output from a sensor configured to detect a change in luminance of each pixel, and in a case where no luminance change is detected, the signal is not output, or that no luminance change is detected is indicated.

16. The apparatus according to claim 1 , wherein the signal is output from a photoelectric conversion element including a pixel for outputting a signal based on photon incidence.

17. A method comprising:

acquiring an event based on a signal indicating a location of a pixel where a luminance change occurs and time when the luminance change occurs from an image capture device;

acquiring an event that is detected based on the signal;

causing a display device to display a first image indicating the pixel where the luminance change occurs based on the acquired signal in a case where the event is detected; and

causing the display device to display a second image, which includes a third image where the event was previously detected, in a case where the event is not detected.

18. The method according to claim 17 , wherein the detecting detects the event depending on presence or absence of the pixel where the luminance change occurs.

19. A non-transitory computer-readable storage medium storing a program for causing a computer to perform a method, the method comprising:

acquiring an event based on a signal indicating a location of a pixel where a luminance change occurs and time when the luminance change occurs from an image capture device;

acquiring an event that is detected based on the signal;

causing a display device to display a first image indicating the pixel where the luminance change occurs based on the acquired signal in a case where the event is detected; and

causing the display device to display a second image, which includes a third image where the event was previously detected, in a case where the event is not detected.

20. The non-transitory computer-readable storage medium storing a program according to claim 19 , wherein the detecting detects the event depending on presence or absence of the pixel where the luminance change occurs.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 6, 2022
From: IGARASHI, KENTA
To: CANON KABUSHIKI KAISHA
Reel/Frame 060405/0564 →
Priority Claims (1)
JP 2021-097306 · Jun 10, 2021 · national
Continuity (1)
Related Publication 20220398770A1 · Dec 15, 2022
References Cited (26)
US 10600189B1 · Bedikian · 2020 [cited by examiner]
US 11164019B1 · Ryan · 2021 [cited by examiner]
US 20060153288A1 · Prochnow · 2006 [cited by examiner]
US 20070110307A1 · Sato · 2007 [cited by examiner]
US 20100246975A1 · Tsukiori · 2010 [cited by examiner]
US 20140368558A1 · Ikeda · 2014 [cited by examiner]
US 20160042238A1 · Lynam · 2016 [cited by examiner]
US 20160105596A1 · Hatakeyama · 2016 [cited by examiner]
US 20160210513A1 · Wang · 2016 [cited by examiner]
US 20170054911A1 · Lee · 2017 [cited by examiner]
US 20170084068A1 · Son · 2017 [cited by examiner]
US 20190385428A1 · Bretschneider · 2019 [cited by examiner]
US 20200226377A1 · Campos Macias · 2020 [cited by examiner]
US 20210037178A1 · Rivard · 2021 [cited by examiner]
US 20210327090A1 · Naganuma · 2021 [cited by examiner]
US 20220036110A1 · Sironi · 2022 [cited by examiner]
US 20220150435A1 · Numata · 2022 [cited by examiner]
US 20220174200A1 · Xiong · 2022 [cited by examiner]
US 20220375256A1 · Endo · 2022 [cited by examiner]
US 20230217117A1 · Kaizu · 2023 [cited by examiner]
US 20230335043A1 · Nakata · 2023 [cited by examiner]
US 20230353893A1 · Niikura · 2023 [cited by examiner]
US 20240073552A1 · Miyatani · 2024 [cited by examiner]
US 20240161503A1 · Taya · 2024 [cited by examiner]
JP 2017091518A · 2017 [cited by applicant]
JP 2020072317A · 2020 [cited by applicant]