IP Library › Granted Patent US 12,154,305
Granted Patent B2
US 12,154,305 · App. 17/767,394 · Granted Nov 26, 2024

Information processing apparatus and information processing method

Inventor: Naoki Nomura (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
G06V10/10B43L1/04G06F3/04883
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,154,305
App. No.
17/767,394
Granted
Nov 26, 2024
Kind
B2
Abstract

Provided is an information processing apparatus and an information processing method that enable appropriate recording of information written on a writing object. A region setting unit sets, in a writing image that shows the writing object on which written information is written, a writing region that includes the written information, and a recording control unit that controls recording of the writing image in response to a change in the writing region. The present disclosure can be applied to, for example, a board writing recording system.

Claims (71)

1. An information processing apparatus, comprising:

a central processing unit (CPU) configured to:

acquire a captured image that includes a writing object, wherein the writing object includes written information;

extract a board writing image from the captured image;

set a first writing region in the extracted board writing image;

determine a first increase in the first writing region;

update, with the extracted board writing image, a first recording candidate image, wherein

the first recording candidate image is updated based on the determined first increase in the first writing region, and

the first recording candidate image is a candidate for a recorded image;

determine reduction in the first writing region; and

control, based on the determined reduction in the first writing region, record of the updated first recording candidate image as the recorded image.

2. The information processing apparatus according to claim 1 , wherein the first writing region indicates a proportion of a range where the written information is written to the writing object.

3. The information processing apparatus according to claim 2 , wherein the CPU is further configured to:

perform expansion processing on the written information in the extracted board writing image; and

set the first writing region based on the performed by performing expansion processing on the written information in the writing image.

4. The information processing apparatus according to claim 3 , wherein the CPU is further configured to perform resolution reduction processing on the extracted board writing image in which the first writing region is set.

5. The information processing apparatus according to claim 1 , wherein the CPU is further configured to:

perform character recognition in the extracted board writing image; and

set, based on the performed character recognition, a character region as the first writing region.

6. The information processing apparatus according to claim 1 , wherein the CPU is further configured to control record of a second recording candidate image as the recorded image, wherein

the second recording candidate image excludes the first writing region.

7. The information processing apparatus according to claim 6 , wherein the CPU is further configured to:

determine that a part of a second writing region is left undeleted after the updated first recording candidate image is recorded, wherein

the second writing region corresponds to the first writing region after the determined reduction;

determine a second increase in the second writing region after the determination that the part of the second writing region is left undeleted;

mask the part of the second writing region that is left undeleted; and

update the first recording candidate image with a first writing image, wherein

the first writing image includes the masked part of the second writing region that is left undeleted, and

the first writing image corresponds to the second recording candidate image that is left undeleted is masked.

8. The information processing apparatus according to claim 7 , wherein the CPU is further configured to:

set a recorded flag for a pixel of the part of the second writing region that is left undeleted;

mask the recorded flag; and

update the first recording candidate image with a second writing image, wherein

the second writing image includes the masked recorded flag, and

the second writing image is associated with the extracted board writing image.

9. The information processing apparatus according to claim 1 , wherein the CPU is further configured to:

determine a left undeleted time of a second writing region, wherein

the second writing region corresponds to the first writing region after the determined reduction; and

determine, to record the updated first recording candidate image as the recorded image, based on the determined left undeleted time of the second writing region, wherein

the determination to record the updated first recording candidate image as the recorded image is after the determination of the reduction in the first writing region.

10. The information processing apparatus according to claim 9 , wherein the CPU is further configured to:

set the left undeleted time for each pixel of the second writing region; and

determine, based on the left undeleted time, to record the updated first recording candidate image as the recorded image.

11. The information processing apparatus according to claim 10 , wherein the CPU is further configured to:

determine the left undeleted time is shorter than a specific time; and

control, based on the determination that the set left undeleted time is shorter than the specific time, not to record the updated first recording candidate image as the recorded image.

12. The information processing apparatus according to claim 11 , wherein the CPU is further configured to:

control, based on the determination that the left undeleted time is shorter than the specific time, record of the second writing region as a memo image, wherein

the memo image is different from the recorded image.

13. The information processing apparatus according to claim 1 , wherein the captured image is one frame of a moving image.

14. The information processing apparatus according to claim 1 , wherein the captured image is a still image.

15. An information processing method performed by an information processing apparatus, the method comprising:

acquiring a captured image that includes a writing object, wherein the writing object includes written information;

extracting a board writing image from the captured image;

setting a writing region in the extracted board writing image;

determining an increase in the writing region;

updating, with the extracted board writing image, a recording candidate image, wherein

the recording candidate image is updated based on the determined increase in the writing region, and

the recording candidate image is a candidate for a recorded image;

determining reduction in the writing region; and

controlling, based on the determined reduction in the writing region, record of the updated recording candidate image as the recorded image.

16. A non-transitory computer-readable medium having stored thereon, computer executable instructions, which when executed by a computer, cause the computer to execute operations, the operations comprising:

acquiring a captured image that includes a writing object, wherein the writing object includes written information;

extracting a board writing image from the captured image;

setting a writing region in the extracted board writing image;

determining an increase in the writing region;

updating, with the extracted board writing image, a recording candidate image, wherein

the recording candidate image is updated based on the determined increase in the writing region, and

the recording candidate image is a candidate for a recorded image;

determining reduction in the writing region; and

controlling, based on the determined reduction in the writing region, record of the updated recording candidate image as the recorded image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 7, 2022
From: NOMURA, NAOKI
To: SONY GROUP CORPORATION
Reel/Frame 059537/0023 →
Priority Claims (1)
JP 2019-190231 · Oct 17, 2019 · national
Continuity (1)
Related Publication 20240078007A1 · Mar 7, 2024
Cited By (1)
US 12,342,103