IP Library Granted Patent US 12688586
Granted Patent B2
US 12688586 · App. 17/916,425 · Granted Jul 21, 2026

Image processing device, image processing method, and program

Inventor: Hiroyoshi Fujii (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
G06T7/20G06T5/50G06V30/22H04N23/69H04N23/695G06T2207/20221G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12688586
App. No.
17/916,425
Granted
Jul 21, 2026
Kind
B2
Abstract

An image processing device according to the present disclosure includes: a movement detection unit that detects movement of a movable writing medium based on moving image data obtained by imaging the writing medium and a writer writing on the writing medium; and a writing portion detection unit that detects a writing portion on the writing medium, wherein the writing portion detection unit executes processing corresponding to the movement of the writing medium in a case where the movement of the writing medium is detected.

Claims (54)

1 . An image processing device comprising:

circuitry configured to

detect movement of at least one movable writing medium of a plurality of individually movable writing media included in a writing medium group based on moving image data obtained by imaging each movable writing medium and a writer writing on one or more of the plurality of individually movable writing media,

detect a writing portion on the one or more of the plurality of individually movable writing media,

execute processing on a detection result of the writing portion corresponding to the movement of each movable writing medium in a case where the movement of the at least one movable writing medium is detected, and

generate a writing log based on a detection result of the movement,

wherein the circuitry generates the writing log in a case where the movement of the at least one movable writing medium is detected.

2 . The image processing device according to claim 1 ,

wherein the circuitry is further configured to

detect a straight line portion of a frame of each movable writing medium, and

detect the movement of the at least one movable writing medium by detecting movement of the straight line portion.

3 . The image processing device according to claim 2 ,

wherein the circuitry is further configured to distinguish between a straight line included in the writing portion and the frame of each movable writing medium based on a length of the detected straight line portion.

4 . The image processing device according to claim 1 ,

wherein the circuitry detects the movement of the at least one movable writing medium by estimating an optical flow in which movement of the writing portion associated with the movement of the at least one movable writing medium is represented by a vector.

5 . The image processing device according to claim 4 ,

wherein the circuitry is further configured to

group the optical flow, and

distinguish between movement of the writer and the movement of the at least one movable writing medium based on a size of a grouped region and a direction of movement.

6 . The image processing device according to claim 1 ,

wherein the circuitry detects the movement of the at least one movable writing medium by recognizing each movable writing medium using general object recognition that recognizes an object by a general name, and tracking a position or a center of gravity of each movable writing medium.

7 . The image processing device according to claim 6 ,

wherein the circuitry is further configured to distinguish between movement of the writer and the movement of the at least one movable writing medium by recognizing the writer as well using the general object recognition.

8 . The image processing device according to claim 1 ,

wherein the circuitry executes the processing by deleting the detection result of the writing portion on the at least one movable writing medium in a case where the movement of the at least one movable writing medium is detected.

9 . The image processing device according to claim 8 ,

wherein the circuitry individually detects movement with respect to each movable writing media of the plurality of individually movable writing media, and

wherein, in a case where the movement of the at least one movable writing medium of the plurality of individually movable writing media is detected, the circuitry deletes the detection result of the writing portion on each writing medium whose movement is detected and holds the detection result of the writing portion on each writing medium whose movement is not detected.

10 . The image processing device according to claim 1 ,

wherein the circuitry executes the processing by changing an angle of view of an imaging device that images the moving image data in a case where the at least one movable writing medium moves out of a frame of the obtained moving image data.

11 . The image processing device according to claim 10 ,

wherein the circuitry executes the processing by causing imaging to be performed at a wider angle of view in a case where the angle of view of the imaging device is changed.

12 . The image processing device according to claim 1 ,

wherein the circuitry is further configured to generate writing data based on the detection result of the writing portion.

13 . The image processing device according to claim 12 ,

wherein the circuitry is further configured to generate composite moving image data by superimposing the generated writing data on the obtained moving image data.

14 . The image processing device according to claim 1 ,

wherein the circuitry generates the writing log in a case where the movement of the at least one movable writing medium is detected at a predetermined speed or more.

15 . The image processing device according to claim 1 ,

wherein the circuitry generates the writing log in a case where the movement of the at least one movable writing medium is detected and the writing portion reaches from a first end to a second end of the movable writing medium.

16 . The image processing device according to claim 1 ,

wherein the circuitry detects the movement of the at least one movable writing medium based on information related to each movable writing medium input by a user.

17 . An image processing method comprising:

detecting movement of at least one movable writing medium of a plurality of individually movable writing media included in a writing medium group based on moving image data obtained by imaging each movable writing medium and a writer writing on one or more of the plurality of individually movable writing media;

detecting a writing portion on the one or more of the plurality of individually movable writing media;

executing processing on a detection result of the writing portion corresponding to the movement of each movable writing medium is executed in a case where the movement of the at least one movable writing medium is detected; and

generating a writing log based on a detection result of the movement,

wherein the writing log is generated in a case where the movement of the at least one movable writing medium is detected.

18 . A non-transitory computer-readable storage medium having embodied thereon a program, which when executed by a computer causes the computer to execute a method, the method comprising:

detecting movement of at least one movable writing medium of a plurality of individually movable writing media included in a writing medium group based on moving image data obtained by imaging each movable writing medium and a writer writing on one or more of the plurality of individually movable writing media; and

detecting a writing portion on the one or more of the plurality of individually movable writing media;

executing processing on a detection result of the writing portion corresponding to the movement of each movable writing medium is executed in a case where the movement of the at least one movable writing medium is detected; and

generating a writing log based on a detection result of the movement,

wherein the writing log is generated in a case where the movement of the at least one movable writing medium is detected.