IP Library › Granted Patent US 11,587,202
Granted Patent B2
US 11,587,202 · App. 16/060,128 · Granted Feb 21, 2023

Method, apparatus or computer program for controlling image processing of a captured image of a scene to adapt the captured image

Inventors: Antti Eronen (Tampere, FI); Jussi Leppänen (Tampere, FI); Arto Lehtiniemi (Lempäälä, FI); Kimmo Roimela (Tampere, FI)
Assignee: NOKIA TECHNOLOGIES OY
G06T3/4038G06F3/017G06T7/50G06T19/006G06V20/00G06V20/64G06V40/28G06V20/44
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,587,202
App. No.
16/060,128
Granted
Feb 21, 2023
Kind
B2
Abstract

A method comprising: processing a recording of a scene to recognise a predetermined user command event performed within the scene; and automatically controlling image processing of a captured image of the scene to adapt the captured image, in dependence on said recognition of the predetermined user command event performed within the scene.

Claims (36)

1. An apparatus comprising:

at least one processor; and

at least one memory including computer program code,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following:

process a recording of a scene to recognize a predetermined user command event performed within the scene;

identify a moving object in the recording of the scene that is associated with the user command event;

track the moving object in a sequence of frames of the recording of the scene; and

control image processing of the recording of the scene, in dependence on said recognition of the user command event performed within the scene by removing the tracked moving object from the sequence of the frames of the recording of the scene and replacing the tracked moving object with different content.

2. An apparatus as claimed in claim 1 , wherein processing the recording of the scene to recognize the predetermined user command event performed within the scene comprises image analysis of a recorded image of the scene to recognize the predetermined user command event performed within the scene.

3. An apparatus as claimed in claim 1 , wherein processing the recording of the scene to recognize the predetermined user command event performed within the scene comprises gesture recognition of a person within the scene.

4. An apparatus as claimed in claim 1 , wherein processing the recording of the scene to recognize the predetermined user command event performed within the scene occurs in response to at least one of (a) a user initiation event dependent upon proximal user event detection, (b) a user action recognition, or (c) a user identity recognition.

5. An apparatus as claimed in claim 1 , wherein the predetermined user command event is not recognized in all of the frames in which the moving object is tracked.

6. An apparatus as claimed in claim 1 , wherein controlling image processing of the recording of the scene comprises controlling processing of:

a first image of the recording of the scene captured at a first time, where a portion of the scene has a first state in the captured first image, and

a second image of the recording of the scene captured at a second time, where the portion of the scene has a second state in the captured second image,

wherein the portion of the recording of the scene changes between the first state and the second state,

to generate a third image, comprising the second image of the recording of the scene, adapted such that the portion of the second image has the first state in an adapted captured second image.

7. An apparatus as claimed in claim 6 , wherein the third image, comprises the second image of the recording of the scene having a replacement image portion for the portion of the recording of the scene, the replacement image portion depending upon the portion of the recording of the scene captured in the first image.

8. An apparatus as claimed in claim 6 , comprising enabling user selection of the portion or enabling automatic selection of the portion.

9. A method comprising:

processing a recording of a scene to recognize a predetermined user command event performed within the scene;

identifying a moving object in the recording of the scene that is associated with the predetermined user command event;

tracking the moving object in a sequence of frames of the recording of the scene; and

controlling image processing of the recording of the scene, in dependence on said recognition of the predetermined user command event performed within the scene by removing the tracked moving object from the sequence of frames of the recording of the scene and replacing the tracked moving object with different content.

10. A method as claimed in claim 9 , wherein processing the recording of the scene to recognize the predetermined user command event performed within the scene comprises image analysis of a recorded image of the scene to recognize the predetermined user command event performed within the scene.

11. A method as claimed in claim 9 , wherein processing the recording of the scene to recognize the predetermined user command event performed within the scene comprises gesture recognition of a person within the scene.

12. A method as claimed in claim 9 , wherein processing the recording of the scene to recognize the predetermined user command event performed within the scene occurs in response to at least one of (a) a user initiation event dependent upon proximal user event detection, (b) a user action recognition, or (c) a user identity recognition.

13. A method as claimed in claim 9 , wherein the predetermined user command event is not recognized in all of the sequence of the frames in which the moving object is tracked.

14. At least one non-transitory computer readable medium comprising instructions that, when executed, perform at least the following:

process a recording of a scene to recognize a predetermined user command event performed within the scene;

identify a moving object in the recording of the scene that is associated with the predetermined user command event;

track the moving object in a sequence of frames of the recording of the scene; and

control image processing of the recording of the scene, in dependence on said recognition of the predetermined user command event performed within the scene by removing the tracked moving object from the sequence of the frames of the recording of the scene and replacing the tracked moving object with different content.

15. The apparatus as claimed in claim 1 , wherein the moving object is a person performing or having performed the user command.

16. The method as claimed in claim 9 , wherein the moving object is a person performing or having performed the user command.

17. The non-transitory computer readable medium as claimed in claim 14 , wherein the moving object is a person performing or having performed the user command.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 7, 2018
From: ERONEN, ANTTI; LEPPANEN, JUSSI; LEHTINIEMI, ARTO; ROIMELA, KIMMO
To: NOKIA TECHNOLOGIES OY
Reel/Frame 046013/0659 →
Priority Claims (1)
EP 15200926 · Dec 17, 2015 · regional
Continuity (1)
Related Publication 20180374196A1 · Dec 27, 2018