IP Library Granted Patent US 10,503,777
Granted Patent B2
US 10,503,777 · App. 14/822,374 · Granted Dec 10, 2019

Method and device relating to information management

Inventor: Anders Mardell (Sollentuna, SE)
Assignee: Sony Corporation
G06F16/583G06K9/00288G06Q10/00H04W4/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,503,777
App. No.
14/822,374
Granted
Dec 10, 2019
Kind
B2
Abstract

A method and an arrangement for use in a device, such as a communication device, may be configured to generate an assembly based on one or more images. The system may include an image retrieval portion for retrieving the one or more images from an image source, an arrangement for fetching data corresponding to the one or more images, and converting the data to presentable information, and an arrangement for generating the assembly including the one or more images and the presentable information provided with description.

Claims (86)

1. A method comprising:

obtaining, by a device, information regarding one or more images, wherein obtaining the information regarding the one or more images comprises automatically extracting information from the one or more images using an image recognition application;

detecting, by the device, a pose of a person in the one or more images based on the information automatically extracted from the one or more images; and

automatically determining and narrating a context of the one or more images, in response to detecting the pose of the person, wherein automatically determining and narrating the context comprises:

determining, by the device, an activity performed by the person based on the pose of the person;

generating, by the device and based on the activity, information describing the one or more images; and

providing, by the device, the one or more images with the information describing the one or more images.

2. The method of claim 1 ,

wherein determining the activity performed by the person is performed using gesture recognition, and

where generating the information describing the one or more images includes:

generating the information describing the one or more images in at least one of a text format, an audio format, or a video format.

3. The method of claim 1 , where obtaining the information regarding the one or more images includes:

obtaining the information regarding the one or more images from metadata associated with the one or more images,

where the metadata identifies content included in the one or more images.

4. The method of claim 1 , where providing the one or more images with the information describing the one or more images includes:

providing, via a Multimedia Messaging Service (MMS), the one or more images with the information describing the one or more images; or

providing, via e-mail, the one or more images with the information describing the one or more images.

5. The method of claim 1 , where obtaining the information regarding the one or more images includes:

performing face recognition to obtain the information automatically extracted from the one or more images; and/or

performing smile detection to obtain the information automatically extracted from the one or more images.

6. The method of claim 1 , where obtaining the information regarding the one or more images includes:

obtaining the information regarding the one or more images from information, stored in the device, associated with the one or more images.

7. The method of claim 1 , where the information, stored in the device, associated with the one or more images includes one or more of:

calendar information,

event information,

distance measurement information, or

messaging information.

8. The method of claim 1 , where the activity performed by the person is determined by using at least one of:

location information to determine if the one or more images are captured near a facility indicating activity, or

landmarks in the one or more images related to the location information to determine if the one or more images are captured near the facility indicating activity.

9. The method of claim 1 , where the activity performed by the person is identified based on receiving activity related information from a step counter.

10. A system comprising:

a processor configured to:

obtain information regarding one or more images,

where the processor, when obtaining the information regarding the one or more images, is further configured to:

automatically extract information from the one or more images using an image recognition application;

detect a pose of a person in the one or more images based on the information automatically extracted from the one or more images;

determine an activity performed by the person based on the pose of the person;

generate, based on the activity, information describing the one or more images; and

provide the one or more images with the information describing the one or more images to provide a text and/or audio narration of the one or more images.

11. The system of claim 10 , where, when obtaining the information regarding the one or more images, the processor is further configured to:

obtain the information regarding the one or more images from metadata associated with the one or more images,

where the metadata identifies content included in the one or more images.

12. The system of claim 10 , where, when providing the one or more images with the information describing the one or more images, the processor is further configured to:

cause the one or more images to be provided with the information describing the one or more images via a Multimedia Messaging Service (MMS); or

cause the one or more images to be provided with the information describing the one or more images via e-mail.

13. The system of claim 10 , where, when obtaining the information regarding the one or more images, the processor is further configured to:

perform face recognition to obtain the information automatically extracted from the one or more images.

14. The system of claim 10 , where, when obtaining the information regarding the one or more images, the processor is further configured to at least one of:

perform smile detection to obtain the information automatically extracted from the one or more images; or

perform pose detection of the person to obtain the information automatically extracted from the one or more images.

15. The system of claim 10 , where, when obtaining the information regarding the one or more images, the processor is further configured to:

obtain the information regarding the one or more images from information, stored in a memory, associated with the one or more images,

the memory being associated with the processor.

16. The system of claim 15 , where the information, stored in the memory, associated with the one or more images includes one or more of:

calendar information,

event information,

distance measurement information, or

messaging information.

17. A non-transitory computer-readable medium storing instructions, the instructions comprising:

one or more instructions which, when executed by a processor, cause the processor to:

obtain information regarding one or more images,

the information regarding the one or more images being obtained by automatically extracting information from the one or more images using an image recognition application;

detect a pose of a person in the one or more images based on the information automatically extracted from the one or more images;

determine an activity performed by the person based on the pose of the person;

generate, based on the activity, information describing the one or more images; and

provide the one or more images with the information describing the one or more images, wherein providing the one or more images with the information comprises generating and sending a Multimedia Messaging Service (MMS) message comprising a text and/or audio narration of the one or more images.

18. The non-transitory computer-readable medium of claim 17 , where the one or more instructions to obtain the information regarding the one or more images include:

one or more instructions to obtain the information regarding the one or more images from metadata associated with the one or more images,

where the metadata identifies content included in the one or more images.

19. The non-transitory computer-readable medium of claim 17 , where the one or more instructions to provide the one or more images with the information describing the one or more images include:

one or more instructions to cause the one or more images to be provided with the information describing the one or more images via the MMS message; or

one or more instructions to cause the one or more images to be provided with the information describing the one or more images via e-mail.

20. The non-transitory computer-readable medium of claim 17 , where the one or more instructions to obtain the information regarding the one or more images include at least one of:

one or more instructions to perform face recognition to obtain the information automatically extracted from the one or more images;

one or more instructions to perform smile detection to obtain the information automatically extracted from the one or more images; or

one or more instructions to perform pose detection of the person to obtain the information automatically extracted from the one or more images.

21. The non-transitory computer-readable medium of claim 17 , where the one or more instructions to obtain the information regarding the one or more images include:

one or more instructions to obtain the information regarding the one or more images from information, stored in a memory, associated with the one or more images,

where the memory is associated with the processor, and

where the information, stored in the memory and associated with the one or more images, includes one or more of:

calendar information,

event information,

distance measurement information, or

messaging information.

22. The non-transitory computer-readable medium of claim 17 , wherein the MMS message further comprises a map on which positions are indicated based on positioning information in metadata for the one or more images.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 12, 2015
From: MARDELL, ANDERS
To: SONY ERICSSON MOBILE COMMUNICATIONS AB
Reel/Frame 036310/0116 →
PARTIAL ASSIGNMENT Recorded Aug 12, 2015
From: SONY MOBILE COMMUNICATIONS AB
To: SONY CORPORATION
Reel/Frame 036336/0336 →
CHANGE OF NAME Recorded Aug 12, 2015
From: SONY ERICSSON MOBILE COMMUNICATIONS AB
To: SONY MOBILE COMMUNICATIONS AB
Reel/Frame 036336/0355 →