IP Library › Granted Patent US 10,187,569
Granted Patent B2
US 10,187,569 · App. 15/310,235 · Granted Jan 22, 2019

Portable device capable of generating panoramic file

Inventors: Tsu-Ming Liu (Hsinchu, TW); Kui-Chang Tseng (Kaohsiung, TW); Chi-Cheng Ju (Hsinchu, TW); Chih-Ming Wang (Zhubei, TW)
Assignee: MEDIATEK INC.
H04N5/23238G06F3/016G06F3/0488G06F3/16G06K9/00255G06K9/6267G06T3/4038G06T7/70H04N5/04H04N5/2258H04N5/2353H04N5/23212H04N5/23216H04N5/23229H04N5/23241H04N5/23293H04N5/247H04N5/2624H04N7/0127H04N7/147H04N7/15H04N7/188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,187,569
App. No.
15/310,235
Granted
Jan 22, 2019
Kind
B2
Abstract

A portable device capable of building a panorama, a panoramic video or/and a panoramic audio. The portable device has a plurality of sensors with overlapping sensing areas and an input device receiving a trigger signal that triggers the sensors to sense data for generating a panoramic photo/video/audio file.

Claims (64)

1. A portable device, comprising:

a plurality of image sensors configured to capture images of a scene that correspond to overlapped fields of view;

a plurality of audio sensors configured to record sounds of the scene that correspond to overlapped fields of sound; and

a processing circuit configured to generate a panoramic file based on the captured images and the recorded sounds in response to a received trigger signal,

wherein

the plurality of image sensors includes

a first group of image sensors disposed for sensing the scene in first respective fields of view around the portable device that are defined with respect to a first plane of the panoramic file, and

a second group of image sensors disposed for sensing the scene in second respective fields of view around the portable device that are defined with respect to a second plane of the panoramic file,

the plurality of audio sensors includes

a first group of audio sensors disposed for sensing the scene in first respective fields of sound around the portable device that are defined with respect to the first plane of the panoramic file, and

a second group of audio sensors disposed for sensing the scene in second respective fields of sound around the portable device that are defined with respect to the second plane of the panoramic file, and

the first plane of the panoramic file differs from the second plane of the panoramic file.

2. The portable device as claimed in claim 1 , further comprising:

a panoramic image processor configured to process the captured images to form a panorama for presentation.

3. The portable device as claimed in claim 2 , further comprising:

a motion-sensing module configured to collect motion information about the portable device when the images are being captured,

wherein the panoramic image processor is configured to process the captured images to form the panorama based on the motion information.

4. The portable device as claimed in claim 2 , further comprising:

a positioning module configured to detect position or height information about the portable device when the images are being captured, such that the panorama is integrated with another panorama generated by another nearby portable device according to the position or height information about the portable device.

5. The portable device as claimed in claim 2 , wherein:

the image sensors are configured to consecutively capture images to record videos to be processed by the panoramic image processor for generating a panoramic video.

6. The portable device as claimed in claim 5 , further comprising:

a panoramic audio processor configured to generate a panoramic audio based on the recorded sounds.

7. The portable device as claimed in claim 6 , wherein:

the panoramic audio is associated with the panoramic video according to a timestamp for synchronization between video and audio.

8. The portable device as claimed in claim 6 , further comprising:

a speaker,

wherein the panoramic audio processor is configured to drive the speaker to output sounds according to a panoramic view window.

9. The portable device as claimed in claim 8 , wherein:

when driving the speaker for playing the panoramic audio, the panoramic audio processor is configured to combine a plurality of sound files weighted by variable weighting factors determined according to the panoramic view window.

10. The portable device as claimed in claim 5 , further comprising:

a video conference system configured to extract an image of a user's face from the panoramic video to focus a panoramic view window on the user's face.

11. The portable device as claimed in claim 5 , further comprising:

a gesture controller configured to extract a gesture from the panoramic video to control a target device.

12. The portable device as claimed in claim 2 , wherein:

the panoramic image processor is configured to adjust frame rates of the image sensors.

13. The portable device as claimed in claim 2 , further comprising:

a panoramic display processor; and

a display,

wherein the panoramic display processor is configured to output a display image based on the panorama for the display to display.

14. The portable device as claimed in claim 13 , wherein:

the panoramic display processor is configured to update the display image output to the display according to a change of a panoramic view window.

15. The portable device as claimed in claim 14 , wherein:

the display is a touch panel, and

the panoramic view window is changed according to a touch operation sensed on the touch panel.

16. The portable device as claimed in claim 14 , wherein:

the panoramic view window is changed according to a gesture captured by at least one of the image sensors.

17. The portable device as claimed in claim 14 , further comprising:

an ultrasonic sensor,

wherein the panoramic view window is changed according to a gesture detected by the ultrasonic sensor.

18. The portable device as claimed in claim 14 , further comprising:

a motion-sensing module,

wherein the panoramic view window is changed according to a motion of the portable device detected by the motion-sensing module.

19. The portable device as claimed in claim 2 , wherein:

the panoramic image processor is configured to

perform lens correlation between the image sensors,

process ISO values or resolutions of the captured images,

align the captured image, or

process the captured images to form the panorama.

20. The portable device as claimed in claim 2 , wherein:

the panorama is encoded as a single frame formed by the captured images.

21. The portable device as claimed in claim 1 , wherein

the first plane of the panoramic file corresponds to a 360° plane surrounding one of a yaw axis, a pitch axis, and a roll axis of the portable device, and

the second plane of the panoramic file corresponds to another 360° plane surrounding another one of the yaw axis, the pitch axis, and the roll axis of the portable device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 10, 2016
From: LIU, TSU-MING; TSENG, KUI-CHANG; JU, CHI-CHENG; WANG, CHIH-MING
To: MEDIATEK INC.
Reel/Frame 040277/0311 →
Continuity (2)
Provisional Application 62029657 · Jul 28, 2014
Related Publication 20170272698A1 · Sep 21, 2017