IP Library Granted Patent US 9,052,866
Granted Patent B2
US 9,052,866 · App. 13/469,074 · Granted Jun 9, 2015

Method, apparatus and computer-readable medium for image registration and display

Inventors: Chun-Hsiang Huang (Taoyuan County, TW); Chung-Huan Mei (Taoyuan County, TW); Hao-Yuan Chen (Taoyuan County, TW); Li-Hui Chen (Taoyuan County, TW); Cheng-Shiun Jan (Taoyuan County, TW)
Assignee: HTC Corporation
G06F3/1446H04N1/3876G06T7/0028G06T2207/10016G09G2356/00H04M1/7253
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,052,866
App. No.
13/469,074
Granted
Jun 9, 2015
Kind
B2
Abstract

A method, an apparatus, and a computer-readable medium for image registration and display are provided. In the method, a registration request is respectively sent to each of the electronic apparatuses to control the electronic apparatus to capture a local image and return the captured local image to the master apparatus. Next, an image registration is performed on the local images to obtain registration information among the local images. Then, a relative location between the master apparatus and each electronic apparatus is estimated according to the registration information. Finally, at least one frame to be displayed are oriented according to the estimated relative locations and sent to the electronic apparatuses for display.

Claims (36)

1. An image registration and display method, adapted to a master apparatus of a plurality of electronic apparatuses to orient at least one frame to be displayed on the electronic apparatuses, wherein each electronic apparatus comprises an image capturing unit and a display unit disposed at the same side and the method comprises:

respectively sending a registration request to each of the electronic apparatuses to control the electronic apparatus to capture a local image and return the captured local image to the master apparatus;

performing an image registration on the local images to obtain a registration information among the local images;

estimating a relative location between the master apparatus and each electronic apparatus according to the registration information; and

orienting at least one frame to be displayed according to the estimated relative locations and sending the at least one frame to the electronic apparatuses for display, wherein the step of estimating the relative location between the master apparatus and each electronic apparatus according to the registration information comprises:

obtaining at least one parameter of each electronic apparatus; and

estimating the relative location between the master apparatus and each electronic apparatus by combining the at least one parameter and the registration information.

2. The image registration and display method of claim 1 , wherein before respectively sending the registration request to the electronic apparatus, the method further comprises:

establishing a wireless connection with each electronic apparatus to send the registration request and receive the local image through the wireless connection.

3. The image registration and display method of claim 2 , wherein the wireless connection comprises near field communication (NFC), Bluetooth, or Wi-Fi.

4. The image registration and display method of claim 1 , wherein before respectively sending the registration request to the electronic apparatus, the method further comprises:

closely placing the electronic apparatuses on a same plane to make the local image captured by each electronic apparatus have an overlapped area with at least one local image captured by other electronic apparatuses.

5. The image registration and display method of claim 2 , wherein the step of performing the image registration on the local images to obtain the registration information among the local images comprises:

extracting a plurality of salient points correspondingly existed in the local images, and utilizing locations of the salient points in the local images as the registration information among the local images.

6. The image registration and display method of claim 1 , wherein the at least one parameter comprises one or a combination of an image resolution, a focal length of the image capturing unit capturing the local image, a lens location of the image capturing unit, and a display resolution of the display unit.

7. The image registration and display method of claim 1 , wherein the step of orienting the at least one frame to be displayed according to the estimated relative locations and sending the at least one frame to the electronic apparatuses for display comprises:

separating a display frame into a plurality of portions and respectively sending the portions of the display frame to the electronic apparatuses for display according to the estimated relative locations.

8. An image registration and display apparatus, comprising:

a communication unit, configured to respectively send a registration request to each of a plurality of electronic apparatuses to control the electronic apparatus to capture a local image and return the captured local image;

an image registration unit, configured to perform an image registration on the local images to obtain a registration information among the local images;

a location estimation unit, configured to estimate a relative location between the image registration and display apparatus and each electronic apparatus according to the registration information; and

an image orienting unit, configured to orient at least one frame to be displayed according to the estimated relative locations and send the at least one frame to the electronic apparatuses for display,

wherein the location estimation unit comprises obtaining at least one parameter of each electronic apparatus, and estimating the relative location between the master apparatus and each electronic apparatus by combining the at least one parameter and the registration information.

9. The image registration and display apparatus of claim 8 , wherein the communication unit comprises establishing a wireless connection with each electronic apparatus to send the registration request and receive the local image through the wireless connection.

10. The image registration and display apparatus of claim 9 , wherein the wireless connection comprises near field communication (NFC), Bluetooth, or Wi-Fi.

11. The image registration and display apparatus of claim 8 , wherein the electronic apparatuses are closely placed on a same plane to make the local image captured by each electronic apparatus have an overlapped area with at least one local image captured by other electronic apparatuses.

12. The image registration and display apparatus of claim 8 , wherein the image registration unit comprises extracting a plurality of salient points correspondingly existed in the local images, and utilizing locations of the salient points in the local images as the registration information among the local images.

13. The image registration and display apparatus of claim 8 , wherein the at least one parameter comprises one or a combination of an image resolution, a focal length of the image capturing unit capturing the local image, a lens location of the image capturing unit, and a display resolution of the display unit.

14. The image registration and display apparatus of claim 8 , wherein the image orienting unit comprises separating a display frame into a plurality of portions and respectively sending the portions of the display frame to the electronic apparatuses for display according to the estimated relative locations.

15. A non-transitory computer-readable medium, recording program instructions for:

respectively sending a registration request to each of a plurality of electronic apparatuses to control the electronic apparatus to capture a local image and return the captured local image to the master apparatus;

performing an image registration on the local images to obtain a registration information among the local images;

estimating a relative location between the master apparatus and each electronic apparatus according to the registration information; and

orienting at least one frame to be displayed according to the estimated relative locations and sending the at least one frame to the electronic apparatuses for display, wherein the step of estimating the relative location between the master apparatus and each electronic apparatus according to the registration information comprises:

obtaining at least one parameter of each electronic apparatus; and

estimating the relative location between the master apparatus and each electronic apparatus by combining the at least one parameter and the registration information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2012
From: HUANG, CHUN-HSIANG; MEI, CHUNG-HUAN; CHEN, HAO-YUAN; CHEN, LI-HUI; JAN, CHENG-SHIUN
To: HTC CORPORATION
Reel/Frame 028221/0640 →
Continuity (1)
Related Publication 20130300885A1 · Nov 14, 2013