IP Library › Granted Patent US 12,526,524
Granted Patent B2
US 12,526,524 · App. 18/458,793 · Granted Jan 13, 2026

System and method for determining when to zoom onto barcode or other optical code using imaging sensor of mobile device

Inventors: Zhicheng Tang (Columbia, MO); Haichao Zhang (Santa Clara, CA); Ji Liang (Salt Lake City, UT); Sia Jeffry Saputra (Sunnyvale, CA); Rathinamoorthy Mylsamy (Milpitas, CA)
Assignee: Samsung Electronics Co., Ltd.
H04N23/69G06K7/1443H04N23/61
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,526,524
App. No.
18/458,793
Granted
Jan 13, 2026
Kind
B2
Abstract

A method includes obtaining a first image frame captured using at least one imaging sensor. The method also includes determining that an optical code is contained within the first image frame and determining whether to automatically zoom onto the optical code. The method further includes, in response to determining to automatically zoom onto the optical code, identifying a zoom ratio to be applied. In addition, the method includes controlling the at least one imaging sensor to capture a second image frame that is zoomed onto the optical code using the zoom ratio. Determining whether to automatically zoom onto the optical code includes identifying a distance between the optical code and a nearest edge or a nearest corner in the first image frame and determining to automatically zoom onto the optical code based on the identified distance being greater than a threshold distance.

Claims (77)

1 . A method comprising:

obtaining, using at least one processor of an electronic device, a first image frame captured using at least one imaging sensor;

determining, using the at least one processor, that an optical code is contained within the first image frame;

determining, using the at least one processor, whether to automatically zoom onto the optical code;

in response to determining to automatically zoom onto the optical code, identifying, using the at least one processor, a zoom ratio to be applied; and

controlling, using the at least one processor, the at least one imaging sensor to capture a second image frame that is zoomed onto the optical code using the zoom ratio;

wherein determining whether to automatically zoom onto the optical code comprises:

identifying a distance between the optical code and a nearest edge or a nearest corner in the first image frame; and

determining to automatically zoom onto the optical code based on the identified distance being greater than a threshold distance.

2 . The method of claim 1 , wherein determining whether to automatically zoom onto the optical code further comprises:

identifying a probable position of the optical code within the first image frame and a confidence score representing a likelihood of the optical code being at the probable position;

in response to determining that the confidence score exceeds a threshold confidence score, determining an occupancy rate of the optical code within the first image frame based on a ratio of an area of the optical code within the first image frame and an area of the first image frame; and

determining to automatically zoom onto the optical code based on the occupancy rate being less than a threshold occupancy rate.

3 . The method of claim 1 , wherein determining whether to automatically zoom onto the optical code further comprises:

determining whether the at least one imaging sensor was moving by at least a threshold amount when the first image frame was captured; and

determining to automatically zoom onto the optical code based on the at least one imaging sensor not moving by at least the threshold amount when the first image frame was captured.

4 . The method of claim 1 , wherein determining whether to automatically zoom onto the optical code further comprises:

determining an image quality of the first image frame; and

determining to automatically zoom onto the optical code based on the image quality exceeding a threshold quality.

5 . The method of claim 1 , further comprising:

attempting to decode the optical code using the first image frame in parallel with determining whether to automatically zoom onto the optical code;

wherein determining whether to automatically zoom onto the optical code comprises determining to automatically zoom onto the optical code based on failing to decode the optical code using the first image frame.

6 . The method of claim 1 , wherein controlling the at least one imaging sensor to capture the second image frame comprises:

automatically controlling the at least one imaging sensor to zoom onto the optical code using the zoom ratio; and

automatically controlling the at least one imaging sensor to capture the second image frame.

7 . The method of claim 1 , wherein the optical code comprises a one-dimensional barcode or a two-dimensional barcode.

8 . An electronic device comprising:

at least one imaging sensor configured to capture a first image frame; and

at least one processor configured to:

determine that an optical code is contained within the first image frame;

determine whether to automatically zoom onto the optical code;

in response to determining to automatically zoom onto the optical code, identify a zoom ratio to be applied; and

control the at least one imaging sensor to capture a second image frame that is zoomed onto the optical code using the zoom ratio;

wherein, to determine whether to automatically zoom onto the optical code, the at least one processor is configured to:

identify a distance between the optical code and a nearest edge or a nearest corner in the first image frame; and

determine to automatically zoom onto the optical code based on the identified distance being greater than a threshold distance.

9 . The electronic device of claim 8 , wherein, to determine whether to automatically zoom onto the optical code, the at least one processor is further configured to:

identify a probable position of the optical code within the first image frame and a confidence score representing a likelihood of the optical code being at the probable position;

in response to determining that the confidence score exceeds a threshold confidence score, determine an occupancy rate of the optical code within the first image frame based on a ratio of an area of the optical code within the first image frame and an area of the first image frame; and

determine to automatically zoom onto the optical code based on the occupancy rate being less than a threshold occupancy rate.

10 . The electronic device of claim 8 , wherein, to determine whether to automatically zoom onto the optical code, the at least one processor is further configured to:

determine whether the at least one imaging sensor was moving by at least a threshold amount when the first image frame was captured; and

determine to automatically zoom onto the optical code based on the at least one imaging sensor not moving by at least the threshold amount when the first image frame was captured.

11 . The electronic device of claim 8 , wherein, to determine whether to automatically zoom onto the optical code, the at least one processor is further configured to:

determine an image quality of the first image frame; and

determine to automatically zoom onto the optical code based on the image quality exceeding a threshold quality.

12 . The electronic device of claim 8 , wherein:

the at least one processor is further configured to attempt to decode the optical code using the first image frame in parallel with determining whether to automatically zoom onto the optical code; and

to determine whether to automatically zoom onto the optical code, the at least one processor is further configured to determine to automatically zoom onto the optical code based on failing to decode the optical code using the first image frame.

13 . The electronic device of claim 8 , wherein, to control the at least one imaging sensor to capture the second image frame, the at least one processor is further configured to:

automatically control the at least one imaging sensor to zoom onto the optical code using the zoom ratio; and

automatically control the at least one imaging sensor to capture the second image frame.

14 . The electronic device of claim 8 , wherein the optical code comprises a one-dimensional barcode or a two-dimensional barcode.

15 . A non-transitory machine-readable medium containing instructions that when executed cause at least one processor of an electronic device to:

obtain a first image frame captured using at least one imaging sensor;

determine that an optical code is contained within the first image frame;

determine whether to automatically zoom onto the optical code;

in response to determining to automatically zoom onto the optical code, identify a zoom ratio to be applied; and

control the at least one imaging sensor to capture a second image frame that is zoomed onto the optical code using the zoom ratio;

wherein the instructions that when executed cause the at least one processor to determine whether to automatically zoom onto the optical code comprise instructions that when executed cause the at least one processor to:

identify a distance between the optical code and a nearest edge or a nearest corner in the first image frame; and

determine to automatically zoom onto the optical code based on the identified distance being greater than a threshold distance.

16 . The non-transitory machine-readable medium of claim 15 , wherein the instructions that when executed cause the at least one processor to determine whether to automatically zoom onto the optical code further comprise instructions that when executed cause the at least one processor to:

identify a probable position of the optical code within the first image frame and a confidence score representing a likelihood of the optical code being at the probable position;

in response to determining that the confidence score exceeds a threshold confidence score, determine an occupancy rate of the optical code within the first image frame based on a ratio of an area of the optical code within the first image frame and an area of the first image frame; and

determine to automatically zoom onto the optical code based on the occupancy rate being less than a threshold occupancy rate.

17 . The non-transitory machine-readable medium of claim 15 , wherein the instructions that when executed cause the at least one processor to determine whether to automatically zoom onto the optical code further comprise instructions that when executed cause the at least one processor to:

determine whether the at least one imaging sensor was moving by at least a threshold amount when the first image frame was captured; and

determine to automatically zoom onto the optical code based on the at least one imaging sensor not moving by at least the threshold amount when the first image frame was captured.

18 . The non-transitory machine-readable medium of claim 15 , wherein the instructions that when executed cause the at least one processor to determine whether to automatically zoom onto the optical code further comprise instructions that when executed cause the at least one processor to:

determine an image quality of the first image frame; and

determine to automatically zoom onto the optical code based on the image quality exceeding a threshold quality.

19 . The non-transitory machine-readable medium of claim 15 , further containing instructions that when executed cause the at least one processor to attempt to decode the optical code using the first image frame in parallel with determining whether to automatically zoom onto the optical code;

wherein the instructions that when executed cause the at least one processor to determine whether to automatically zoom onto the optical code further comprise instructions that when executed cause the at least one processor to determine to automatically zoom onto the optical code based on failing to decode the optical code using the first image frame.

20 . The non-transitory machine-readable medium of claim 15 , wherein the instructions that when executed cause the at least one processor to control the at least one imaging sensor to capture the second image frame comprise instructions that when executed cause the at least one processor to:

automatically control the at least one imaging sensor to zoom onto the optical code using the zoom ratio; and

automatically control the at least one imaging sensor to capture the second image frame.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 30, 2023
From: TANG, ZHICHENG; ZHANG, HAICHAO; LIANG, JI; SAPUTRA, SIA JEFFRY; MYLSAMY, RATHINAMOORTHY
To: SAMSUNG ELECTRONICS CO., LTD
Reel/Frame 064757/0209 →
Continuity (2)
Provisional Application 63461849 · Apr 25, 2023
Related Publication 20240365004A1 · Oct 31, 2024
References Cited (23)
US 8040399B2 · Georgis et al. · 2011 [cited by applicant]
US 9195873B2 · Gopalakrishnan et al. · 2015 [cited by applicant]
US 9781350B2 · Gao et al. · 2017 [cited by applicant]
US 11244147B2 · Floerkemeier et al. · 2022 [cited by applicant]
US 11265474B2 · Dolgin et al. · 2022 [cited by applicant]
US 11561678B1 · Shang et al. · 2023 [cited by applicant]
US 20150363625A1 · Wu · 2015 [cited by examiner]
US 20220377241A1 · Miyake et al. · 2022 [cited by applicant]
US 20230214960A1 · Choudhary · 2023 [cited by examiner]
US 20230283876A1 · Yoo · 2023 [cited by examiner]
JP H11324235A · 1999 [cited by applicant]
WO 2022260258A1 · 2022 [cited by applicant]
Dynamsoft Developers Blog, “QR Code Scanning: Zoom From a Distance,” dynamsoft.com, May 2021, 10 pages. [cited by applicant]
Tran, “Auto-zoom feature for QR Code scanner with Google vision,” stackoverflow.com, Sep. 2019, 2 pages. [cited by applicant]
“Barcode scanner apps for Android—javatpoint,” javapoint.com, 2021, 13 pages. [cited by applicant]
“qr_scanner_plus | Flutter Package,” pub.dev, Aug. 2022, 8 pages. [cited by applicant]
Molenaar, “11 Top QR Scanners to Download to Your Mobile Device,” influencermarketinghub.com, Oct. 2021, 18 pages. [cited by applicant]
Huawei Developer, “Scan Kit—HMS Core,” Mar. 2020, 8 pages. [cited by applicant]
Funcode Technology, “Industrial 2D Barcode Solutions—Funcode Technology,” funcode-tech.com, Nov. 2021, 13 pages. [cited by applicant]
DENSO International America, “Inventor of the QR Code Develops a New Reader Application,” prnewswire.com, Jun. 2010, 5 pages. [cited by applicant]
Apps Wing, “QR Scanner—Barcode Reader,” apkfab.com, Sep. 2021, 6 pages. [cited by applicant]
Tan et al., “EfficientDet: Scalable and Efficient Object Detection,” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020, 10 pages. [cited by applicant]
Kundu, “YOLO Algorithm for Object Detection Explained [+Examples],” v7labs.com, Jan. 2023, 25 pages. [cited by applicant]