An Embedded Real-time Object Alert System for Visually Impaired: A Monocular Depth Estimation based Approach through Computer Vision
Jareen Anjom Department of Electrical & Computer Engineering North South University Dhaka, Bangladesh [email protected] Rashik Iram Chowdhury Department of Electrical & Computer Engineering North South University Dhaka, Bangladesh [email protected], Tarbia Hasan Department of · 2025
Read An Embedded Real-time Object Alert System for Visually Impaired: A Monocular Depth Estimation based Approach through Computer Vision by Jareen Anjom Department of Electrical & Computer Engineering North South University Dhaka, Bangladesh [email protected] Rashik Iram Chowdhury Department of Electrical & Computer Engineering North South University Dhaka, Bangladesh [email protected], Tarbia Hasan Department of (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-08165.txt.
Introduction
Jareen Anjom, Rashik Iram Chowdhury, Tarbia Hasan, and Ishan Arefin Hossain wrote this research paper, published in 2025. It builds a wearable alert system that warns blind users about objects close ahead, designed for the crowded streets of Bangladesh.
The system pairs two vision models: one estimates depth from a single camera, and one detects objects. Together they judge what is near and raise an alert before a collision. Transfer learning trained the models, and compression tricks shrank them so they run in real time on small embedded hardware. The detection model scored well on the standard accuracy measure in tests. The authors aim the low-cost system at daily commutes, where dense obstacles and traffic make independent travel risky for people who cannot see.
Catalog record
| CREATOR | Jareen Anjom Department of Electrical & Computer Engineering North South University Dhaka, Bangladesh [email protected] Rashik Iram Chowdhury Department of Electrical & Computer Engineering North South University Dhaka, Bangladesh [email protected], Tarbia Hasan Department of |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-08165
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
An Embedded Real-time Object Alert System for Visually Impaired: A Monocular Depth Estimation based Approach through Computer Vision Jareen Anjom Department of Electrical & Computer Engineering North South University Dhaka, Bangladesh [email protected] Rashik Iram Chowdhury Department of Electrical & Computer Engineering North South University Dhaka, Bangladesh [email protected], Tarbia Hasan Department of Electrical & Computer Engineering North South University Dhaka, Bangladesh [email protected] Md. Ishan Arefin Hossain Department of Electrical & Computer Engineering North South University Dhaka, Bangladesh [email protected] Abstract Visually impaired people face significant challenges in their day-to-day commutes in the urban cities of Bangladesh due to the vast number of obstructions on every path. With many injuries taking place through road accidents on a daily basis, it is paramount for a system to be developed that can alert the visually impaired of objects in close distance beforehand. To overcome this issue, a novel alert system is proposed in this research to assist the visually impaired in commuting through these busy streets without colliding with any objects. The proposed system can alert the individual of objects that are present at a close distance. It utilizes transfer learning to train models for depth estimation and object detection and combines both models to introduce a novel system. The models are optimized through the utilization of quantization techniques to make them lightweight and efficient, allowing them to be easily deployed on embedded systems. The proposed solution achieved a lightweight real-time depth estimation and object detection model with an mAP50 of 0.801. I Introduction Visually impaired people face significant challenges in their day-to-day commutes in the urban cities of Bangladesh due to the vast number of obstructions on every path. With many injuries occurring through road accidents daily, it is paramount for a system to be developed that can alert the visually impaired of objects at close distance beforehand. Thus, a novel alert system is proposed in this research to assist the visually impaired in commuting through these busy streets without colliding with any objects. The proposed system can alert individuals to objects that are present at a close distance. It utilizes transfer learning to train models for depth estimation and object detection and combines both models to introduce a novel system. The models are optimized through quantization techniques to make them lightweight and efficient, allowing them to be easily deployed on embedded systems. The proposed solution achieved a lightweight real-time depth estimation and object detection model with a mAP50 of 0.801. The significant rise in the number of accidents on the streets of Bangladesh is a growing concern for the safety of pedestrians. A largely affected group of people is the visually impaired, who find it difficult to move across the busy streets without accidentally injuring themselves from various obstructions such as motorcycles, cars, pedestrians, rickshaw pullers, etc. This problem is primarily relevant in countries like Bangladesh, the eighth most densely populated country in the world [ 1 ] . Urban areas in the capital city of Dhaka face the busiest traffic and pedestrian crowds daily. In this country, about 750 thousand people are blind, and six million more have varying degrees of visual impairment [ 2 ] . According to a report [ 3 ] , the number of pedestrian fatalities in Dhaka is comparatively higher than in cities of other countries. With the prevalence of accidents, it is crucial to aid the visually impaired in safely moving through such obstructions. The visually impaired are accustomed to using walking sticks or canes to identify if any object is blocking their path ahead of them. Since they cannot easily identify the object type, several solutions have been implemented by researchers, such as the Smart Walker [ 13 ] , wearable spectacles for object identification [ 12 ] , and other object detection modules. However, most of these solutions are limited to indoor settings. Systems that have worked with outdoor surroundings [ 9 ] [ 10 ] [ 11 ] have been beneficial for the visually impaired to identify dangerous objects blocking their path on the streets. However, objects on the streets of Bangladesh can be quite different from those in other countries. For this purpose, a Bangladesh Road Scene dataset RSUD20K [ 14 ] is utilized in this research to help the visually impaired individuals who face various challenges in avoiding objects such as rickshaw vans, auto rickshaws, haulers, trucks, bicycles, etc. Then, a depth estimation model is used to identify objects in close proximity. The system utilizes Raspberry Pi camera modules to efficiently detect the depth of the objects ahead of the individuals and successfully identify the objects that are in close distance to avoid clashes. The objectives of this research are as follows: • Introduce an embedded system using Raspberry Pi that provides real-time alerts without a distributed network. • Combine both object detection and depth estimation models to introduce a transfer-learning based optimized novel system for object identification in close proximity by utilizing two datasets of different domains and apply quantization for generating a lightweight model. The paper is organized in sections as follows: Section II explores the existing related literature and their limitations, Section III is the detailed methodology of the system, Section IV evaluates various object detection models across different metrics. And finally, the paper is concluded in Section V . II Related Works Recent advancements in technologies for visually impaired individuals and autonomous systems have primarily focused either on object detection or on depth estimation to provide users with spatial awareness and obstacle detection in their surroundings. Very few have done both, and most of these works have not optimized their models for lightweight deployment on resource-constrained devices. This gap leaves a need for more efficient solutions that can achieve both tasks while maintaining a compact size and feasible real-time performance for assistive devices. The works listed below highlight the two objectives- Depth estimation and object detection. Table I shows a summary comparison of the related works and critically analyses the existing literature. TABLE I : Comparison of Notable Literature Ref. Target User Dataset Models Contribution Limitation [ 4 ] Visually impaired MS COCO, Flickr30k SSD and RNN Vision Navigator Framework Outdoor performance degradation [ 5 ] UAV navigation, autonomous systems Mid-Air dataset U-Net + YOLOv3 + Attention Unsupervised depth estimation Limited generalization [ 6 ] Autonomous vehicle developers Tartan Drive FCRN, ResNet-50 Monocular depth estimation Outputs Not Sharp like SOTA [ 7 ] Autonomous driving, robotics KITTI stereo Multi-stage architecture, SGM monoResMatch: Multi-scale feature extractor Stereo setup dependency [ 8 ] Autonomous driving, collision avoidance KITTI, Make3D, CityScapes PyD-Net variants Two lightweight architectures, PyD-Net and PyD-Net2 Accuracy gap with SOTA [ 16 ] Autonomous vehicles, robotics NYU Depth-V2, KITTI MobileNetV2, encoder-decoder Patch-Wise Attention Module, Multi-Scale Feature Fusion Lacks the accuracy of stereo or multi-view depth estimation [ 9 ] Visually impaired COCO Dataset YOLOv5, Transfer Learning YOLOv5 with an audio response system Limited generalization [ 10 ] Visually impaired Custom (OOD) dataset YOLOv5,v8 Object detection New dataset, object detection with auditory feedback Low FPS [ 11 ] Visually impaired TOC, COCO, TT100K YOLOv5-8, YOLO-NAS Real-time obstacle detection Limited generalization [ 12 ] Visually impaired Real-time environment images YOLO, Raspberry Pi Assistive device, high accuracy Lighting challenges, hardware