Person detection and re-identification in open-world settings of retail stores and public spaces
Branko Brkljač, Milan Brkljač · 2025
Read Person detection and re-identification in open-world settings of retail stores and public spaces by Branko Brkljač, Milan Brkljač (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-00772.txt.
Introduction
Branko Brkljač and Milan Brkljač survey the engineering of finding and re-identifying people across cameras in the open world, in a 2025 paper. Re-identification asks whether the person in one feed is the same individual seen elsewhere earlier. Retailers want it for marketing analytics; cities, for public space management. The open world refuses laboratory tidiness.
Lighting shifts, crowds overlap, and cameras disagree, and before matching can start, the system must detect and localize each person in messy frames. Multi-camera, multi-person setups multiply the difficulty and demand serious tracking. The paper reviews design architectures and computer vision options, then probes one near-real-time system's sensitivity across environments. Its value is practical: a map of what breaks outside the lab and what builders do about it.
Catalog record
| CREATOR | Branko Brkljač, Milan Brkljač |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-00772
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Person detection and re-identification in open-world settings of retail stores and public spaces Thanks: Identify applicable funding agency here. If none, delete this. Branko Brkljač, Milan Brkljač Abstract Practical applications of computer vision in smart cities usually assume system integration and operation in challenging open-world environments. In the case of person re-identification task the main goal is to retrieve information whether the specific person has appeared in another place at a different time instance of the same video, or over multiple camera feeds. This typically assumes collecting raw data from video surveillance cameras in different places and under varying illumination conditions. In the considered open-world setting it also requires detection and localization of the person inside the analyzed video frame before the main re-identification step. With multi-person and multi-camera setups the system complexity becomes higher, requiring sophisticated tracking solutions and re-identification models. In this work we will discuss existing challenges in system design architectures, consider possible solutions based on different computer vision techniques, and describe applications of such systems in retail stores and public spaces for improved marketing analytics. In order to analyse sensitivity of person re-identification task under different open-world environments, a performance of one close to real-time solution will be demonstrated over several video captures and live camera feeds. Finally, based on conducted experiments we will indicate further research directions and possible system improvements. I Introduction Modern computer vision techniques are solving complex technical challenges posed by applications in open-world settings. This refers to scenarios in which the system must overcome uncontrolled and difficult to predict characteristics of the operating environment. This is also the case with person detection [ 1 ] and person re-identification [ 2 ] tasks, which have traditionally been researched in the context of autonomous vehicles [ 3 ] , robotics [ 4 ] , human-machine interfaces [ 5 ] , crowd analysis [ 6 ] , and most commonly security applications [ 7 ] . The concept of smart cities [ 8 ] and the integration of such vision systems [ 9 , 10 , 11 ] into complex decision-making frameworks [ 12 , 13 , 14 ] have introduced the need for efficient and robust solutions, with the ability to make necessary trade-offs between operational costs and system performance on a case-by-case basis. The common goal is providing necessary insights into persons’ behaviour based on the ability to detect and possibly re-identify the same person at different points in time and space [ 15 ] . Such applications also raise the questions of ethical and privacy nature, which is a significant line of current research [ 16 , 17 ] . Nevertheless, integration of behaviour analysis systems in retail stores and public spaces is gaining momentum [ 18 ] and is expected to have significant impact on insightful business operations and space management. Approaching potential customers based on research analysis of their behaviour can be considered a key ingredient for designing successful marketing strategies and campaigns. It is also manifestation of the general trend of tailored campaigns and data-driven decisions emerging across different modalities of interaction with retail shoppers and public space users. In other words, persons’ movement patterns and time spent in different parts of a store or elsewhere directly answer the questions: ”How do consumers shop?”, or ”How people engage in public space?”. Data driven insights into these questions are foundations for comprehensive understanding of their behaviour. Thus, behavioural constructs in different conceptual frameworks, like e.g. emotional regulation consumption or compensatory consumption [ 19 ] , can be better related with the motivational and emotional aspects of the shopping process and public infrastructure engagement. It is also the kind of data that cannot be obtained from point-of-sale [ 20 ] or simple visitor statistics [ 21 ] . Therefore, spatial analysis of human behavior can be considered one of the complementary technologies for achieving optimal decisions and reducing the cost of adapting to individual needs of customers or users. In this paper, we provide a brief overview of methods and approaches for addressing design challenges for person detection and person re-identification in open-world environments and describe their use in retail sector and public spaces. We also present a demonstration of one cost efficient, close to real-time solution based on OAK-D lite [ 22 ] embedded vision platform [ 23 ] and discuss advantages and limitations of such hardware implementation and baseline algorithmic approach. The rest of the paper is organized as follows. In Section II we break down the landscape of existing methods for person detection and person re-identification tasks and provide a structured overview of research directions that have been established by pursuing different solution architectures under the assumptions of specific imaging modalities, identification scenarios, robustness requirements and model learning strategies. In Section III we go into implementation details of developed low-cost solution and indicate advantages and limitations of the adopted fast prototyping system design approach. Section IV presents conducted experiments and discusses their implications for possible applications in retail marketing analytics and public space management. Finally, in Section V we indicate directions for future research and possible system improvements. Code implementation is available at: https://github.com/brkljac/personReID . II Related work Person detection [ 1 , 10 , 11 ] , alongside face detection [ 24 , 25 ] , is probably one of the most studied object detection tasks in the literature [ 26 ] . Similarly, person re-identification (ReID) [ 2 ] , alongside face recognition [ 27 ] , is one of the long-standing recognition problems in vision [ 28 , 29 ] . Its goal is to retrieve information whether the specific person has already appeared in video or over multiple camera feeds in the past. In such case, re-identification is considered as successful if we can correctly assign person’s identity with some of the identities already present in the gallery, or create a new identity entry in the case of novel person in the scene. Described working scenario corresponds to the open-set ReID task, which is different from the closed-set setting in which it is assumed that the query object already exists in the gallery. These two problems, detection and re-identification, can be approached either traditionally, i.e. separately [ 30 , 31 ] , in a sequential manner, or jointly, i.e. in an end-to-end manner [ 32 , 33 ] , which is a characteristic of more recent ReID approaches. In the following we provide a brief overview of methods utilized in these two specific tasks of interest. II-A Detection task In general, besides the problem of defining object categories [ 34 ] , object detection approaches solve two fundamental problems in vision: localization and classification of object instances inside the scene. Consequently, binary classification of persons in the image can be formulated as a two stage: localization and detection problem, or as a single stage, i.e. one step regression task [ 26 ] . As there are numerous approaches for person detection, their applicability depends on the cost-performance trade-off put in front of system designer. The role of the detector in the broader context of the system in which it operates is also important. In this sense, the choice of an adequate working point