A sensor-fused BIM-based ıntelligent control system for energy-efficient ındoor environmental regulation using deep actor-critic reinforcement learning (DACRL) Authors: Libin Tong Published: 2025 ABSTRACT AbstractThe rising energy demand of the building sector, coupled with the need for high indoor environmental quality (IEQ), necessitates intelligent control strategies. However, traditional methods like rule-based control (RBC) lack adaptability, while model predictive control (MPC) suffers from model dependency. Hence, this study designed and implemented an intelligent indoor environmental control system based on multi-sensor fusion and Building Information Modeling (BIM). At the algorithmic level, this study employed a deep fusion actor-critic reinforcement learning (DACRL) algorithm to achieve energy-efficient dynamic environmental control. The system employs a four-layer architecture with cloud-edge-end collaboration. Layer 1: The perception layer utilizes a multi-modal sensor network built on an STM32L0 low-power micro-controller and an SX1276 LoRa communication module. This architecture enables distributed collection and pre-processing of parameters such as temperature, humidity, CO2, light, and occupancy. Layer 2: The fusion layer proposes a spatio-temporal synchronization mechanism for multi-source asynchronous data based on sliding window dynamic weighting and an extended Kalman filter (EKF). As an optimization, an isolation forest and one-class support vector machine (SVM) are combined to construct a multi-layer anomaly detection process. Layer 3: The decision layer establishes a deep reinforcement learning control model based on the topology of BIM semantic mapping. The key novelty of this model lies in its innovative embedding of the Lieb–Thirring (L–T) inequality, which describes the energy concentration characteristics of spatial fields, as a spectral constraint into both the reward function and the online action projection process of the Actor-Critic algorithm. This model innovatively embeds the Lieb–Thirring (L–T) inequality, which describes the energy concentration characteristics of spatial fields, as a spectral constraint into the reward function and online action projection process of the Actor-Critic algorithm. Layer 4: The execution layer implements real-time closed-loop control of terminal equipment such as HVAC, lighting, and shading through the standard BMS protocol. This study designed large-scale simulation experiments covering six core scenarios: offices, classrooms, residences, hospitals, shopping malls, and data centers. The experimental results demonstrate that the system’s annual energy consumption per unit area decreases by up to 63.2% compared to traditional rule-based control (RBC) strategies and by 23.5% compared to model predictive control (MPC) strategies. At the same time, several indoor comfort metrics improved significantly, with CO2 concentrations falling below 800 ppm 91.5% of the time and the thermal comfort (PMV) index remaining within ± 0.3 94.2% of the time. The proposed DACRL algorithm demonstrates excellent convergence and generalization capabilities. It achieves stable convergence numerically with an average of only 15,000 training steps. Performance loss in cross-building type transfer testing is only 4.9%.Keywords: Building ınformation modeling (BIM), Sensor fusion, Indoor environmental regulation, Energy efficiency, Deep actor-critic reinforcement learning (DACRL)Subject terms: Engineering, Mathematics and computing Introduction Energy consumption in the building sector is on the rise due to the acceleration of global urbanization and the growing demand for indoor environmental quality (IEQ) in contemporary buildings. This is now one of the main causes of carbon emissions and energy consumption worldwide1,2. The creation of clever and advanced building energy management techniques is essential in this situation. These tactics need to reduce energy use while maintaining the productivity, comfort, and well-being of the occupants. This is a major challenge and core research topic currently facing the intersection of building operations management, energy engineering, and artificial intelligence3,4. Figure 1 summarizes the six indoor environmental regulating principles with equal weight. The 6 principles of indoor environmental regulation. Traditional indoor environmental control systems mostly use methods based on fixed rules or classical PID control. Although these methods are simple and reliable, they are difficult to cope with the complex characteristics of the building environment, such as multi-variable, strong coupling, large inertia, time-varying and uncertainty5. Model predictive control has solved some of the above problems to a certain extent through the feed-forward optimization, but its performance is heavily dependent on accurate physical models6. In recent years, data-driven deep reinforcement learning (DRL) technology has opened up new avenues for the intelligent control of complex systems7,8. Existing studies have initially demonstrated the feasibility of DRL in building energy-saving control, such as its application in heating, ventilation and air conditioning (HVAC) system optimization9,54. However, the direct application of the DRL to actual building environment regulation still faces several key bottlenecks. Bottleneck 1. Accurate state perception and system-level stability. The decision quality of DRL agents is highly dependent on accurate perception of the environment state. Single sensor data lacks a robust fusion framework that is deeply integrated with the control system. Bottleneck 2. Safety and overall feasibility of control strategies. The DRL agent may violate the physical constraints of the device during the exploration process. Therefore, prior knowledge and physical constraints must be embedded in the learning and execution process. Bottleneck 3. Spatial field coordination and the global energy efficiency optimization. Existing research lacks modeling and constraints on the overall “energy” distribution and uniformity of indoor environmental spatial fields. To systematically address these challenges and practical problems, this study proposes and constructs an intelligent control system based on sensor fusion and BIM, using the deep actor-critic reinforcement learning (DACRL). The main contributions of this paper are as follows: This study proposes an end-to-end, multi-layer intelligent control system architecture. This architecture is clearly divided into a perception layer, a fusion layer, a learning and decision layer, and a control execution layer. The study also details the functional modules, hardware selection, data flow, decision flow, and feedback flow paths for each layer. This innovative design provides a complete solution for large-scale engineering deployment of the system. This study proposes an end-to-end, multi-layer intelligent control system architecture. This architecture is clearly divided into a perception layer, a fusion layer, a learning and decision layer, and a control execution layer. The study also details the functional modules, hardware selection, data flow, decision flow, and feedback flow paths for each layer. This innovative design provides a complete solution for large-scale engineering deployment of the system. This study designs a novel mechanism for the coordinated deployment, synchronization, and anomaly detection of multi-modal sensor data. This mechanism comprehensively optimizes coverage, redundancy, and energy consumption through a comprehensive optimization model. This model ensures the reliability of the sensing network55. It also combines sliding windows, timestamp alignment, and the extended Kalman filter (EKF) algorithm to achieve high-precision spatio-temporal synchronization of asynchronous multi-source data. As an algorithm optimization, a multi-layered anomaly detection and data repair process is constructed by combining an isolation forest and a one-class support vector machine. This study designs a novel mechanism for the coordinated deployment, synchronization, and anomaly detection of multi-modal sensor data. This mechanism comprehensively optimizes coverage, redundancy, and energy consumption through a comprehensive optimization model. This model ensures the reliability of the sensing network55. It also combines sliding windows, timestamp alignment, and the extended Kalman filter (EKF) algorithm to achieve high-precision spatio-temporal synchronization of asynchronous multi-source data. As an algorithm optimization, a multi-layered anomaly detection and data repair process is constructed by combining an isolation forest and a one-class support vector machine. This research develops a semantic-geometric mapping and data interaction interface for deep integration with BIM. This interface is constructed through a three-layer nested system based on the IFC standard, consisting of a structural modeling layer, a semantic mapping layer, and an external simulation interface layer. This structure bidirectionally binds physical sensors and actuators to spatial and equipment entities in the BIM model. It also provides a foundation for the co-simulation with energy simulation platforms such as Energy-Plus. This research develops a semantic-geometric mapping and data interaction interface for deep integration with BIM. This interface is constructed through a three-layer nested system based on the IFC standard, consisting of a structural modeling layer, a semantic mapping layer, and an external simulation interface layer. This structure bidirectionally binds physical sensors and actuators to spatial and equipment entities in the BIM model. It also provides a foundation for the co-simulation with energy simulation platforms such as Energy-Plus. This study develops a deep actor-critic (DACRL) control model embedded with Lieb-Thirring (L–T) spectral constraints. This model innovatively incorporates the L–T inequality, which characterizes the concentration of “energy” in a spatial field, as a spectral constraint into the reinforcement learning reward function and the online action projection process. This study develops a deep actor-critic (DACRL) control model embedded with Lieb-Thirring (L–T) spectral constraints. This model innovatively incorporates the L–T inequality, which characterizes the concentration of “energy” in a spatial field, as a spectral constraint into the reinforcement learning reward function and the online action projection process. The proposed approach is effective because robust perception and sophisticated decision-making work together. The primary benefit of the proposed multi-sensor fusion framework is its ability to produce a reliable, comprehensive, and spatially aware state representation. Unlike studies that rely on one or a small amount of sensor data, the proposed method reduces the possibility of inaccurate readings and captures the intricate, interconnected nature of the interior environment. This high-fidelity state estimation not only enhances the quality of the data but is also a prerequisite for any subsequent data-driven controller, such as our DACRL agent. This allows for wise and efficient choices, which contribute directly to long-term energy savings and comfort maintenance. This study’s following sections are arranged as follows. In section "Literature review", relevant research is reviewed with summary of the state-of-the-art studies. In section "The system architecture design", the system architecture and module design are described. In section "The deep actor-critic control model design", the deep actor-critic control model’s core algorithms are discussed. In section "Experimental platform and simulation environment", the experimental platform and simulation environment setup are described. In section "Experimental results and discussion", the experimental results are presented and the detailed discussion is given; and in section "Conclusion and prospect", the paper is concluded and future research directions are examined. Literature review Intelligent control of the indoor environment sits at the intersection of multiple research domains. To thoroughly contextualize our work, this review first examines the broad landscape of energy optimization methods, then considers the integration of Building Information Modeling (BIM) with sensor data, and finally focuses on the cutting-edge applications of Deep Reinforcement Learning (DRL) in built environments. Energy consumption optimization methods for indoor environment control As global energy demand and environmental pressures continue to increase, traditional research on energy management is facing challenges. Intelligent energy management and optimization has become an important research direction in the intelligentization of buildings, agriculture, and cities. Ullah et al.10 proposed a new framework for intelligent greenhouse climate optimization based on IoT. This framework achieves intelligent balance management of greenhouse energy consumption by real-time regulation of the environmental parameters such as temperature, humidity and light. In the experiment, the model maintained the optimal environment for crop growth to a great extent. At the same time, it numerically reduced energy consumption and production costs by approximately 26.5% and 27.8% respectively. Similarly, Benyezza et al.22 used IoT and fuzzy control technology to design a zoned irrigation system. This system achieves dual savings in water resources and energy. In the core areas of architecture and urban environment, comprehensive research on optimizing building energy consumption, thermal comfort and lighting performance has also received core attention. Lakhdari et al.11 conducted joint modeling through parametric optimization and multi-objective evolutionary algorithm. The model constructed a balanced framework of lighting, thermal comfort and energy efficiency for middle school classrooms in arid and hot areas. Wu and Zhang14 further proposed a multi-objective building envelope optimization framework. The framework combines useful daylight illuminance (UDI), energy use intensity (EUI) and thermal discomfort time (TDP). The study was conducted in a hot summer and cold winter climate zone. The results showed that by optimizing the opening area of south-facing windows and shading design, energy efficiency can be improved by 18–48.4% and daylight illuminance and thermal comfort performance can be well improved. At the same time, building energy consumption optimization methods based on control theory and artificial intelligence have been deeply studied. Chen and Li15 optimized the radiant ceiling cooling system through model predictive control. This optimization idea achieves accurate tracking of regional air temperature. Arroyo et al.23 proposed an MPC algorithm combined with reinforcement learning. The algorithm integrates state estimation, dynamic optimization and learning capabilities. This organic fusion enables the building energy system to continuously adaptively optimize in an uncertain environment. Lissa et al.16 optimized the home energy management system based on deep reinforcement learning. The system realizes adaptive scheduling and load forecasting of the photovoltaic (PV) energy. This model can reduce summer energy consumption by an average of 8% without affecting user comfort, and up to 16%. In terms of urban smart infrastructure, energy optimization research combining IoT and AI has also collided with event scenarios. Chen et al.12 built an intelligent streetlight system. The system collects traffic flow and personnel information through sensors. This framework combines dynamic PWM dimming and renewable energy management to achieve efficient energy saving and carbon emission reduction. Selvaraj et al.13 proposed an AI-based intelligent building energy management and monitoring system (AIMS-SB). The system can predict and optimize building energy consumption, renewable energy output and recovery to maximize energy efficiency and two-dimensional comprehensive utilization of energy. Rehman et al.17 focused on the integration of renewable energy in smart grids. The study proposed a hybrid heuristic algorithm (HGPDO) combined with load scheduling and energy storage management. This system achieved electricity cost reduction, peak-valley ratio optimization and carbon emission reduction. Wang et al.18 proposed an intelligent ventilation strategy based on occupancy density detection for high-density crowd environments. This strategy achieved energy savings of approximately 11.7% while reducing the risk of the infection. In addition, energy prediction model is also a key link in intelligent energy management. Hora et al.19 used LSTM combined with butterfly optimization algorithm to predict electricity consumption. This prediction model can effectively capture time series characteristics. In the field of agricultural smart greenhouses, Liu et al.21 proposed a greenhouse climate prediction model based on LSTM to perform global optimization through short-term sliding windows and abnormal data processing strategies. The optimization results achieved high-precision predictions of temperature, humidity, light, carbon dioxide concentration and soil environment. Lin et al.20 further proposed a double-layer curtain wall (DSF) system with natural ventilation for building facade renovation. This model is of great significance in the context of energy conservation and low-carbon transformation of traditional buildings. The core goal of this study is to improve the energy efficiency of buildings in summer by optimizing the double-layer curtain wall structure and the design of adjustable glass blinds. More essentially, some IoT based methodologies are also efficient51–53. BIM and sensor fusion: the State-of-the-art The integrated framework of Building Information Modeling (BIM), Internet of Things (IoT), sensor technology and Digital Twin (DT) has gradually become an important tool to promote the full life cycle management of buildings. In the field of low-carbon and green building research, Zhang and Ying24 pointed out that the integration of geographic information systems (GIS) and BIM can effectively improve the command and management of rail transit projects. The study used BIM technology to quickly calculate life cycle carbon emissions and optimize them in the design stage. This innovation provides an efficient path for building low-carbon cities. This verifies that BIM is no longer limited to geometric modeling but is gradually becoming an important supporting platform for energy analysis and environmental assessment. In the facility operation and maintenance link, the integration of BIM and sensor data is a research trend. Valinejadshoubi et al.25 proposed a BIM-based sensor fault management framework. The framework uses a cloud platform to achieve efficient communication between facility managers and the IoT companies. Such a communication paradigm can respond quickly when a sensor fails. Similarly, Zavaleta28 further studied the combination of the BIM and structural health monitoring (SHM). The study demonstrated how sensor data-driven structural assessment can improve the safety of buildings. At the same time, the study pointed out that data standardization and system interoperability are still challenges that need to be solved. With the introduction of the concept of digital twins, the integration of BIM and IoT is leading to the vigorous development of building virtualization. Eneyew et al.26 proposed a multi-level BIM-IoT data integration architecture. This architecture can solve the problem of insufficient semantic interoperability. This innovation enables building digital twins to have the ability to predict, evaluate and actively intervene. Wang et al.30 used deep learning and BIM big data to carry out environmental satisfaction evaluation. The study further proposed an improved data fusion algorithm. This provides experimental verification for the application of digital twins in energy-saving buildings. The research of Yang et al.27 went a step further. The model combines BIM with synthetic aperture radar (SAR) observations. This fusion analysis realizes 4D digital twins for urban motion monitoring. In terms of risk management in complex environments, Xun et al.29 introduced the intuitionistic fuzzy set (IFS) and D–S evidence theory paradigm. This study proposed a multi-information fusion method based on BIM and set the application scenario as the safety risk assessment of undersea tunnel construction. This method can achieve dynamic risk perception under uncertainty and fuzziness. This study highlights the decision-making support value of BIM in high-risk infrastructure projects. At the same time, Zhou and Yang33 combined BIM with multi-source heterogeneous sensors. This study designed a new construction site safety management system. The system uses comprehensive information in spatial and temporal dimensions to achieve real-time perception and intelligent decision-making. The application of BIM has also been extended to the fields of cultural heritage protection and complex geometric modeling. Miky et al.32 proposed a deep learning-driven HBIM workflow for historical buildings. This workflow improves the recognition accuracy of the surface weathering morphology and facade deterioration by combining drone images and laser scanning data. Rached et al.31 used RGB-D sensors combined with deep learning methods. This study obtained automatic BIM model generation for the indoor environments and significantly improved modeling efficiency. This type of research has led to the development of low-cost BIM generation technologies. Applications of deep reinforcement learning in built environments The core advantage of deep reinforcement learning is that it can continuously learn and optimize decision-making strategies through interaction with complex environments. In the field of rescue robots, Niroui’s34 research first proposed combining deep reinforcement learning with cutting-edge exploration methods. This framework is used for autonomous exploration of unknown and crowded environments in urban search and rescue. Test results show that this method can not only quickly expand the exploration range but also maintain stable performance under different environmental layouts. In terms of the building energy management, Jia35 proposed an end-to-end deep reinforcement learning control framework. This framework directly learns the optimal balance between building energy saving and occupant comfort through interactive data. The study also introduced expert experience replay, policy smoothing constraints and a virtual test platform. Test results show that this framework is effective in systematically evaluating the performance of different algorithms. In response to the complexity of building energy systems caused by the integration of renewable energy, Shen36 proposed a multi-agent deep reinforcement learning optimization paradigm. This paradigm achieves collaborative control of multiple devices through a dual deep Q network and a value decomposition mechanism. At the same time, it combines priority experience replay and feasible action screening mechanisms as an efficiency optimization. Experimental results show that this method significantly reduces the duration of user discomfort and the waste of renewable energy. In response to the high energy consumption problem of heating, ventilation and air conditioning (HVAC), Gao37 modeled building thermal comfort control as a joint optimization problem of energy consumption and comfort. The study used a deep neural network to predict the thermal comfort level of residents and combined it with a deep deterministic policy gradient (DDPG) learning control strategy. In addition, Brandi38 explored optimizing indoor temperature control and heating energy consumption by adjusting the water supply temperature set point. The study verified the adaptability of deep reinforcement learning in both static and dynamic environments. This suggests that future research needs to further optimize the coupling of input feature selection and control strategy. In the study of demand response (DR), Jang39 proposed a deep reinforcement learning method that combines planning models with safety mechanisms. This model can cope with the complex interaction between price signals and user behavior. By introducing a “guardrail” mechanism, this study effectively reduced the high cost risk in the initial learning stage. Furthermore, Lei40 proposed a novel control framework based on the Branching Dueling Q-Network (BDQN) for multidimensional control problems. The method was pre-trained in a virtual environment and then deployed in a real office setting. It reduced energy consumption while improving overall comfort. Finally, Valladares41 modeled indoor air quality (IAQ) and thermal comfort. The study proposed a novel deep reinforcement learning algorithm that can optimize energy consumption, comfort, and air quality simultaneously. The algorithm was verified through large-scale simulation and real-world scenarios and found that this method can achieve energy reduction while maintaining a suitable thermal comfort index and controlling CO2 concentration. The system architecture design Overall system structure Layer module structure (perception layer → fusion layer → learning decision layer → control execution layer) The overall framework of this model is constructed using a hierarchical structure with the modules of perception layer, fusion layer, learning decision layer, control execution layer, respectively. Perception layer (sensor node) The sensor acquisition nodes in the perception layer preferably use STM32L0 series micro-controllers (Fig. 2 shows the details and common application scenarios of this micro-controller). In this system, this micro-controller features a 32-bit core, 32 MHz, and approximately 51 I/Os. It also supports the I2C/SPI/UART/USB, has a low-power stop mode, and includes flash memory. This hardware was chosen for its low power consumption, sufficient ADC accuracy, and cost advantages. These advantages make it suitable for large-scale deployment. The SX1276 LoRa wireless module is used as the companion wireless module for the acquisition nodes. Specific parameters for this module include a maximum link budget of 168 dB, a sensitivity of − 148 dBm, and a maximum data rate of approximately 300 kbps. The STM32 ecosystem, solutions and communities (Source: https://www.st.com/en/microcontrollers-microprocessors/stm32l0-series.html). At the same time, local pre-processing and sampling operations are used. The specific steps are shown in Table 1. Table 1Node-side local processing and sampling mechanism.Hierarchical modulesSpecific functionsMethod or AlgorithmData preprocessing layer-1De-noisingLow-pass filteringData preprocessing layer-2Baseline calibrationTable correctionIntelligent perception layerEvent detectionState mutation determinationTiming identification layerTimestamp managementReal-time clock (RTC)Sampling and reporting layer-1Normal samplingLow-speed periodic sampling of temperature, humidity, CO2, etcSampling and reporting layer-2Abnormal reportingHigh-frequency sampling and real-time reporting Node-side local processing and sampling mechanism. The power consumption and sleep strategy utilizes the low power mode of STM32L0 and the wake-up mechanism of the SX127642,43 to achieve long battery life. The core idea of this power consumption optimization is to wake up only when sampling or reporting. Fusion layer The fusion layer first performs node aggregation. Each cell/floor is deployed with an aggregation node, implemented using the STM32F103ZET6 + SX1276. The aggregation node is responsible for receiving LoRa reports, de-duplication, time-division multiplexing (TDM), local caching, and forwarding. Multiple sensor nodes are connected to a single aggregation node; time division multiplexing (TDM) is used in conjunction with SF/channel multiplexing to reduce conflicts. The aggregation node maintains a time slot table and periodically allocates slots. The aggregation node or edge gateway maps physical sensor IDs to spatial semantics in the BIM and constructs a unified spatio-temporal semantic table. Learning decision-making layer The features output by the fusion layer are organized into a state vector at the edge. This parameter includes environmental variables (temperature, humidity, CO2, illumination, occupancy), device power consumption, external weather conditions, and BIM features for the current and historical windows. The decision layer uses the deep actor-critic model. The input first passes through a causal LSTM/convolutional time window to extract temporal features before entering the actor (continuous action output) and critic (value estimation) heads. The decision output is then processed through a feasible domain projection and safety filter. Control execution layer This layer’s modules first issue commands using the multiple protocols, with actions translated into BMS/device protocols based on the device type. Building integrated devices such as air conditioners, fans, valves, sunshades, and lighting can be connected via the JACE-8000 network controller and the IO-28U intelligent IO module. Control commands consider a three-step process: "send → confirm → execute and monitor." Command logs are stored at the aggregation node or gateway. Detailed description of data flow, decision flow, and feedback flow paths The data flow path The data flow path includes the following core modules. Nodes. Sensor sampling → local filtering/compression → packaging and encryption for reporting frames. Nodes. Sensor sampling → local filtering/compression → packaging and encryption for reporting frames. LoRa. The SX1276’s high link budget enables long-range coverage (characterized by: maximum link budget 168 dB, sensitivity − 148 dBm) LoRa. The SX1276’s high link budget enables long-range coverage (characterized by: maximum link budget 168 dB, sensitivity − 148 dBm) Aggregation pre-processing. Packet de-duplication, time stamp correction, packet loss detection, and preliminary anomaly screening operations. Aggregation pre-processing. Packet de-duplication, time stamp correction, packet loss detection, and preliminary anomaly screening operations. Gateway uplink. The aggregation node sends data to the edge service via Ethernet/Wi-Fi/4G, maps the original observations to BIM semantics and stores them in the time series database. Gateway uplink. The aggregation node sends data to the edge service via Ethernet/Wi-Fi/4G, maps the original observations to BIM semantics and stores them in the time series database. Cloud archiving and training data pool. Edge data is periodically aggregated and synchronized to the cloud data lake. Cloud archiving and training data pool. Edge data is periodically aggregated and synchronized to the cloud data lake. The data format sample is shown in Fig. 3. The data format example. Figure 4 demonstrates a graphic representation of the data flow path. The data flow path visualization. The decision flow path The decision flow path includes the following core modules. State estimation. The edge fuses short-window history w (e.g., the last 10–30 min) and combines it with BIM boundary conditions to obtain a low-dimensional state. State estimation. The edge fuses short-window history w (e.g., the last 10–30 min) and combines it with BIM boundary conditions to obtain a low-dimensional state. Policy inference. Actor inputs and outputs continuous actions (set temperature, air volume, shading angle, light brightness, etc. for each control zone). Policy inference. Actor inputs and outputs continuous actions (set temperature, air volume, shading angle, light brightness, etc. for each control zone). Safety check. The action is corrected to using the rule engine (device upper and lower limits, minimum shift interval and the energy budget) and the projection function. Safety check. The action is corrected to using the rule engine (device upper and lower limits, minimum shift interval and the energy budget) and the projection function. Command issuance. Depending on the device protocol, the edge creates and transmits particular instructions (such as BAC-net commands, digital IO, or Mod-bus register accesses) to the execution layer. Command issuance. Depending on the device protocol, the edge creates and transmits particular instructions (such as BAC-net commands, digital IO, or Mod-bus register accesses) to the execution layer. Execution confirmation. Success is noted in the execution log and an ACK or status is returned by the execution layer. If not, a retry or fallback is triggered. Execution confirmation. Success is noted in the execution log and an ACK or status is returned by the execution layer. If not, a retry or fallback is triggered. The feedback flow path The feedback flow path includes the following core modules. Short-term closed-loop. Sensor feedback within 1–5 s to several minutes after execution is used to evaluate short-term effects (comfort and device response). This module enables rapid adaptive adjustments at the edge. Short-term closed-loop. Sensor feedback within 1–5 s to several minutes after execution is used to evaluate short-term effects (comfort and device response). This module enables rapid adaptive adjustments at the edge. Experience storage. The edge writes the transition tuple (including the execution success flag) to the local experience pool. This data is also periodically uploaded to the cloud experience pool for offline retraining. Experience storage. The edge writes the transition tuple (including the execution success flag) to the local experience pool. This data is also periodically uploaded to the cloud experience pool for offline retraining. Model evaluation and triggering. If the edge detects a degradation in policy performance (energy consumption not decreasing or comfort violations exceeding a threshold), a model rollback is triggered or a new pre-trained model is requested from the cloud. Model evaluation and triggering. If the edge detects a degradation in policy performance (energy consumption not decreasing or comfort violations exceeding a threshold), a model rollback is triggered or a new pre-trained model is requested from the cloud. Operations and alerting. Sensor/node health data (battery, RSSI, packet loss rate) is aggregated for use in the operations dashboard. Operations and alerting. Sensor/node health data (battery, RSSI, packet loss rate) is aggregated for use in the operations dashboard. System deployment architecture The deployment level description This system’s deployment hierarchy adopts a layered design paradigm: "cloud-edge-field-network-end devices." This paradigm ensures reliable intelligent control in the large-scale building environments. The cloud layer carries out the primary computational and administrative tasks. This layer uses BIM-powered physical simulation models to model and test large-scale virtual environments. The framework uses GPU clusters to train deep actor-critic reinforcement learning offline. Additionally, the framework incorporates data lake storage to facilitate knowledge mining, batch analysis, and centralized long-term data archiving. The edge layer is deployed on edge gateways within each building or floor and is primarily responsible for real-time inference and execution of control decisions. This process includes state estimation, policy inference, action safety filtering, and command issuance, and completes closed-loop control at the execution layer through an interface with the building management system (BMS). In addition to the previous module, the edge nodes store recent experience data. This enables independent operation in the event of failures and facilitating the fine-tuning of local policies. The field network layer uses the aggregation nodes and BMS controllers to convert protocols and link sensors and actuators. Sensor nodes frequently use SX1276 LoRa modules and STM32L0 micro-controllers. These modules offer wireless communication capabilities with low power consumption and excellent coverage. This capability allows for the steady collection of important environmental data, such as the room temperature, humidity, CO2 concentration, light intensity, and occupancy rate. Actuators connect to fans, air conditioners, lights, sunshades, and other devices via I/O modules and pre-existing BMS interfaces. The ASCII deployment diagram In the Fig. 5, the ASCII deployment diagram is demonstrated. The ASCII deployment diagram. Design of perception and fusion modules In the intelligent building indoor environment control system scenario, the task is heavy. The perception accuracy and data reliability of the multi-modal sensors directly affect energy consumption optimization and overall model control. Therefore, in order to achieve efficient and robust environmental state modeling, this chapter proposes a multi-level perception and fusion module. This module is comprehensively designed by combining sensor deployment strategy, time series multi-modal data synchronization and anomaly detection mechanism. Multiple sensor deployment strategies Considering the multi-dimensional monitoring needs of indoor environments in smart buildings, this model analyzes multiple types of multi-modal variables, including temperature, humidity, carbon dioxide, volatile organic compounds, light intensity, and PM2.5. A multi-sensor collaborative deployment model is also constructed. Suppose that the indoor space is divided into M functional areas, such as office, meeting, and the rest areas. The set of sensors deployed in each area is . Each sensor sample value is , where represents the variable type, j represents the j-th sensor, and t represents time. Define the spatial coverage index of each area as: Here is the area of region m, and is the area that sensor can effectively perceive. To ensure coverage, the following constraints must be met: where is the minimum coverage ratio of each type of sensor. To improve measurement reliability, at least independent sensors are deployed in each area for each type of variable. At the same time, the distance between sensors should be ensured to satisfy: This operation can avoid the waste of resources caused by excessive overlap of sensing areas. Considering the dynamic changes of the space occupancy and activity intensity , an adaptive optimization model of the sampling frequency is defined as: where is the variable weight coefficient. The introduction of this parameter ensures that the sampling frequency is increased in high activity or high occupancy situations, while being subject to energy consumption constraints: is the sensor power consumption and is the upper limit of system energy consumption. Taking into account coverage, redundancy, adaptability and energy consumption, this model can construct an optimization objective function for regional sensor deployment, such as formula 6. Here are the optimization weights and is the ideal sampling frequency calculated based on occupancy and activity intensity. Time series multimodal data synchronization Multi-sensor data is subject to sampling rate differences, transmission delays, and intermittent packet loss. Therefore, in order to achieve precise timing synchronization and noise suppression, this study proposes a three-level fusion model: sliding window + timestamp alignment + extended Kalman filter (EKF)44,45. Let the window length W and each sensor generates a time series to mitigate instantaneous jitter. Define the window average as: The window variance is further introduced as the basis for dynamic weight as follows: After alignment, the unified sequence is defined as a weighted interpolation as: In order to ensure the smoothness of the sequence, inequality constraints are introduced as : where is the maximum instantaneous change threshold of variable type $i$. The important role of this threshold is to prevent abnormal mutations from interfering with subsequent processing. Apply EKF to the aligned sequence , and the state update equation is: The observation update equation is: where is the state transfer function, is the observation function, and is the adaptive gain matrix, which is designed as: At the same time, this item meets the following constraints: These constraints can ensure the stability and smoothness of the filter response. The prediction error covariance update formula is: Taking noise suppression and real-time performance into consideration, this model can adapt to complex scenarios with sensor loss, delay, and asynchronous sampling. Then the joint optimization model for sensor deployment and time series data synchronization is described as: Joint optimization model for sensor deployment and time series data synchronization Anomaly detection mechanism In real-world scenarios, sensors may produce abnormal values due to long-term drift, hardware failure, or local environmental interference. Therefore, directly using unprocessed data in most scenarios may lead to control strategy deviations. In order to ensure the system’s accurate perception of the indoor environment, this study designed a multi-level anomaly detection and data fusion mechanism. This model considers the isolation forest algorithm46,47, which divides the data layer by layer by constructing random partitioning trees. This operation can quickly isolate outliers in the tree due to their sparsity. In the Fig. 6, the isolation forest estimation with 2 dimension features is demonstrated. The isolation forest estimation with 2 dimensional features. Let that the single sensor time series is , then the anomaly score of each sample point is defined as: Here, represents the path length of the isolated sample, is the averaging operation, and c(W) is the normalization factor under the window length W. In addition to handling high-dimensional data, this optimization approach is able to detect unexpected anomalies. Because of this, the technique may be used to monitor continuous variables like temperature and humidity in real time. Isolation forests are primarily suitable for single-variable anomaly detection. However, the multi-modal sensor data selected in this scenario often has nonlinear correlations. To address this, this study introduces a One-Class SVM to establish normal data boundaries: Here, is a kernel mapping function that maps raw features into a high-dimensional feature space. w and are determined by the trained support vectors. At the judgment level, if f(x) < 0, it is considered an anomaly. This method can simultaneously detect the inter-sensor coordination anomalies, such as the simultaneous occurrence of temperature and humidity anomalies in smart building environments. After removing abnormal data, this study generates the final state vector through weighted fusion as follows: The weights are calculated dynamically, taking into account the following factors: Historical sensor accuracy and drift trends; Historical sensor accuracy and drift trends; Correlation with adjacent sensor data; Correlation with adjacent sensor data; Data stability indicators. Data stability indicators. BIM modeling and data interaction interface Framework of three-tier nested system BIM (Building Information Modeling) is a digital representation of a building’s physical and functional characteristics. It is also a core vehicle for multi-source data integration and dynamic interaction. In the smart construction sites and intelligent operation and maintenance scenarios, the BIM modeling and data interaction interfaces form a three-layered system. The specific system details are shown in Fig. 7. The BIM three-tier nested system. The structural modeling layer establishes a hierarchical model of building components and spatial topology based on the IFC (Industry Foundation Classes) standard. The semantic mapping layer semantically binds sensor data to BIM model spatial regions and the component attributes. This operation enables the bidirectional mapping between geometry and semantics. The external simulation interface layer utilizes open APIs and a data adaptation protocol. This protocol connects the BIM model with energy consumption simulation platforms such as Energy-Plus, ESP-r, and IES VE, as well as real-time monitoring platforms. Building structure extraction and IFC hierarchy construction In the BIM modeling stage, the building components must first be abstracted in layers, and a hierarchical system based on the IFC standard is constructed as shown in Table 2. Table 2Hierarchical system based on IFC standards.Layer informationDetailsIfcBuildingElementModules for basic structural units such as walls, beams, columns, and floor slabsIfcSpace/IfcZoneModules for topological representation of closed or semi-enclosed spacesIfcSystemModules for electromechanical equipment, pipeline systems, and sensor networksIfcPropertySetModules for the physical properties, functional properties, and operating parameters of components Hierarchical system based on IFC standards. Mathematically, the IFC hierarchical relationship can be formalized as the quadruple as: where E represents the component set, S represents the space set, Sys represents the system set, and P represents the property set. Topological relationships can be established through the adjacency matrix A as: Semantic-geometric mapping relationship construction It is challenging to directly allow the dynamic coupling of sensor data in traditional BIM models since they only describe geometry and structure. This model suggests the Semantic-Geometric Mapping Model (SGMM) as a solution. The SGMM’s main idea is to use attribute identification and three-dimensional coordinate restrictions to insert sensor nodes into the BIM model. The sensor node set is specifically described as follows: Each sensor node has a triplet attribute defined as follows Here represents the three-dimensional geometric coordinates, the represents the sensor type, and represents its acquisition parameters. The mapping function is defined as: That is, sensor nodes can be bound to a spatial set S or a component set E. At the same time, this mapping is written to IfcPropertySet through the property inheritance mechanism. This operation enables BIM-based representation of sensor data. This mapping model not only supports the flow of real-time sensor data into the BIM system, but also enables querying spatial status and sensor distribution from the BIM model. Interaction with simulation environment To achieve building energy efficiency assessment and climate boundary condition simulation, this model requires connecting the BIM model with energy consumption simulation tools (Energy-Plus/ESP-r/IES VE). This study constructs a BIM-Simulation Interface Model (BSIM). Specific details are shown in Table 3. Table 3Interaction with Simulation Environment.Layer informationDetailsData parsing layerThis layer, based on IFC-XML conversion, parses objects such as IfcSpace, IfcWall, and IfcWindow into parameters recognizable by the simulation softwareBoundary condition import layerThis module dynamically inputs climate boundary conditions into the simulation platform using meteorological databases, including TMY2 and EPW files, and real-time sensor data streamsBidirectional interaction layerThis layer enables bidirectional data flow between the BIM and the simulation platform. For example, energy consumption results from Energy-Plus can be written back to IfcPropertySets in the BIM model Interaction with Simulation Environment. The process is formalized as follows: where the represents the BIM → simulation data conversion, and represents the simulation result write-back process. The deep actor-critic control model design The goal of this section is to design a deep Actor–Critic controller for BIM-driven, multi-modal sensor fusion. The design goal is to keep energy consumption and spatial field spectral “energy” within the physical boundaries given by the BIM while satisfying comfort and air quality constraints. The key innovation of this model is the introduction of the Lieb–Thirring (L–T) spectral inequality48–50 as a spectral energy constraint into the control loop. Then, the model seamlessly embeds this constraint into the Actor–Critic learning and reasoning process through a hybrid strategy of scale projection and soft penalty. State Space S construction The fusion state vector at time t is defined as: where are all spatial field vectors processed by sensor fusion and discretized on the BIM topology ( with the dimension of n). is the occupancy probability or estimated number of people. is the energy consumption history over the past $w$-step window. is the time slice encoding. is the device state delay and hysteresis. For the convenience of subsequent spectrum analysis, system space field vector is defined, which combines temperature, CO2, illumination and the other information as: N is the total number of degrees of freedom after fusion determined by the BIM mesh/zoning. The short-term empirical covariance based on is defined as follows: Let be the eigenvalue of . To characterize the spectrum “energy”, the power spectrum is considered and define it as follows: This quantity measures the concentration of high-energy modes in the spatial field, which is also the core quantity for introducing L–T constraints. The action Space A definition The continuous action vector is defined as formula 31. The constraint interval is: where is the continuous variable for the ventilation mode. Its significance lies in approximating the discrete switches with the continuous probabilities, making the policy differentiable. The actions directly affect the dynamics of mechanical equipment and indoor heat flow, convection, and pollution diffusion, and then will influence the . To facilitate linking the control to the spectral energy constraint, it can be considered that the short-term dynamics can be approximately linearized as: where can be estimated through offline simulation (Energy-Plus) or online identification. Multi-objective design of reward function R The base multi-objective reward is defined as formula 36. The meanings of these terms are consistent with your example. can be adjusted with external parameters such as the electricity prices and peak/off-peak periods to reflect time sensitivity. To incorporate spectral constraints into learning, a two-layer mechanism is designed and implemented as follows. Layer 1. Soft constraint penalty term (during the training process). Integrating spectral excess penalty. where is the upper bound on the spectral energy given by the BIM/simulation. This upper bound can be adjusted over time and based on operational conditions. If the spectral quality exceeds the upper bound, a penalty is applied based on the excess. The coefficient is a regulatory factor. Layer 2. Online hard projection ( during the operational level). Before the policy is actually sent to the executor, a scale projection is applied to ensure that the predicted value of meets the upper bound (see the next section for details). This projection is used to ensure safety at runtime. The embedded control solution based on Lieb–Thirring inequality Continuous to discrete L–T constraint mapping The continuous form of the Lieb–Thirring inequality conceptually gives an upper bound on the spectral power sum and the energy norm as: On the discrete BIM grid, it is approximate the integral with the mass matrix . This gives the spectral constraint in discrete form as: Here, can be obtained by simulation scale, such as Energy-Plus or the historical data regression. Inequality formulation of linearized predictions and constraints Based on the linear approximation , the upper bound of the predicted spectrum is expressed as a quadratic inequality with respect to the action The approximation step that preserves the quadratic term is defined as follows: Then, define the constant term and coefficient as: Then the prediction constraint can be written as: From and L > 0, the model can get ,and the inequality formula 45 is a convex quadratic inequality. The scaling projection The model uses radial scaling projection to ensure that the runtime actions satisfy formula 45. The specific algorithm idea is: if the original action output by the policy violates formula 45, then find the minimum scaling factor in the direction of the original action so that the scaled action satisfies the constraint. It is then got the quadratic inequality as formula 46. Then, define the constant term and coefficient as formula 47. Then the condition as formula 50 is obtained. Solution strategy details: If , the action can be used directly; If , the action can be used directly; Otherwise, solve the quadratic equation . Let the discriminant . If , then there is no real root, which means that radial scaling cannot make the inequality true in [0,1]. Under this condition, the step should be back to . Otherwise, solve the quadratic equation . Let the discriminant . If , then there is no real root, which means that radial scaling cannot make the inequality true in [0,1]. Under this condition, the step should be back to . If , the two roots are (if A = 0, this degenerates to the linear solution ). Therefore, the model can select the solution that satisfies and is closest to 1, set the . Then, use as the final dispatch action. If , the two roots are (if A = 0, this degenerates to the linear solution ). Therefore, the model can select the solution that satisfies and is closest to 1, set the . Then, use as the final dispatch action. Proof: Since , follows. Therefore, if A > 0, the is an upwardly convex quadratic function, and g(0) = C. If , then there exists a solution on some interval containing the origin. If g(1) > 0, then there exists such that if and only if and at least one root lies in (0,1). Radial scaling reduces the weight of the quadratic term without changing the direction. This is a monotonic way to reduce (which is easier to satisfy on if B is favorable). This procedure avoids the computationally expensive direct solution of the full-dimensional projection of the inequality. The policy learning, loss function and training details The selection ideas Based on the continuous BIM actions and the high requirements for safety and stability, this study uses the Soft Actor-Critic (SAC) framework as the main framework and considers entropy regularization to improve exploration robustness. At the same time, the model combines the double Q (double critic) structure and experience replay + prioritized experience replay (PER) to improve the sample efficiency. The critic loss (double Q) Consider two sets of critic networks and corresponding target networks . Sample batches (s,a,r,s') from the experience pool. The target value is in the form of SAC with entropy, defined as follows: Here, , and if the scale projection is still used during the training phase, is first projected. Critic loss is defined as: The actor updates The Actor goal is to maximize SAC and can be defined as follows: To improve training stability and respect the geometry of the policy space, the proposed model considers using the natural gradient updates. This update process estimates the diagonal or low-rank approximation of the Fisher information matrix on a small batch and obtains the natural gradient direction. The experience replay, per and target network soft update and delay strategy The experience pool stores the quadruple , where is the actual action issued after projection. This model uses PER to prioritize samples based on the TD error . Specifically, during sampling, the probability is used. Importance sampling weights are used for correction during training as: Then gradually increase from a small value to 1 to reduce the deviation. Then, the soft update is used to ensure the stability of the target network as: The whole algorithm details are presented as below. Sensor-fused BIM-based deep Actor-Critic control The implementation details and hyper-parameters In the Table 4, the detailed hyper-parameter Configuration for the DACRL System is demonstrated. Table 4The Hyper-parameter configuration for the DACRL system.ParameterValueRandom seed42Training steps500,000Batch size256Discount factor (γ)0.99Target update (τ)0.005Actor network[256, 256]Critic network[256, 256]Activation functionReLUOutput activation (actor)TanhOptimizerAdamLearning rate (actor)3e−4Learning rate (critic)3e−4Initial temperature (α)1.0Temperature learning rate3e−4Target entropy-dim(A)Replay buffer size1e6PER α0.6PER β0.4 → 1.0PER ε1e−6Sliding window (W)10 (steps)EKF process noise (Q)diag(1e−3)EKF measurement noise (R)diag(1e−2)Isolation forest (n_estimators)100One-Class SVM (ν)0.05Anomaly Score Threshold0.6L–T constraint (Lγ,d)1.5Penalty coefficient (λ)10.0Rule engine bounds[a_min, a_max]Min. shift interval300s The Hyper-parameter configuration for the DACRL system. Experimental platform and simulation environment The multi-dimensional experimental scene settings In order to fully verify the performance of the algorithm, six typical building scenes were constructed. The specific parameters of each scene are shown in the Table 5. To ensure the reproducibility of our results, all the experiments were conducted with a fixed random seed (seed = 42). Table 5The 6 typical architectural scenes.Architectural typeScene detailsLarge open office space2000 m2, 3.6m ceiling height, 4 functional areas, accommodating 200 peopleMultimedia classrooms in the teaching building150 m2, 4.2m ceiling height, 2 functional areas, accommodating 60 peopleResidential apartments90 m2, 2.8m ceiling height, 3 functional areas, accommodating 3 peopleHospital ward area800 m2, 3.2m ceiling height, 6 wards, accommodating 40 peopleMall atrium area3000 m2, 5.4m ceiling height, dynamically changing traffic densityData center room500 m2, 3.0m ceiling height, high-heat-density equipment The 6 typical architectural scenes. Each building type uses different enclosure structure parameters as shown in Table 6, and the shading coefficient is shown in Fig. 8. Table 6The Building Envelope Structure Parameter Configuration.Architectural typeWall U-value [W/(m2·K)]Window-to-wall ratioGlass typeOpen office space0.450.45Double low-EMultim0.650.40Double NormaResidential apartments0.850.30Single + InsulationHospital ward area0.500.35Double low-EMall atrium area0.700.55Double laminatedData center room0.400.20Single reflective The Building Envelope Structure Parameter Configuration. The shading coefficient. The multi-modal sensor network deployed in each experimental scenario is shown in Fig. 9, and the following fault conditions are simulated: 30% random sensor deviation (including ± 1.5°C temperature and ± 8%RH humidity); 30% random sensor deviation (including ± 1.5°C temperature and ± 8%RH humidity); 15% intermittent sensor failure; 15% intermittent sensor failure; Communication latency (including 0.5–5 s random delay); Communication latency (including 0.5–5 s random delay); Packet loss rate (including 5%-20%). Packet loss rate (including 5%-20%). The Multi-modal sensor network deployed in experimental scenario. The high-precision BIM modeling and digital twin environment The multi-scale BIM model in the experiment uses Revit + Dynamo to build a LOD500 level BIM model. The model contains the following core parameters. Geometric model. This parameter contains component-level building geometry information. Geometric model. This parameter contains component-level building geometry information. Physical properties. This parameter includes material thermal properties, optical properties, and acoustic parameters. Physical properties. This parameter includes material thermal properties, optical properties, and acoustic parameters. Equipment information. This parameter includes HVAC system parameters, lighting characteristics, and control systems. Equipment information. This parameter includes HVAC system parameters, lighting characteristics, and control systems. Spatial topology. This parameter includes room adjacency and airflow distribution paths. Spatial topology. This parameter includes room adjacency and airflow distribution paths. The real-time collaborative simulation platform integration tools are shown in Table 7. Table 7The real-time collaborative simulation platform integration tools.ToolsFunctionEnergy-Plus 9.5Building energy simulation with a 1-min timescaleCONTAM 3.2Indoor air quality and ventilation simulationRadianceNatural light and illumination simulationMATLAB/System simulationTensorFlow 2.8Deep learning algorithm execution The real-time collaborative simulation platform integration tools. The multi-level comparison algorithm design In the Table 8, the benchmark algorithm groups are demonstrated. Table 8The benchmark algorithm groups.AlgorithmKey modulesTraditional Rules-Based Control (RBC)Model is based on ASHRAE 55–2020 comfort standards;Fixed temperature set-pointActivates fresh air when CO2 concentration exceeds 1000 ppmMulti-loop PID controlIndependent temperature, humidity, and CO2 control loops;Ziegler-Nichols + genetic algorithm optimization;Anti-saturation processing and integral separationModel Predictive Control (MPC)A 12-step, 60-min strategy is used for the forecast horizon;A 4-step, 20-min strategy is used for the control horizon;Offline identification and online update are used for the state-space model;IPOPT nonlinear optimization is used as the solverDeep Q Network (DQN)The network architecture uses a 5 × 256 fully connected infrastructure;ε-greedy (0.1 → 0.01);Priority samplingProximal Policy Optimization (PPO)Clip parameter ε = 0.2;Experience collected from four parallel environments;GAE λ = 0.95Soft Actor-Critic (SAC)Automatic entropy adjustment;Dual Q network + target network;Gaussian distribution The benchmark algorithm groups. Model is based on ASHRAE 55–2020 comfort standards; Fixed temperature set-point Activates fresh air when CO2 concentration exceeds 1000 ppm Independent temperature, humidity, and CO2 control loops; Ziegler-Nichols + genetic algorithm optimization; Anti-saturation processing and integral separation A 12-step, 60-min strategy is used for the forecast horizon; A 4-step, 20-min strategy is used for the control horizon; Offline identification and online update are used for the state-space model; IPOPT nonlinear optimization is used as the solver The network architecture uses a 5 × 256 fully connected infrastructure; ε-greedy (0.1 → 0.01); Priority sampling Clip parameter ε = 0.2; Experience collected from four parallel environments; GAE λ = 0.95 Automatic entropy adjustment; Dual Q network + target network; Gaussian distribution At the same time, in order to verify the overall weight of each module, an ablation research test is designed. To verify the contribution of each module, four variant algorithms are designed: Model Name DACRL-w/o-BIM: This model removes BIM semantic information. Model Name DACRL-w/o-BIM: This model removes BIM semantic information. Model Name DACRL-w/o-Fusion: This model removes multi-sensor fusion. Model Name DACRL-w/o-Fusion: This model removes multi-sensor fusion. Model Name DACRL-w/o-LT: This model removes the Lieb-Thirring constraint. Model Name DACRL-w/o-LT: This model removes the Lieb-Thirring constraint. Model Name DACRL-w/o-Safety: This model removes the safety filter layer. Model Name DACRL-w/o-Safety: This model removes the safety filter layer. Experimental results and discussion The comparative analysis of energy consumption performance In the simulation of a full year (8760 h in a normal year and 8784 h in a leap year), the energy consumption comparison of each algorithm is shown in Fig. 10. The energy consumption performance comparison of whole year (kWh/m2·a). Experimental results show that traditional RBC and PID algorithms generally have high energy consumption levels in various building types. RBC has the highest energy consumption (1250.6 kWh/m2·a), while PID slightly improves over RBC in most scenarios. Reinforcement learning algorithms generally outperform traditional and MPC methods. The proposed DACRL algorithm reduces energy consumption to 106.2 kWh/m2·a in office building scenarios, it achieves the lowest energy consumption of 50.1 kWh/m2·a in residential scenarios, and in the high-energy-consumption data center scenario, the DACRL reduces the energy consumption from 1250.6 kWh/m2·a to 952.4 kWh/m2·a. The comfort index analysis The multi-dimensional comfort evaluation system is used in this test; the PMV-PPD index is used for thermal comfort, the lighting uniformity U0 and glare index DGI are used for visual comfort. TVOC, PM2.5, and CO2 concentration are used for air quality, while the noise level NR curve is used for the acoustic comfort. The evaluation’s outcome is shown in Fig. 11. The comparison of multi-dimensional comfort radar charts. According to experimental findings, proposed DACRL performs better than the comparative algorithms across the board in terms of comfort metrics. For 94.2% of the time, the PMV value stays between [− 0.3, + 0.3], while for 91.5% of the time, the CO2 concentration stays below 800 ppm. The training efficiency and convergence test The training curves for the six building types are shown in Fig. 12. The results show that DACRL has faster convergence speed and better stability than other RL algorithms. The comparison of reward curves during training. In terms of convergence steps, DACRL requires an average of 15,000 steps to converge, while SAC requires 22,000 steps and PPO requires 28,000 steps. In terms of final performance, DACRL’s final cumulative reward is 18.3% higher than SAC and 27.6% higher than PPO. At the same time, the reward variance during DACRL training is 42% lower than that of SAC. The ablation experiment analysis The ablation experiment for office scene The results of the office scene ablation experiment are shown in Fig. 13. The ablation experiment result for office scene. The experimental results show that the office environment has obvious zoning characteristics and the heat load difference between the east and west facing areas is significant. The lack of BIM semantic information makes the system unable to identify the functional differences between the areas. At the same time, the east and west areas use the same temperature setting strategy. This will lead to over-cooling in the west-facing area and insufficient heating in the east area. The lack of the sensor fusion module makes the system unable to detect local hot spots, resulting in a decrease in temperature uniformity by nearly half. The removal of the LT constraint leads to disordered airflow organization, and the temperature difference at different heights reaches 3.2℃, and the number of violations of thermal comfort constraints increases by 258%. The ablation experiment for classroom scene The results of the classroom scene ablation experiment are shown in Fig. 14. The ablation experiment result for classroom scene. Experimental results demonstrate the highly dynamic nature of classroom environments. For example, the occupancy density on a tree branch increased dramatically from 0 to 60 people within 10 min of class. The lack of BIM information prevented the system from predicting class schedules and activating the ventilation system in advance. The lack of a sensor fusion module increased the false alarm rate for occupancy detection by 37%. After removing the LT constraint, the temperature difference between the podium and the back row reached 2.5°C. The lack of a safety filter layer led to 15 additional student complaints of discomfort caused by rapid temperature changes during class. The ablation experiment for residential scene The results of the residential scene ablation experiment are shown in Fig. 15. The ablation experiment result for residential scene. Experimental results show that the residential environments emphasize personalized comfort needs, with the elderly preferring 24°C and children 22°C. The lack of BIM information prevented the system from identifying bedroom functional partitions and automatically switching to sleep mode. The lack of a sensor fusion module prevented accurate detection of occupant locations. The removal of LT constraints caused heat from cooking in the kitchen to quickly spread to the living room. The lack of a safety filter layer caused bathroom humidity to exceed 80% for extended periods after showering. The ablation experiment for hospital scene The results of the hospital scene ablation experiment are shown in Fig. 16. The ablation experiment result for hospital scene. Experimental results show that the medical environment has extremely high requirements for air quality and temperature and humidity stability. The lack of BIM information prevented the system from distinguishing between general wards and isolation wards. The lack of a sensor fusion module made it impossible to detect abnormal positive pressure in the operating room. This resulted in three pressure difference reversal events. After the LT constraint was removed, the airflow organization in the ward area was disordered. The lack of a safety filter layer caused the temperature in the drug storage room to briefly exceed the 8°C limit. The ablation experiment for mall scene The results of the mall scene ablation experiment are shown in Fig. 17. The ablation experiment result for mall scene. Commercial complexes are big in scale and have a highly dynamic crowd density. The absence of BIM data made it impossible for the system to distinguish between different functional spaces like stores, corridors, and atriums. Accurate estimate of instantaneous client flow was also hampered by the absence of a sensor fusion module. During the weekend, CO2 levels often topped 1200 parts per million. Hot air gathered in the atrium when the LT limitation was removed. It creates a noticeable temperature stratification with a maximum temperature differential of 4.2°C. In comparison to the baseline solution, the full DACRL solution extended the consumer dwell duration by 12.3% during the testing. The ablation experiment for data center scene The results of the data center scene ablation experiment are shown in Fig. 18. The ablation experiment result for data center scene. Experimental results showed that the lack of BIM information prevented the identification of cabinet power density distribution. This resulted in local overheating reaching 38°C. The lack of a sensor fusion module caused mixing of hot and cold air, resulting in a 19% decrease in cooling efficiency. Removing LT constraints disrupted airflow. While the lack of a safety filter layer had minimal impact on energy consumption, the PUE deteriorated from 1.28 to 1.48. The performance under extreme conditions Under five extreme working conditions (Fig. 19), the experimental results show that DACRL exhibits the strongest robustness:, which is specifically reflected in the following aspects. The performance comparison under extreme working conditions. In extreme high temperature scenarios, energy consumption is 23.5% lower than MPC, and comfort violations are reduced by 68%; In extreme low temperature scenarios, heating energy consumption is reduced by 19.8%, eliminating the risk of frostbite; In large temperature fluctuation scenarios, temperature fluctuations are controlled within ± 1.2°C; In high humidity scenarios, de-humidification energy consumption is reduced by 27.3%, eliminating the risk of condensation; In polluted weather scenarios, indoor PM2.5 concentrations are maintained at < 35μg/m3. The generalization capability across building types By training on one building type and testing on other types (Fig. 20) shows that DACRL exhibits excellent generalization ability. According to the test results, DACRL only loses an average of 4.9% in performance on unseen building types, which is significantly lower than SAC’s 12.3% and PPO’s 18.7%. The generalized performance across building types (kWh/m2·a) (office train → OT, classroom train → CT, residential train → RT, average generalization → AVG, direct training → DT). The actual deployment verification test In Fig. 21, the actual deployment verification test result is illustrated. The actual deployment verification test result. This experiment conducted a four-week deployment study in an open office building in Fuzhou, China (consistent with the "Large Open Office Space" scenario described in section "The multi-dimensional experimental scene settings"). The deployment details are as follows: Deployment Location and Time: The entire east wing of a modern office building (approximately 2,000 square meters) in Fuzhou, China, was deployed in July 2023 to evaluate system performance under high-temperature, high-load conditions during the summer. Climatic Conditions: The deployment period was characterized by a typical subtropical monsoon summer climate, with average temperatures ranging from 28–35°C and average relative humidity of 75–85%. From the experimental results, it can be concluded that the daily energy consumption of office buildings fluctuates significantly. The lowest is about 1000 kWh and the highest is over 3100 kWh. At the same time, the energy saving rate fluctuates between 17 and 24%. The PMV compliance rate and CO2 concentration compliance rate remain above 90% most of the time, and the illumination compliance rate is also stable between 93 and 97%. The number of equipment failures is zero, and the sensor data integrity rate and control instruction execution success rate are both over 96%. The comprehensive comparative analysis with cutting-edge methods To more clearly identify the contribution and performance of this study, Table 9 below compares our proposed DACRL system with several advanced building control methods recently published in the literature. Table 9The comparative analysis with State-of-the-Art building control methods.ModelPrimary methodologyReported energy savingsIAQ performanceKey innovations/LimitationsDACRLSensor-Fused BIM + DACRL with L–T constraintUp to 63.2% (vs. RBC), 23.5% (vs. MPC)PMV within ± 0.3 for 94.2% time; CO2 < 800 ppm for 91.5% timePros: End-to-end BIM-sensor-DRL fusion; Novel L–T spectral constraint for field uniformity; Excellent generalization. Cons: Complex setup requiring BIM modelArroyo et al.23Reinforced MPC ~ 15–20% (vs. Rule-based)Maintains comfort constraintsPros: Combines model-based robustness with RL’s adaptability. Cons: Performance reliant on model accuracy; Lacks spatial field optimizationShen et al.36Multi-Agent DRL ~ 12–18% (vs. Single-agent DRL)Reduces discomfort hours significantlyPros: Effective for multi-device coordination. Cons: Primarily cost-focused; No explicit BIM or physical spatial integrationValladares et al.41Deep Reinforcement Learning ~ 10–15% (vs. PID)Maintains thermal comfort and controls CO2Pros: Early work jointly optimizing energy, comfort, and IAQ. Cons: Uses simpler DRL without safety filters or spatial constraintsLei et al.40Branching Dueling Q-Network ~ 8–14% (vs. RBC)Improves overall comfort metricPros: Occupant-centric multivariate control. Cons: Control actions are discrete/truncated; No BIM integration The comparative analysis with State-of-the-Art building control methods. The system practicality, scalability and people-oriented considerations While the core contributions of this research lie in its algorithms and system architecture, its ultimate value lies in practical deployment. Based on experimental results and system design, further discuss key issues in its practical application are also discussed. 1. Human-centered Control and Adaptability: This study implicitly safeguards occupant well-being by maintaining strict comfort metrics (such as PMV and CO2), a reactive strategy. However, it is recognized that occupants’ preferences and behaviors are dynamic and personalized. The proposed architecture provides a natural platform for more advanced human-centered control. For example, occupants can provide comfort feedback (e.g., "too hot," “too cold”) via mobile apps or indoor terminals. This feedback can be directly used as an additional input to the reinforcement learning reward function, enabling online fine-tuning and personalized adaptation of the system. Future work will focus on exploring this "human-in-the-loop" learning mechanism. 2. Scalability and Interoperability with Existing Systems:Scalability is built into the system’s four-layer architecture and "cloud-edge-end" collaboration paradigm. The system can scale horizontally by floor or building unit thanks to the deployment of edge computing nodes. As for interoperability, as explained in section "Control execution layer", conventional BMS protocols (such BACnet and Modbus) are used by the execution layer to connect with building equipment. Our system can be linked with the majority of current building automation systems without altering the underlying hardware, which drastically lowers deployment hurdles and costs. This is demonstrated by the JACE-8000 controller, which is a universal gateway in the industry. 3. Long-term Adaptability and Robustness: Building operating conditions and usage patterns change over time. This system’s ability to adapt over the long term through offline training methods and a cloud-based experience pool is one of its main advantages. In particular, operating data is frequently uploaded to the cloud by edge nodes. The system delivers the updated policy model to the edge nodes and initiates model retraining when it notices performance deterioration or notable operational drift. The system may overcome the constraints of conventional static control systems by adapting to long-term issues like seasonal variations, shifts in building functioning, and aging equipment thanks to this closed-loop learning and update process. Conclusion and prospect This study provides a comprehensive analysis of the multivariable coupling, nonlinearity, and time-varying characteristics inherent to indoor environmental control in buildings. Then, it proposes an intelligent control system that integrates multi-source sensor information, BIM digital twins, and spectrally constrained reinforcement learning. The system uses the novel DACRL control method, which is embedded with efficient L–T spectral constraints, spatiotemporal synchronization, and anomaly repair algorithms for multimodal data. It also optimizes the deployment of edge-side sensor nodes and their sampling. High-precision perception, effective computation, and high-performance control of intricate architectural environments are all made possible by this creative methodological combination. Large-scale experimental results show that the system significantly reduces the operating energy consumption of different types of buildings while maintaining the comfort and health of the indoor environment. At the same time, the framework demonstrates excellent robustness and generalization performance. The successful embedding of L–T inequality as a physical constraint provides new ideas for the safe and reliable application of reinforcement learning in the field of building control. The proposed system architecture and algorithm model have good engineering applicability and scalability. Future research will focus on the following areas: (1) Introducing human-in-the-loop adaptive mechanisms to explore how to seamlessly integrate occupant real-time feedback and personalized preferences into the DACRL learning process; (2) Developing more efficient cross-building transfer learning and lifelong learning algorithms to further improve the system’s long-term adaptability in large-scale deployments and reduce operation and maintenance costs. Author contributions The sole author completed draft, idea, method, experiment and software. Funding There is no external funding for this study. Data availability Available on request to corresponding author Libin Tong. Competing interests The authors declare no competing interests. Footnotes Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. References Associated Data Data Availability Statement Available on request to corresponding author Libin Tong.