Microservice Architecture Patterns for Scalable Machine Learning Systems

Sowjanya Karanam, Jayanth Bhargav · 2026

Read Microservice Architecture Patterns for Scalable Machine Learning Systems by Sowjanya Karanam, Jayanth Bhargav (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-13672.txt.

Description

Sowjanya Karanam and Jayanth Bhargav review microservice architecture patterns for scalable machine learning systems. Machine learning now powers recommendations and large-scale business analytics, and managing these models at scale is hard. Microservices break complex systems into smaller parts that can be built, updated, and scaled on their own. The authors review how Netflix, Uber, and Google use microservices for training, deployment, and monitoring. They discuss design challenges and fit for large-scale applications like recommendation systems. Simulation studies show microservice designs can reduce latency and improve scalability.

Catalog record

CREATORSowjanya Karanam, Jayanth Bhargav
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29092
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.13672

Browse the full library · About the Tower of Babel