Porting an LLM based Application from ChatGPT to an On-Premise Environment
Teemu Paloniemi, Manu Setälä, Tommi Mikkonen · 2025
Read Porting an LLM based Application from ChatGPT to an On-Premise Environment by Teemu Paloniemi, Manu Setälä, Tommi Mikkonen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-07907.txt.
Description
Teemu Paloniemi, Manu Setälä and Tommi Mikkonen wrote a 2025 paper on moving an AI application from a public cloud to a local site. Cloud use of large language models can clash with privacy and security law. Their case app, AIPA, uses such models plus data analysis to grade bids for public contracts. The port had to keep that work intact.
Two design choices sat at the center: open model clarity and hardware cost. The paper walks through the port step by step. It weighs gains and losses of the local set-up next to the cloud one. Privacy control is the main gain they report.
Catalog record
| CREATOR | Teemu Paloniemi, Manu Setälä, Tommi Mikkonen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-07907