Porting an LLM based Application from ChatGPT to an On-Premise Environment

Teemu Paloniemi, Manu Setälä, Tommi Mikkonen · 2025

Read Porting an LLM based Application from ChatGPT to an On-Premise Environment by Teemu Paloniemi, Manu Setälä, Tommi Mikkonen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-07907.txt.

Description

Teemu Paloniemi, Manu Setälä and Tommi Mikkonen wrote a 2025 paper on moving an AI application from a public cloud to a local site. Cloud use of large language models can clash with privacy and security law. Their case app, AIPA, uses such models plus data analysis to grade bids for public contracts. The port had to keep that work intact.

Two design choices sat at the center: open model clarity and hardware cost. The paper walks through the port step by step. It weighs gains and losses of the local set-up next to the cloud one. Privacy control is the main gain they report.

Catalog record

CREATORTeemu Paloniemi, Manu Setälä, Tommi Mikkonen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-07907

Browse the full library · About the Tower of Babel