CaLoRA ify: Ca lorie Estimation with Visual-Text Pairing and LoRA -Driven Visual Language Models

Dongyu Yao, Keling Yao, Junhong Zhou, Yinghao Zhang · 2024

Read CaLoRA ify: Ca lorie Estimation with Visual-Text Pairing and LoRA -Driven Visual Language Models by Dongyu Yao, Keling Yao, Junhong Zhou, Yinghao Zhang (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-09936.txt.

Description

Dongyu Yao, Keling Yao, Junhong Zhou, and Yinghao Zhang built a system that estimates calories from a single photo of food. Their paper came out in 2024. Standard calorie tools need special data formats or long processing chains, which limits daily use.

The team first built a large dataset of food images paired with text that names ingredients and gives nutrition facts. Their system trains a vision-language model, a model that reads both images and words, on those pairs. A light tuning method adapts the model without retraining all of it. Users can also chat with the system to refine an estimate, which keeps the tool flexible for real meals.

Catalog record

CREATORDongyu Yao, Keling Yao, Junhong Zhou, Yinghao Zhang
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-09936

Browse the full library · About the Tower of Babel