CaLoRA ify: Ca lorie Estimation with Visual-Text Pairing and LoRA -Driven Visual Language Models
Dongyu Yao, Keling Yao, Junhong Zhou, Yinghao Zhang · 2024
Read CaLoRA ify: Ca lorie Estimation with Visual-Text Pairing and LoRA -Driven Visual Language Models by Dongyu Yao, Keling Yao, Junhong Zhou, Yinghao Zhang (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-09936.txt.
Description
Dongyu Yao, Keling Yao, Junhong Zhou, and Yinghao Zhang built a system that estimates calories from a single photo of food. Their paper came out in 2024. Standard calorie tools need special data formats or long processing chains, which limits daily use.
The team first built a large dataset of food images paired with text that names ingredients and gives nutrition facts. Their system trains a vision-language model, a model that reads both images and words, on those pairs. A light tuning method adapts the model without retraining all of it. Users can also chat with the system to refine an estimate, which keeps the tool flexible for real meals.
Catalog record
| CREATOR | Dongyu Yao, Keling Yao, Junhong Zhou, Yinghao Zhang |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-09936