What You See Is Not Always What You Get: Evaluating GPT’s Comprehension of Source Code

Jiawen Wen, Bangshuo Zhu, Huaming Chen · 2024

Read What You See Is Not Always What You Get: Evaluating GPT’s Comprehension of Source Code by Jiawen Wen, Bangshuo Zhu, Huaming Chen (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-08098.txt.

Description

Jiawen Wen, Bangshuo Zhu, and Huaming Chen present a study from twenty twenty-four on hidden attacks that fool language models as they read code. The attacks tweak code at the level of single marks. Human eyes cannot see the change, yet the model's acts shift. The team sorts such tricks into four kinds.

The kinds are code reordering, unseen marks, code cuts, and look-alike marks. They test top models on both clean and tweaked code. Two gauges track trust in the reply and the rightness of the reply. All models lost ground under the tricks, though by unlike amounts. More tweaks meant worse scores. The authors urge tougher models for code work.

Catalog record

CREATORJiawen Wen, Bangshuo Zhu, Huaming Chen
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-08098

Browse the full library · About the Tower of Babel