TSSR: Two-Stage Swap-Reward–Driven Reinforcement Learning for Character-Level SMILES Generation

Jacob Ede Levine, Yun Lyan Luo, Sai Chandra Kosaraju · 2026

Read TSSR: Two-Stage Swap-Reward–Driven Reinforcement Learning for Character-Level SMILES Generation by Jacob Ede Levine, Yun Lyan Luo, Sai Chandra Kosaraju (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-04521.txt.

Description

Jacob Ede Levine, Yun Lyan Luo, and Sai Chandra Kosaraju teach a molecule generator to repair its own spelling, in a 2026 arXiv paper. Chemical language models write molecules as SMILES strings, one character at a time, and small errors compound. Many samples come out unparseable or chemically impossible, while hard grammar constraints that prevent failure also fence in exploration.

Their framework, TSSR, shapes the reward in two stages. First, local character swaps that fix syntax are rewarded, walking broken strings toward parseable ones; then chemistry-aware feedback from the RDKit toolkit rewards reductions in valence, aromaticity, and connectivity errors. The reward splits into interpretable pieces and needs no labelled data or hand-built grammar. On the MOSES benchmark, training from scratch and finetuning a pretrained model both gained syntactic and chemical validity and novelty, while the finetuned models kept their drug-likeness and synthesizability.

Catalog record

CREATORJacob Ede Levine, Yun Lyan Luo, Sai Chandra Kosaraju
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-04521

Browse the full library · About the Tower of Babel