TSSR: Two-Stage Swap-Reward–Driven Reinforcement Learning for Character-Level SMILES Generation
Jacob Ede Levine, Yun Lyan Luo, Sai Chandra Kosaraju · 2026
Read TSSR: Two-Stage Swap-Reward–Driven Reinforcement Learning for Character-Level SMILES Generation by Jacob Ede Levine, Yun Lyan Luo, Sai Chandra Kosaraju (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-04521.txt.
Description
Jacob Ede Levine, Yun Lyan Luo, and Sai Chandra Kosaraju teach a molecule generator to repair its own spelling, in a 2026 arXiv paper. Chemical language models write molecules as SMILES strings, one character at a time, and small errors compound. Many samples come out unparseable or chemically impossible, while hard grammar constraints that prevent failure also fence in exploration.
Their framework, TSSR, shapes the reward in two stages. First, local character swaps that fix syntax are rewarded, walking broken strings toward parseable ones; then chemistry-aware feedback from the RDKit toolkit rewards reductions in valence, aromaticity, and connectivity errors. The reward splits into interpretable pieces and needs no labelled data or hand-built grammar. On the MOSES benchmark, training from scratch and finetuning a pretrained model both gained syntactic and chemical validity and novelty, while the finetuned models kept their drug-likeness and synthesizability.
Catalog record
| CREATOR | Jacob Ede Levine, Yun Lyan Luo, Sai Chandra Kosaraju |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-04521