Gen-SIS: Gen erative S elf-augmentation I mproves S elf-supervised Learning

Varun Belagali, Srikar Yellapragada, Alexandros Graikos, Saarthak Kapse, Zilinghan Li, Tarak Nath Nandi, Ravi K Madduri, Prateek Prasanna, Joel Saltz, Dimitris Samaras · 2024

Read Gen-SIS: Gen erative S elf-augmentation I mproves S elf-supervised Learning by Varun Belagali, Srikar Yellapragada, Alexandros Graikos, Saarthak Kapse, Zilinghan Li, Tarak Nath Nandi, Ravi K Madduri, Prateek Prasanna, Joel Saltz, Dimitris Samaras (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-01672.txt.

Description

Varun Belagali and co-authors let a generative model invent the extra views that self-supervised learning feeds on. Their 2024 paper, Gen-SIS, works in visual representation learning, where an encoder learns by matching different views of the same image. Hand-made distortions like cropping and color jitter supply those views, and diffusion models widened them, but only after pretraining on huge image-text sets that domains like tissue pathology lack.

Their diffusion model trains purely on the unlabeled target images themselves. Self-augmentation from the domain's own data keeps the views honest to its statistics. The result targets exactly the fields where outside image collections do not exist.

Catalog record

CREATORVarun Belagali, Srikar Yellapragada, Alexandros Graikos, Saarthak Kapse, Zilinghan Li, Tarak Nath Nandi, Ravi K Madduri, Prateek Prasanna, Joel Saltz, Dimitris Samaras
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-01672

Browse the full library · About the Tower of Babel