FreeMesh: Boosting Mesh Generation with Coordinates Merging

Jian Liu, Haohan Weng, Biwen Lei, Xianghui Yang, Zibo Zhao, Zhuo Chen, Song Guo, Tao Han, Chunchao Guo · 2025

Read FreeMesh: Boosting Mesh Generation with Coordinates Merging by Jian Liu, Haohan Weng, Biwen Lei, Xianghui Yang, Zibo Zhao, Zhuo Chen, Song Guo, Tao Han, Chunchao Guo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-13573.txt.

Introduction

Jian Liu and co-authors improve how 3D meshes are turned into token strings in 2025. Models that build meshes step by step rely on such strings, yet no good yardstick compared the string methods. Better strings mean faster, leaner mesh generation.

The team offers a new metric based on information per token to grade string methods without training. Their merging trick then joins the most common coordinate patterns in the string. That raises compression for several known methods at once. Tests across those methods confirm gains, and the authors hope the metric guides future mesh tokenizer design.

Catalog record

CREATORJian Liu, Haohan Weng, Biwen Lei, Xianghui Yang, Zibo Zhao, Zhuo Chen, Song Guo, Tao Han, Chunchao Guo
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-13573

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FreeMesh: Boosting Mesh Generation with Coordinates Merging Jian Liu, Haohan Weng, Biwen Lei, Xianghui Yang, Zibo Zhao, Zhuo Chen, Song Guo, Tao Han, Chunchao Guo Abstract The next-coordinate prediction paradigm has emerged as the de facto standard in current auto-regressive mesh generation methods. Despite their effectiveness, there is no efficient measurement for the various tokenizers that serialize meshes into sequences. In this paper, we introduce a new metric Per-Token-Mesh-Entropy (PTME) to evaluate the existing mesh tokenizers theoretically without any training. Building upon PTME, we propose a plug-and-play tokenization technique called coordinate merging. It further improves the compression ratios of existing tokenizers by rearranging and merging the most frequent patterns of coordinates. Through experiments on various tokenization methods like MeshXL, MeshAnything V2, and Edgerunner, we further validate the performance of our method. We hope that the proposed PTME and coordinate merging can enhance the existing mesh tokenizers and guide the further development of native mesh generation. 1 Introduction Figure 1: Per-Token-Mesh-Entropy (PTME) Analysis. (a) Visualization demonstrates that our Rearrange & Merge Coordinates (RMC) method significantly enhances geometric detail preservation and better topology. (b) Comparative analysis between baseline Merge Coordinates (MC) and the proposed RMC approach. MC fails to reduce PTME, while our RMC framework effectively minimizes token entropy. A number of recent methods ( Siddiqui et al. 2023 ; Weng et al. 2024a ; Chen et al. 2024a ; Chen et al. 2024b ; Chen et al. 2024c ; Tang et al. 2024a ; Hao et al. 2024 ; Weng et al. 2024b ) have emerged that serialize 3D meshes into sequences and model them using an auto-regressive Transformer. These generated meshes typically preserve sharp edges and high-quality topology, which can be easily incorporated into existing graphics pipelines. However, there is no effective metric to measure the quality of these tokenizers theoretically. The common way to evaluate them is through expensive training and observing experimental results, which is time-consuming and the randomness is uncontrollable. In this paper, we equip mesh serialization with a mathematical tool, entropy ( Shannon 1948 ) . Generally, a sequence with a lower total amount of information is usually easier for sequence learning ( Su 2018 ) . The comparison of total information can be transformed into a comparison of average information entropy. Considering the properties of meshes, different tokenizers can produce varying lengths for the same mesh. Based on the simplest raw representation from MeshXL ( Chen et al. 2024a ) , we have summarized a set of formulas called Per-Coordinate-Mesh-Entropy ( PCME ). The PCME is equal to the product of information entropy and compression rate, and it can be used to compare the amount of information contained in a mesh sequence with a single coordinate as the basic unit. The lower the PCME, the easier the sequence is to learn. This metric can effectively measure the quality of the tokenizer without any training. With the guidance of PCME, we further consider how to reduce it to improve current mesh tokenizers. Through our early observation, we found that the serialized coordinate sequence has a large number of repeated patterns. We consider merging multiple coordinates into additional tokens to reduce the redundancy in sequence, thus further facilitating mesh learning. Consequently, we extended the Per-Coordinate-Mesh-Entropy to Per-Token-Mesh-Entropy (PTME), where a token can be coordinate tokens or merged tokens. A good mesh tokenizer should have a relatively low PTME. We further validated PTME on existing tokenizers such as MeshXL ( Chen et al. 2024a ) , MeshAnythingV2 ( Chen et al. 2024c ) , and EdgeRunner ( Tang et al. 2024a ) . Furthermore, we introduce coordinate merging, which further compresses these tokenizers by merging some high-frequency coordinates to construct a new vocabulary. By increasing the vocabulary size, more coordinates are compressed thus the PTME is further reduced. Note that we implement token merging through SentencePiece training, which is simple and efficient. We constructed a simple point cloud conditioned mesh generation pipeline to evaluate the proposed method empirically. We used the filtered Objaverse ( Deitke et al. 2023 ) and Objaverse-XL ( Deitke et al. 2024 ) ) as training data. For a fair comparison, we only took the tokenizers from MeshXL, MeshAnything V2, and EdgeRunner, and incorporated them into our framework for training and testing in the 7-bit discretization setting. Extensive experiments demonstrate that our PTME is an effective method for evaluating the superiority of mesh tokenizers, and that the Rearrange & Merge Coordinates (RMC) can effectively increase the number of mesh faces generated by previous tokenizers. Our contributions can be summarized as follows: • We make the first attempt to build a mathematical framework, PTME, to evaluate existing mesh tokenizers without any training. • We introduce a simple yet effective coordinate merging to further compress the mesh sequence. • We achieve a state-of-the-art compression ratio of 21.2% by combining EdgeRunner with token merging, showing the effectiveness of the proposed coordinate merging. 2 Related Work Figure 2: Comparison of token length distribution between coordinate merging techniques. while the baseline Merge Coordinates (MC) method typically requires 2 coordinates per token representation, the Rearrange & Merging Coordinates (RMC) approach achieves more efficient compression, with most coordinates being represented by a single token. Indirect Mesh Generation. These approaches ( Zhao et al. 2024a ; Jain et al. 2022 ; Long et al. 2023 ; Zhao et al. 2025 ) predominantly utilize 3D generation networks initially to generate alternative representations, followed by post-processing procedures to obtain the mesh. Broadly, most of them can be classified into four categories. The first category comprises the SDS optimization methods grounded in NeRF and Gaussian frameworks, as elucidated in ( Jain et al. 2022 ; Poole et al. 2022 ; Wang et al. 2023 ; Chen et al. 2023 ; Tang et al. 2023 ) . These methods effectively capitalize on the generalizable capabilities of 2D diffusion models to mitigate the scarcity of 3D data. However, they are constrained by the limited 3D perception of 2D models, and are characterized by relatively slow processing speeds. The second category is the single-image-to-multi-image transformation combined with a reconstruction approach, as detailed in ( Long et al. 2023 ; Tang et al. 2024b ; Yang et al. 2024 ) . This class of methods incorporates a finetuned multi-view diffusion model. To a certain extent, it can alleviate the Janus problem. Nevertheless, it is restricted by challenges related to multi-view consistency, resulting in unstable generation outcomes. The third category pertains to the Large Reconstruction Model (LRM), as demonstrated in ( Hong et al. 2023 ; Xu et al. 2024 ; Wei et al. 2024 ) , which showcases end-to-end training of a triplane-NeRF regression. However, the reconstruction performance of these methods has an upper bound. The fourth category consists of the 3D DiT-based methods, as presented in ( Zhao et al. 2024b ; Zhang et al. 2024 ; Chen et al. 2024d ; Zhao et al. 2025 ) . These methods employ a substantial volume of 3D data to train a foundation geometry model, currently exhibiting the most proficient geometric control capabilities. However, their model performance is limited by the Variational Autoencoder (VAE) ( Kingma 2013 ) , and an additional UV painting model ( Zeng et al. 2024

Read the complete text