Determinantal formulae for a symmetric generating function of totally symmetric plane partitions

Julia Hörmayer and Florian Schreier-Aigner · 2026

Read Determinantal formulae for a symmetric generating function of totally symmetric plane partitions by Julia Hörmayer and Florian Schreier-Aigner (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-04626.txt.

Introduction

Julia Hörmayer and Florian Schreier-Aigner present determinant formulas for a family of polynomials built by summing over totally symmetric plane partitions, three-dimensional stacks of cubes with full symmetry. The family connects to alternating sign matrices and to symmetric tilings of a hexagon with a triangular hole.

Their formulas express these polynomials as determinants, which in turn produce new lattice path models for them and a novel family of tableaux. The tableau picture shows the polynomials generalise three classical dual Littlewood identities from representation theory. The work, following earlier joint work by the second author with Ilse Fischer, deepens the enumerative theory of these symmetric objects.

Catalog record

CREATORJulia Hörmayer and Florian Schreier-Aigner
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.04626

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Determinantal formulae for a symmetric generating function of totally symmetric plane partitions Julia Hörmayer and Florian Schreier-Aigner Abstract . Ilse Fischer and the second author introduced in [Algebr. Comb. 7 (2024), no. 5, 1319–1345] a two parameter family of polynomials defined as sums over totally symmetric plane partitions and connected to alternating sign matrices and cyclically symmetric lozenge tilings of a hexagon with a triangular hole. In this paper we present several determinantal formulae leading to new lattice path models and a novel family of tableaux. The later illustrates that the polynomials of our interest can be thought of as generalisations of the three dual Littlewood identities. 1. Introduction Initiated by MacMahon [ 16 ] at the end of the 19th century, the study of plane partitions became popular within the combinatorial community starting in the second half of the last century. In particular, proving the enumeration formulae for the ten symmetry classes of plane partitions became an important research programme which was popularised by Stanley [ 18 , 19 ] and only finished in 2011 by Koutschan, Kauers, and Zeilberger [ 11 ] . First noted by Bender and Knuth [ 4 ] , the symmetry classes of plane partitions (at least those without cyclical symmetry) were observed to be connected to symmetric polynomials, allowing simple proofs for their enumeration formulae. For more details compare to the overview article by Krattenthaler [ 13 ] . The symmetry classes of plane partitions involving a cyclical symmetry, on the other hand, turned out to be connected to alternating sign matrices (ASMs) introduced by Robbins and Rumsey [ 17 ] . Similarly to plane partitions, the early focus was on the enumeration of their symmetry classes; again a very challenging task which was completed only in 2017 by Behrend, Fischer and Konvalinka [ 3 ] . Over the years more numerical connections, i.e., equidistributions, between these two seemingly unrelated combinatorial objects have been found, compare for example to [ 2 , 9 , 12 ] . Nevertheless, their relation is still an unsolved mystery. In a recent series of papers by Ilse Fischer and the second author [ 6 , 7 ] , they introduced a novel weight for monotone triangles , combinatorial objects generalising ASMs and in bijection with semistandard Young tableaux. The corresponding generating functions, nowadays called the (modified) Robbins polynomials , are symmetric polynomials generalising Schur polynomials. In the special case corresponding to ASMs, the modified Robbins polynomials reveal a novel and unexpected connection between ASMs and plane partitions: the modified Robbins polynomial can be written in this case as a sum over totally symmetric plane partitions (TSPPs) where each TSPP contributes one Schur polynomial. Denote by \mathcal{A}_{n,k} this very generating function of TSPPs, which we call the symmetric generating function for TSPPs , where n denotes the size of the involved TSPPs and k is an additional parameter deforming the indexing partition of each of the Schur polynomials in a natural way; the precise definitions are given in Section 3 . As shown in [ 7 , Theorem 1.2] , the symmetric functions \mathcal{A}_{n,k} yield another intriguing connection to plane partitions, as they enumerate the cyclically symmetric lozenge tilings of cored hexagons with side lengths n+2k,n,n+2k,n,n+2k,n which generalise cyclically symmetric plane partitions. In this paper, we study the symmetric generating function \mathcal{A}_{n,k} for TSPPs from an algebraic combinatorial point of view and derive variants of the Jacobi–Trudi formula, the Nägelsbach–Kostka identity, and the Giambelli identity as presented in our main theorem. Theorem 1.1 . The symmetric function \mathcal{A}_{n+1,k}(\mathbf{x};r,u,v,w) satisfies the following determinantal formulae (1) \displaystyle\det_{1\leq i,j\leq n}\left((-1)^{j-i}v^{j}\binom{i-1}{j-1}+ru^{i}w^{j-i}s_{(i-1|j+k-1)}(\mathbf{x})\right) (2) \displaystyle= \displaystyle\det_{1\leq i,j\leq n}\left(ru^{i}e_{(n+k+i-j)}(\mathbf{x})+(-1)^{i-1}v^{i}\sum_{m}\binom{m-1}{m-i}e_{(n+1-j-m)}(\mathbf{x})\left(\frac{w}{u}\right)^{m-i}\right) (3) \displaystyle= \displaystyle\det_{1\leq i,j\leq n+k}\left(\begin{matrix}v^{n-i+1}h_{i-j}(\mathbf{x})+(-1)^{k+n-i}ru^{n-i+1}\sum\limits_{m=0}^{n-i}\binom{n-i}{m-i}h_{k+1+2n-m-j}(\mathbf{x})\left(\frac{w}{u}\right)^{m-i}\>1\leq i\leq n\\ \qquad\qquad\qquad\qquad\qquad h_{i-j}(\mathbf{x})\qquad\qquad\qquad\qquad\qquad\qquad\quad n+1\leq i\leq n+k\end{matrix}\right) (4) \displaystyle= \displaystyle\det_{1\leq i,j\leq n}\left(\delta_{i,j}v^{i}+ru^{j}\sum_{m}\binom{i-1}{i-m}\left(\frac{w}{u}\right)^{i-m}s_{(m-1|j+k-1)}(\mathbf{x})\right), In particular we provide lattice path interpretations for the last three determinants using the Lindström–Gessel-Viennot lemma [ 10 , 14 ] and use the method of dualisation due to Gessel and Viennot [ 10 ] for a combinatorial argument showing that these determinants are equal. Moreover we present a tableaux theoretic interpretation for these determinants which we call the TSPP tableaux . Using these TSPP tableaux it is immediate that the symmetric functions \mathcal{A}_{n,k} are connected to the three dual Littlewood identities, as shown in ( 8 ), ( 9 ) and ( 10 ). We believe that these new tableaux will be a useful tool for working with \mathcal{A}_{n,k} . We start by introducing all necessary symmetric polynomial terminology in Section 2 . In Section 3 , we define the symmetric generating function \mathcal{A}_{n,k} . Section 4 contains the proof of our main theorem. Thereafter, in Section 5 , we introduce TSPP tableaux and show that they yield another combinatorial interpretation for \mathcal{A}_{n,k} . 2. Preliminaries A partition \lambda is a weakly decreasing sequence of positive integers \lambda=(\lambda_{1},\ldots,\lambda_{\ell}) . We say that \lambda is a partition of |\lambda|:=\lambda_{1}+\cdots+\lambda_{\ell} , denoted by \lambda\vdash|\lambda| , and call \ell its length , also denoted by \ell(\lambda) . The Young diagram of a partition \lambda is a left-aligned collection of boxes such that the i -th row from the bottom has \lambda_{i} boxes (French convention). For simplicity, we identify partitions with their corresponding Young diagrams. The conjugate \lambda^{\prime}=(\lambda_{1}^{\prime},\lambda_{2}^{\prime},\ldots) of \lambda is obtained by reflecting \lambda along the x=y diagonal, see Figure 1 for an example. The Frobenius notation of \lambda is defined as (\lambda_{1}-1,\ldots,\lambda_{d}-d|\lambda_{1}^{\prime}-1,\ldots,\lambda_{d}^{\prime}-d) where d is the size of the Durfee square , i.e., the maximal integer d with \lambda_{d}\geq d . A semistandard Young tableaux (SSYT) of shape \lambda is a filling of \lambda with positive integers such that rows are weakly decreasing from left to right and columns are strictly decreasing from bottom to top. For an SSYT T we define its weight by \mathbf{x}^{T}=x_{1}^{\#\text{ of 1's in }T}x_{2}^{\#\text{ of 2's in }T}\cdots x_{n}^{\#\text{ of n's in }T}. Denote by \SSYT_{\lambda} the set of SSYTs of shape \lambda . For an infinite family of variables \mathbf{x}=(x_{1},x_{2},\ldots) , we define the Schur function s_{\lambda}(\mathbf{x}) as the multivariate generating function for SSYTs of shape \lambda s_{\lambda}(\mathbf{x}):=\sum_{T\in\SSYT_{\lambda}}\mathbf{x}^{T}. Two important special cases of the Schur function are the complete homogeneous symmetric function h_{k}(\mathbf{x})=s_{(k)}(\mathbf{x}) and the elementary symmetric function e_{k}(\mathbf{x})=s_{(1^{k})}(\mathbf{x}) , where (1^{k}) denotes the partition consisting of k times the entry 1 . \vphantom{1}\smash{1} \vphantom{1}\smash{2} \vphantom{1}\smash{2} \vphantom{1}\smash{4} \vphantom{1}\smash{2} \vphantom{1}\smash{3} \vphantom{1}\smash{4} Figure 1 . A SSYT of shape (4,2,1) and weight x_{1}x_{2}^{3}x_{3}x_{4}^{2} (left) and the conjugate of the partition (4,2,1) (right). There are three determinantal formulae for Schur functions which are of relevance for this paper: the Jacobi–Trudi formula s_{\lambda}(\mathbf{x})=\det_{1\leq i,j\leq\ell(\lambda)}\Big(h_{\lambda_{i}-i}(\mathbf{x})\Big), the Nägelsbach–Kostka identity , or dual Jacobi–Trudi formula s_{\lambda}(\mathbf{x})=\det_{1\leq i,j\leq n}\Big(e_{\lambda_{i}^{\prime}-i}(\mathbf{x})\Big), and the Giambelli identity s_{\lambda}(\mathbf{x})=\det_{1\leq i,j\leq d}\Big(s_{(a_{i}|b_{j})}(\mathbf{x})\Big). All of these formulae can be proven combinatorially by the celebrated Lindström–Gessel–Viennot lemma [ 10 , 14 ] , introduced next. Let G be an acyclic graph with an edge weight \omega . We define two paths in G to be non-intersecting if they do not have a vertex in common and a family of paths in G to be non-intersecting if all pairs of paths within this family are non-intersecting. We define the weight of a path \omega(P) as the product of its edge weights \omega(P):=\prod_{e\in P}\omega(P), and the weight of a family of

Read the complete text