Basis Vector Metric: A Method for Robust Open-Ended State Change Detection
David Oprea, Sam Powers · 2025
Read Basis Vector Metric: A Method for Robust Open-Ended State Change Detection by David Oprea, Sam Powers (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-07308.txt.
Introduction
David Oprea and 1 co-author test a new method in 2025 for telling what state an object is in from a photo. State change detection asks, for example, whether a shirt is wet or dry, using language embeddings, numeric summaries of words, to judge the image. The work uses the MIT-States dataset of about 53,000 images, covering 225 nouns and 115 adjectives in roughly a thousand pairings.
Their Basis Vector Metric, or BVM, is compared against six rivals, including cosine similarity and a small neural network. BVM wins the first test, naming the state of each noun class best. A second test, telling adjectives apart for each adjective, gives no conclusive edge over a logistic regression baseline from the dataset's own paper. The authors note clear routes to improve BVM, so the method stays a promising work in progress.
Catalog record
| CREATOR | David Oprea, Sam Powers |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-07308
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Basis Vector Metric: A Method for Robust Open-Ended State Change Detection David Oprea, Sam Powers Abstract Institutional Affiliation: Lumiere Foundation Abstract - We test a new method, which we will abbreviate using the acronym BVM (Basis Vectors Method), in its ability to judge the state changes in images through using language embeddings. We used the MIT-States dataset, containing about 53,000 images, to gather all of our data, which has 225 nouns and 115 adjectives, with each noun having about 9 different adjectives, forming approximately 1000 noun-adjective pairs. For our first experiment, we test our method’s ability to determine the state of each noun class separately against other metrics for comparison. These metrics are cosine similarity, dot product, product quantization, binary index, Naive Bayes, and a custom neural network. Among these metrics, we found that our proposed BVM performs the best in classifying the states for each noun. We then perform a second experiment where we try using BVM to determine if it can differentiate adjectives from one another for each adjective separately. We compared the abilities of BVM to differentiate adjectives against the proposed method the MIT-States paper suggests: using a logistic regression model. In the end, we did not find conclusive evidence that our BVM metric could perform better than the logistic regression model at discerning adjectives. Yet, we were able to find evidence for possible improvements to our method; this leads to the chance of increasing our method’s accuracy through certain changes in our methodologies. 1 Introduction Image classification has been a very widely studied subject in AI, with many methods nowadays used to perform multiple tasks that have appeared in this area of research. Although image classification has been widely researched, it mostly has been focused on static image classification. Static image classification is where you are just given an image and are tasked with determining what type of image it is. Yet, not much research focuses on dynamic image changes, where an image’s properties can change and the model has the job of classifying what has changed for a certain image. Because of no research in dynamic image classification, tasks involving this are painstakingly hard to implement and are very expensive in resources, both computationally and time-wise. Usually, most image classification tasks involve just identifying an object. But for this study, we wanted to not focus on looking on what the type of object we are looking at is, but instead focus on the current ”state” of the object. By using a dataset with static images, but with those images having different states, we can effectively simplify the problem, whereas one would likely use a video instead of images for this kind of task. From this, it is much easier to obtain data and convert the data into embeddings, which is the type of data we will use to evaluate all of our metrics. The main objective of this study is to help further our understanding of how to efficiently solve the task that is image state detection. We not only evaluate already made metrics and test them, but we also create a new, robust method, BVM. We created this new metric with the goal in mind of being able to discern subtle differences between images and using that to effectively classify the states of those images. We will go into detail about how we use supervised learning to try to make the important attributes of our images get more amplified and trivial ones diminished using our method. Also, the methods we present don’t involve a lot of computing power or time. The creation of the embeddings from images is a pretty simple process, with many available models able to do this today each with its strengths. With a decent computer, you could easily utilize and/or quickly implement these metrics with thousands if not hundreds of thousands of image embeddings and obtain results from them. Also, some of the metrics we present don’t require any pretraining at all, like cosine similarity or dot product. This means that once you have the embeddings for the images you want, all you have to do is quickly run the metric(s) through them and obtain your results. This gives our work the ability to be used by anyone to accomplish whatever task they need to do and whether they want to opt for speed or accuracy. This makes our research very easily usable and helpful in progressing the advance of dynamic image classification. 2 Related Works Though there is not much work in the field of dynamic image classification, there are countless works which helped us to become able to study this. [ 3 ] created a large image dataset used for improving the task of static image classification called ImageNet. This kickstarted the quick improvement of models in being able to classify images effectively into categories and it was also the inspiration for future image classifying competitions as well. [ 2 ] performed a research project which was focused on taking an image and using some text to change the state of that image. The paper addresses this problem by introducing CLIP projection-augmentation embedding (PAE) to improve text-guided image manipulation through embeddings and residual vectors.R. Staniūtė et. al [ 4 ] studied the performance of different embedding models on the Clickr30k and MSCOCO [ 13 ] datasets. It talks about AlexNet [ 9 ] , ResNet [ 10 ] , VGGNet [ 11 ] , and GoogLeNet (or Inception-X Net), making comparisons on how they performed. The researchers saw as the year of creation of the embedding models increased, they became more and more accurate at creating embeddings to describe images and their attributes. P. Sitikhu et. al [ 1 ] researched testing the effectiveness of cosine similarity in the AG’s news topic classification data set. They open up questions both on what is the right combination of embedding model and scoring method to use. 3 Methods The core concept underlying BVM [ 6 ] is that we want the basis vectors to be trained so that they exemplify the differences between two images to more accurately determine what their states are. We do this by making a matrix that has values of either 0 or 1, in which 0 will make values that we don’t want to have much weight diminished, and 1 will try to increase the weight of the important values which easily differentiate images. This will in turn hopefully leave us with basis vectors that exemplify the state of the image through its values. To better visualize the idea of how basis vectors work we can look at how they manipulate vectors on a two-dimensional plane. 1 1 1 We generated the 2D plots for BVM on this Google Colab: https://colab.research.google.com/drive/1efOLA3Fy_ht4pbFn3nnGiLjWvn5U43Qj##scrollTo=gEz-TJfHW2QH . (a) Initial Basis Vectors - Orthogonal Classes (b) Trained Basis Vectors - Orthogonal Classes In figures 1(a) and 1(b) we see an example with two orthogonal classes, class 1 and class 2. Figure 1(a) shows untrained basis vectors to represent the classes going 5, 10, 15, 20, 25, and 30 degrees in both directions, with larger values showing more ”unalike” vectors. Figure 1(b) shows these basis vectors after being trained; it is clear