Student: Konstantinos Kalyfommatos
Program: “Data Science and Information Technologies”
Title: Exploring Dimensionality Reduction for Text Embeddings
Abstract:
Dense text embeddings are a core representation in modern NLP, supporting tasks such as retrieval, clustering, classification, and semantic search.
However, embeddings often have hundreds or thousands of dimensions, creating substantial storage and efficiency challenges at scale. In this work, we present a systematic study of post-hoc dimensionality reduction methods for text embeddings across multiple modern embedding backbones, compression ratios, and downstream tasks. We introduce GeoPres, a simple geometry-preserving reduction method: a learned linear map trained to preserve pairwise distances in the original embedding space—motivated by the Johnson–Lindenstrauss lemma from metric geometry. Our experiments show that embedding dimensionality can often be substantially reduced with minimal downstream task performance loss, and that GeoPres outperforms competing methods across many settings. We further find that preserving internal similarity rankings strongly correlates with downstream utility, providing a useful proxy for evaluating reduction quality. Overall, our results offer practical recommendations for selecting dimensionality reduction techniques in text embedding models.
Date/Time: Wed, July 8 2026 – 12:00 PM (Greece Time)
Examination Committee:
Dr. Haris Papageorgiou – Athena Research Center
Dr. Juri Opitz – University of Zurich
Dr. Bill Psomas – Czech Technical University in Prague
Presentation link:
https://teams.microsoft.com/meet/316925178600087?p=xICmRwt5eqVlxCwdrY