-
TAVA - A Novel Method for Label-Free Embedding Compression
Ongoing research on compressing text embeddings without labeled data, using a novel two-stage distillation approach with generative adversarial adapters.
-
Universal Pretraining - Exploring the Value of Modality
Research I worked on during my graduate studies at SMU investigating the influence of modality on transformer pretraining. This work was abandoned.