-
TAVA - A Novel Method for Label-Free Embedding Compression
Ongoing research on compressing text embeddings without labeled data, using a novel two-stage distillation approach with generative adversarial adapters.
-
Loadax - High-Performance Data Loading for JAX
A JAX-native dataloading library with prefetching, multi-worker support, and distributed loading for ML training pipelines.
-
Scratch
Machine learning architectures and methods implemented from scratch.
-
Menagerie
A menagerie of deep learning models and techniques.
-
Hooper
An AI chatbot with generative UI built to discuss the NBA with realtime news and stats.
-
Phantom - A Rust based deep learning framework
A forward mode automatic differentiation and deep learning library written from scratch in rust capable of training neural networks.
-
Sieve - Approximate Nearest Neighbors index in Rust
An in-memory approximate nearest neighbors vector search index built with Rust.
-
Universal Pretraining - Exploring the Value of Modality
Research I worked on during my graduate studies at SMU investigating the influence of modality on transformer pretraining. This work was abandoned.