Projects
Audit-Prune: removing shortcuts from LLM benchmarks
Six answer-only surface features score 68.9% on binary-choice TruthfulQA, above the top leaderboard model (66.9%), and several of 13 other benchmarks leak too. Audit-Prune cuts TruthfulQA's leak to near chance while keeping model rankings (Spearman 0.915).
dKS: a fast test for whether two datasets differ
Extends the Kolmogorov–Smirnov distance to multiple dimensions as a unit-invariant metric. The approximation runs about 76,000× faster than exact computation on a million 2-D points; I wrote the open-source library.
Public LLM datasets on Hugging Face
Three contrast sets (3,053 pairs) for steering LLMs, each isolating one behavior (conciseness, positivity, formality), two built with Martian AI; plus TruthfulQA-476 and two held-out sets for testing truthfulness classifiers.
MotionPI: data platform for an NIH wearable study
Wristbands detect moderate-to-vigorous activity and trigger in-the-moment phone surveys (113 participants enrolled to date). As sole developer of the app, backend and offline-first sync, I built a pipeline that handles ~7.7M records a day with zero malformed writes.
Hotspot detection on aggregated health data
Fast hotspot detectors need points, not region totals. Sampling 20–50 points per region instead of one improves detection power and scans the contiguous U.S. in 0.33 s (FlexScan: 1,109 s with its significance test).