Date |
Chapter |
Notes |
Topic |
Assignment |
Mon 8.19 |
|
|
Class Overview |
|
Wed 8.21 |
FDS 2, HDP 3 |
L1 |
Curse of Dimensionality : Basic Geometry |
|
Mon 8.26 |
|
L2 |
Curse of Dimensionality : Nearest Neighbors |
Quiz 1 |
Wed 8.28 |
seidel, eps-kernel, John's Ellipsoid |
L3 |
Curse of Dimensionality : Convex Hulls |
|
Mon 9.2 |
|
|
LABOR DAY |
|
Wed 9.4 |
FDS 5.11, HDP 8.3, AB book |
L4 |
Hardness of Estimation : VC-dimension and Learning Theory |
|
Mon 9.9 |
AHRS 2, HDP 4, 7.3 |
L5 |
Hardness of Estimation : Mean/Parameter Estimation |
|
Wed 9.11 |
RFFs, RKHS, kernel distance |
L6 |
Building Embeddings : Lifting |
HW 1 due |
Mon 9.16 |
M4D 4.2, Magen notes |
L7 |
Building Embeddings : Metric Embeddings |
Quiz 2 |
Wed 9.18 |
BM25, SIFT |
L8 |
Building Embeddings : Feature Modeling |
|
Mon 9.23 |
Embed Vis, Collab |
L9 |
Building Embeddings : Masked Word Models |
|
Wed 9.25 |
|
L10 |
Building Embeddings : Contrastive Learning |
|
Mon 9.30 |
FDS 3, M4D 7.6, t-SNE, analysis |
L11 |
Dimensionality Reduction : PCA, t-SNE |
Quiz 3 |
Wed 10.2 |
M4D 7.7, DML |
L12 |
Dimensionality Reduction : Distance Metric Learning |
HW 2 due |
Mon 10.7 |
|
|
FALL BREAK |
|
Wed 10.11 |
|
|
FALL BREAK |
|
Mon 10.14 |
FDS 2.7 |
- |
Dimensionality Reduction : Random Projections + JL extensions |
|
Wed 10.16 |
M4D 4.6 |
- |
Similarity Search : Locality Sensitive Hashing |
Project Proposal |
Mon 10.21 |
|
- |
Similarity Search : Graph-based Search (aka HNSW) |
Quiz 4 |
Wed 10.23 |
|
- |
Similarity Search : SOTA - Pinecone, FAISS |
|
Mon 10.28 |
FDS 5.2 |
- |
Optimization : Perceptron |
|
Wed 10.30 |
|
- |
Optimization : Minimum Enclosing Ball (and Frank-Wolfe) |
HW 3 due |
Mon 11.4 |
|
- |
Optimization : Convexity, non-convexity, Polyak-Lojasiewicz |
Quiz 5 |
Wed 11.6 |
|
- |
Coresets : Kernel Density Estimates |
|
Mon 11.11 |
|
- |
Coresets : Sensitivity Sampling (Radamacher Complexity) |
|
Wed 11.13 |
|
- |
Coresets : Low-Rank Convex Hulls |
|
Mon 11.18 |
|
- |
Sampling : from Convex Polytopes |
Quiz 6 |
Wed 11.20 |
|
- |
Sampling : Hit-and-Run |
HW 4 due |
Mon 11.25 |
|
|
Project Presentations |
Project Report due |
Wed 11.27 |
|
|
Project Presentations |
|
Mon 12.2 |
|
|
Project Presentations |
|
Wed 12.4 |
|
|
Project Presentations |
Quiz 7 |
Thu 12.12 |
|
|
FINAL EXAM 3:30pm - 5:30pm |
|