Go to file
Michael Pilosov d70eff3704 runs filter: N + T chip rows; group all/none meta chips; explicit row layout
- Add N and T axes alongside dataset/algorithm; chips populated from runs
  in the list, axis group hidden when there's a single unique value.
- Dataset+algorithm on row 1, N+T on row 2 via two explicit
  .runs-filter-row flex containers (cleaner than a sentinel break elem
  that double-counted the row-gap).
- 'all' and 'none' meta-chips now wrap as a unit inside .chip-meta-wrap
  so one doesn't orphan to the next line.
- Row is hidden entirely when every axis in it collapses to a single
  value (:has selector on .runs-filter-row).
2026-04-22 17:20:08 -06:00
app runs filter: N + T chip rows; group all/none meta chips; explicit row layout 2026-04-22 17:20:08 -06:00
flows flow: hash user-supplied generator_kwargs, not the merged dict 2026-04-22 17:04:50 -06:00
scripts stems: fold generator_kwargs into the hash; fix swiss_roll vs hole ambiguity 2026-04-22 16:30:42 -06:00
.gitignore some minor upgrades to prefect syntax 2026-04-21 18:02:39 -06:00
clean.sh some minor upgrades to prefect syntax 2026-04-21 18:02:39 -06:00
makefile rename folder 2026-04-21 19:30:45 -06:00
pyproject.toml some minor upgrades to prefect syntax 2026-04-21 18:02:39 -06:00
README.md some minor upgrades to prefect syntax 2026-04-21 18:02:39 -06:00
requirements-frozen.txt some minor upgrades to prefect syntax 2026-04-21 18:02:39 -06:00
uv.lock some minor upgrades to prefect syntax 2026-04-21 18:02:39 -06:00

Dimension Reduction Lab

A Python project exploring various dimension reduction techniques using Prefect for workflow orchestration.

Overview

This project serves as an experimental sandbox for studying dimensionality reduction and embedding algorithms within a reproducible environment. The primary goal is to evaluate and compare different techniques (like UMAP, t-SNE, PaCMAP, and TriMap) while focusing on their stability characteristics, particularly in the context of changing or drifting data distributions. By leveraging Prefect's workflow management capabilities, we can systematically analyze how these algorithms perform across arbitrary datasets, track their behavior over time, and measure their sensitivity to various hyperparameters and data perturbations.

Requirements

The project uses several key dependencies (as seen in requirements.frozen.txt):

Package Management

This project uses UV (μv) as its package manager, a fast Python package installer and resolver written in Rust. The requirements.frozen.txt file was generated using UV to ensure reproducible dependencies.

To update dependencies:

uv pip compile pyproject.toml (--all-extras) -o requirements.frozen.txt

Modifying --all-extras to include either an individual optional dependency group or all of them. See the pyproject.toml file for more information.

This project uses Prefect for workflow orchestration, for it's lightweight approach to running experiments from a UI and compatibility with single-node deployments.