DEX Studio
DEX Studio
Open-source, self-hosted, local-first Data + ML + AI workbench. Single-page web UI — no separate API server, no microservices.
Features
- Data — Sources (CSV, Parquet, Postgres, Spark, dbt), Pipelines, SQL console, Warehouse (bronze/silver/gold), Lineage graph, Quality checks, Catalog, Transforms, Streaming, Schema, Backfill, Compaction
- Intelligence — Playground (SSE streaming chat), Models, Experiments, Dashboard, Agents, Traces, Drift, Embeddings, Features, Predictions, Tools, Finetune
- SecOps — PrivacyGuard overview, PII strategy config, Audit log, Alert rules, Policies
- System — Status, Live log tail (SSE), Metrics, Runs feed, Scheduler, Compaction, Alerting, Costs, Components
Quick Start
gitclonehttps://github.com/TheDataEngineX/dex-studio cddex-studio dockercomposeup # open http://localhost:7860Or natively:
uvsync uvrunpoedev Documentation
| Guide | Description |
|---|---|
| Getting Started | Install, run, create your first project and pipeline |
| Configuration | All dex.yaml options — sources, pipelines, ML, AI, backends |
| Design | Architecture decisions, project structure, roadmap |
| Architecture Review | Request flow, auth, scheduler, deployment |
| Observability | Metrics, logging, tracing, Prometheus integration |
Development
uvrunpoelint# ruff lint uvrunpoelint-fix# ruff lint + auto-fix uvrunpoetypecheck# mypy strict uvrunpoetest# pytest uvrunpoecheck-all# lint + typecheck + test uvrunpoedev# uvicorn dev server (port 7860, hot-reload)Architecture
flowchartLRB["Browser"]-->|"HTTP / SSE"|UI["FastAPI + Jinja2 + HTMX"]UI-->|"same process"|ENG["DexEngine (direct import)"]ENG-->DUCK[("DuckDB")]ENG-->|"optional"|PG[("PostgreSQL")]ENG-->|"optional"|QDRANT[("Qdrant")]ENG-->|"optional"|LLM[("Ollama / OpenAI / Anthropic")]No external API server — dex-studio imports dataenginex directly as a Python library. A single process handles HTTP, rendering, and engine execution.
Ecosystem
| Repo | Purpose |
|---|---|
| dataenginex | Python library — engine, config, all backends |
| dex-studio | This repo — web UI |
| infradex | Kubernetes deployment via ArgoCD |
Links
License: MIT • Python: 3.13+ • Port: 7860 • Status: Pre-1.0