These research documents were produced during project planning. They contain detailed analysis of data sources, automation strategies, modeling approaches, and metric definitions. They serve as primary source material for the project.
Comprehensive catalog of every federal and government-adjacent data source relevant to a national housing dashboard. Covers the full federal backbone (BPS, NRC/NRS, HMDA, FHFA HPI, FRED, BLS, HUD-USPS) with endpoint URLs, file formats, cadences, geography granularity, and automation difficulty scores (1-5). Establishes the two-tier data architecture concept and proposes a normalization schema.
Key topics covered:
Detailed connector playbook for building automated data ingestion from federal and local government sources. Includes per-connector ingestion steps (BPS, SOC/NRC/NRS, HMDA, ArcGIS, Socrata, Accela), SQL DDL for all tables, Mermaid ETL diagrams, and a prioritized national rollout plan across top-25 CBSAs.
Key topics covered:
Detailed metric-by-metric reproduction plan starting from the Houston CBAS presentation. Inventories every metric from the deck (70+ items), maps each to the best public data sources, assesses national replicability, and provides per-metric reproduction recipes with SQL query examples.
Key topics covered:
Full design document for the Houston MVP. Covers architecture decisions (Supabase, Python ingest, Next.js dashboard, monorepo), complete database schema DDL, dashboard page specifications (6 pages with KPI definitions), the permit-lag pipeline model, and 3-phase MVP rollout plan.
Detailed implementation plan for Phase 1 (federal backbone + modeled pipeline). 11 tasks covering project scaffolding, Supabase migrations, Python connectors (BPS, FHFA HPI), pipeline model, Click CLI, and Next.js dashboard scaffold. All tasks completed and merged.
Design document for Phase 2 (employment, population, HMDA, FRED). Covers new connectors, database migrations, CLI commands, dashboard pages, and the HMDA closings integration into the pipeline model.
Detailed implementation plan for Phase 2. Covers BLS employment connector, Census PEP population connector, FRED API connector, HMDA mortgage origination connector, four new SQL migrations, and three new dashboard pages (employment, demographics, prices).