The market data layer for Edge Lab, a futures research platform I'm building one package at a time, starting with clean, queryable historical data.
- Ingests six years of 1-minute ES and NQ bars from Databento (about 4.2M rows, 2019 to 2024), normalizes them to Parquet partitioned by symbol and year, and queries them through DuckDB
- Built-in data-quality checks for duplicates, gaps, half-day sessions, and contract rolls, covered by 30 tests (21 on synthetic data, 9 against the real dataset)
- Returns bars as C-contiguous NumPy arrays so the C++ backtest engine coming next can consume them directly
Python, Databento, Parquet, DuckDB, pandas, NumPy, pytest