robotic experience library (rxl) — a high-performance c++ reinforcement learning library purpose-built for real-time robotic control, with python bindings via pybind11. built with deterministic timing guarantees for fixed-frequency robot control loops.
openquant — a strategy evaluation framework modelling quantitative portfolio optimisation. includes a 7-page technical paper on the theoretical foundations.
hmm for regime switching — a 3-state gaussian hmm built from scratch to identify market regimes (bull, bear, crash). implemented the forward-backward algorithm manually.
q-function rl engine — a multi-agent rl system for autonomous stock trading. features a custom market simulation and a sigmoid-bounded metric for stock quality.