Reinforcement-learning-based routing for heterogeneous quantum networks In progress
Independent Study, Information Networking Institute, CMU — Advisor: Prof. Michael Mattarock
Quantum networks move entanglement, not bits, and the thing you're optimizing for — fidelity — degrades with every hop and every noisy component in a way that classical shortest-path routing was never built to reason about. This project asks a narrow, concrete version of a bigger question: can a decentralized learned policy, using only local information, route entanglement through a noisy quantum network as well as or better than a centralized heuristic that can see the whole topology?
I built a router using Proximal Policy Optimization, implemented in NetSquid, where each node runs its own agent making decisions from a fixed, scale-invariant observation and action space — meaning the same trained policy generalizes across network sizes without retraining. I benchmarked it against two centralized baselines: a negative-log-fidelity-weighted Dijkstra's algorithm, and simple hop-count routing, across both homogeneous and heterogeneous quantum hardware models.
The one configuration that didn't hit 100% success is worth stating plainly rather than smoothing over: the 10×10 homogeneous grid reached an 84.4% success rate with a wide ±27.0% spread across seeds — a real signal about where decentralized, locally-observed policies start to strain as network size grows, and a concrete direction for follow-up work rather than a clean result to round up.
Research preprint and journal submission targeted for October 2026. Simulation code, trained models, and results will be released as an open-source repository on completion.