GRAFT — Cross-Model Residual Transplant
Zero-shot cross-model residual-stream transplant of DeepSeek-R1-Distill-Llama-70B activations into Llama-3.3-70B on AMD MI300X.
GRAFT (Generative Residual Activation Forward Transplantation) is a programmatic zero-shot cross-model residual-stream transplant experiment.
- Transplanted DeepSeek-R1-Distill-Llama-70B’s residual activations into Llama-3.3-70B-Instruct on a single AMD Instinct MI300X (AMD Developer Cloud).
- Every phase is audit-gated: a failing phase refuses to start based on the previous phase’s manifest.
- Pin-parity enforcement:
sha256(pip freeze)must matchconfigs/pins.txtbefore any phase starts. - Hard $55 budget tripwire on $60 of cloud credit — disciplined engineering under real resource constraints.