A graphene-loaded metal-insulator-metal waveguide demonstrated all-optical switching at femtosecond timescales with a 35 fJ control pulse. The design pairs graphene’s fast saturable absorption with deep-subwavelength plasmonic confinement and silicon-waveguide coupling.