Abstract The potential of GaAs‐based photonic crystals for fast all‐optical switching in the telecom spectral range is exploited by controlling the surface recombination and, thereby, the carrier relaxation dynamics. The structure is entirely coated with a layer of aluminium oxide using atomic layer deposition. This results in a carrier lifetime of about 10 ps, as determined by spectrally resolved pump–probe measurements. We show that the nonlinear response of the resonator is optimized when it is excited with a few‐picoseconds pulse. This dynamics is perfectly captured by our model accounting for the carrier diffusion with an impulse response function. Moreover, the suppression of photo‐induced oxidation is revealed to be crucial to demonstrate all‐optical operation at GHz rates with average coupled pump power of 0.5 mW (hence 100 fJ/bit). The switching window is 12 ps wide (1/e), as resolved by homodyne pump–probe measurements. The devices respond to a sequence of closely spaced pump pulses demonstrating a gating window close to 10 ps, with a contrast as high as 7 dB.