Every Activation Function You Need to Know
Which activation to use where, why ReLU replaced sigmoid, why transformers moved to GELU and SwiGLU, and the failure modes (dead units, saturation, non-zero-centered outputs) interviewers ask you to diagnose.