In this note we describe how the first-order conditions of fixed effects in certain generalized linear models display a very convenient form. This can be exploited to implement a very fast GLM estimator with high-dimensional fixed effects, as we do in the R package glmhdfe.