The covariance matrix gives the covariance of each feature. $C = \frac{1}{N-1} X^T X$ $X$ has mean zero.