An encoder processes the inputs (e.g., a sequence of words) to create a representation in higher dimensional space like [[word embeddings]], often called a [[context vector]].