Why Not All Transformers Can Actually Transform