Skip to content

Commit

Permalink
Merge pull request #3500 from abhisheklomsh/patch-2
Browse files Browse the repository at this point in the history
Update: Fixed typo transformer-embeddings.md
  • Loading branch information
alanakbik authored Jul 15, 2024
2 parents 7887678 + b523cd7 commit 86a5fc3
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -111,7 +111,7 @@ torch.Size([1536])
torch.Size([9984])
```

I.e. the size of the embedding increases the mode layers we use (but ONLY if layer_mean is set to False, otherwise the length is always the same).
I.e. the size of the embedding increases the more layers we use (but ONLY if layer_mean is set to False, otherwise the length is always the same).

(pooling)=
### Pooling operation
Expand Down

0 comments on commit 86a5fc3

Please sign in to comment.