[feat] Simplicial Embeddings

[blefaudeux]

🚀 Feature

Add the simplicial embeddings to xformers

Motivation

Seems pretty interesting, easy to integrate, and great results on SSL / vision

Pitch

Write a PR and see how that looks

Alternatives

Go skiing

Additional context

see linked paper

[blefaudeux]

in the paper it's proposed as an addition at the bottom of the encoder, to force the final representation into L hopefully more or less orthogonal vectors