Multitask learning

[antgr]

Is it possible to do multitask learning using flair? I would like to try a very simple example.

[antgr]

I suspect that I have to use regular pytorch implementation for this part, right?

[djstrong]

I would be interested in multitask learning.

[alanakbik]

@djstrong agree, we really need this in Flair.

[stefan-it]

I also agree with that :) In the meantime I may point you to the following papers:

• "AdapterFusion: Non-Destructive Task Composition for Transfer Learning"
• "MAD-X: An Adapter-based Framework for Multi-task Cross-lingual Transfer"

There will be a huge release on https://adapterhub.ml/ in the next days/weeks and we should really try to integrate that into Flair :)

[djstrong]

A simple (I guess) multitask learning is implemented in sentence-transformers.