@fchollet What would the addition of Transformers to Keras look like? Like if I wanted to add a base model or layer to extend to create different transformers, how would you like that done to accept a pull request?
Show this thread
As far as the core API is concerned, it looks like this: https://keras.io/api/layers/attention_layers/multi_head_attention/ … We're also working on a library for transformers, called KerasNLP. It's work in progress, and you're welcome to contribute!https://github.com/keras-team/keras-nlp …
-
-
Whoah, I’ve looked all over. How did I miss that? I guess my search was for Transformer. Thanks!
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
It would be a good idea to add transformer to the page. Help people find it.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.