New tutorial on http://keras.io : text generation with FNet, a highly efficient BERT variant that leverages a Fourier transform-based linear mixer. https://keras.io/examples/nlp/text_generation_fnet/ …pic.twitter.com/Lcez33prsH
Show this thread
Created by @getdarshan! Also check out the original paper:https://arxiv.org/abs/2105.03824v3 …
-
-
I had the same idea! Except I used a T5 implementation with encoder attention replaced with FFT. And I trained it from scratch. Here is the demo: https://huggingface.co/spaces/flax-community/FT5-demo … Details in the README
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.