https://slatestarcodex.com/2015/06/02/and-i-show-you-how-deep-the-rabbit-hole-goes/ … is a fun story.
Anyway, we have 537k MIDI files (~9GB) which we're converting to ABC (text is just easier to work with and it's only somewhat lossy). Our TPU swarms hunger. Should be interesting to compare with @OpenAI's MuseNet...
-
-
Prikaži ovu nit
-
At a loss of ~0.35, starting to get some interesting samples, eg https://gist.github.com/shawwn/69c0e95fa363e75c83cbaab204d21a1f … / https://www.gwern.net/docs/ai/music/2020-01-28-gpt2-midi-abc-111803542.mp3 … (improves substantially ~0m55s, 2m15s mark, impressively maintains themes throughout). Colab: https://colab.research.google.com/drive/1OJB0_mYMn5o4KTOdJFT4QNUMHkaeWcpY … Current training log:pic.twitter.com/UEX2Jm8ts3
Prikaži ovu nit
Kraj razgovora
Novi razgovor -
-
-
How do you do that? Can you share a colab?
-
I don't believe this would work on Colab. You need raw access to the TPUs on GCP.
- Još 5 drugih odgovora
Novi razgovor -
-
-
OK now I'm trying to figure out whether this is a reference to https://slatestarcodex.com/2015/06/02/and-i-show-you-how-deep-the-rabbit-hole-goes/ …, or whether they are *both* references to something else I don't know about yet
- Još 1 odgovor
Novi razgovor -
Čini se da učitavanje traje već neko vrijeme.
Twitter je možda preopterećen ili ima kratkotrajnih poteškoća u radu. Pokušajte ponovno ili potražite dodatne informacije u odjeljku Status Twittera.