Shane recently experimented with generating metal band ice cream flavors1, and my mentor Natasha and I (and a lot of Twitter) were highly entertained by them. We chatted about how I could generate some weird things during my OpenAI Scholar summer too. And since I’m working in deep learning with data about songs, we thought:
song titles + deep learning paper titles from arXiv2 = something hilarious???
Throughout my experimentation this week, these two sets of titles tried their darndest not to mix with each other - so sad! Many, many of the results were clearly either only influenced by deep learning:
Structural Model for Deep Learning for Parallel Problem Evolutional Recognition
Quee Reflet : Semi-Supervised A Learning-Model and Hierarchical Variational Architrate Networks for Invementation Selection
…or only influenced by songs:
Love Me Down (Manis Edit)
Boy (feat. Stron The Remix)
But right at the beginning, after just 2 training epochs and 9 samples, things we’re looking promising with these samples:
Flexing To The Study
Embedding feat. Cetya Readm
Amazing! Thanks to textgenrnn, this fun side experiment was all set to be a breeze, right?
Well, I got misleadingly lucky on those very first two epochs because my samples didn’t achieve hilarity like that again for a while. I probably generated well over 500 samples total. Things got a bit frustrating - I was mostly sampling boring-sounding deep learning paper titles.
But occasionally, the titles would play together as intended!
Overall, my strategy was to encourage song/arXiv mixing by ensuring my network didn’t overfit to any particular training data.
max_length: this forced the network to work with a smaller memory by limiting the number of previous characters it could use to predict the next character.
I would definitely still get meh results, but adjusting these configurations seemed to improve chances of generating something fun.
I think the textgenrnn project says this well in its disclaimer:
You will not get quality generated text 100% of the time, even with a heavily-trained neural network … NN text generation often generate lots of texts and [you’ll need to] curate/edit the best ones afterward.
And indeed, lots of curating and editing went into my ‘best of’ list!
After much tinkering and sampling, I did eventually achieve some fun mashup titles! Here are my favorites:
Flexing To The Study
Embedding feat. Ceyta Readm
Strong (feat. Salial Networks)
Moon (feat. Ligoning for Structured Remix)3
Completion and Continuous remix
State (Feat. Kanna Alignment Algorithms)
Like You Way To (Original Learning4 from a Hadcer convex framework)
Space Camera & Anomaly5
Correction in Remix
Automatic Samples for sea Remix
Silver (Sving Recognitive Network prooft Remix)
Learning Theory (Live Self Model)6
A Problems of Gents
DeepSEGK: A Reconstruction7
DeepMe (feat. Remix)
Framework for Subspace (Dance of Resolutional Networks)
An Every of Localization Me Down (feat. A. Gradi)
Deep Sentiment of Character8
Semantic Segmentation in Semantic Segmentation
This was a lot of fun for me! People like Janelle Shane sharing experiments like these are what got me interested in text generation in the first place I hope you enjoyed this as well!
And shout out to the Austin middle school coding class who provided Shane with the original dataset of 1,600 ice cream flavors - sweeet! ↩
arXiv (pronounced like ‘archive’) has become the go-to open repository for the latest deep learning papers. The paper titles I used here were grabbed from the Brundage Bot collection of arXiv papers. ↩
The most surefire way my network found to create a mashup title was to add “remix” to the end. ↩
This reminded me of tracks that add “(original mix)” or “(original score)” to the end. ↩
Could also be a hipster band name. ↩
Live tracks too, huh? ↩
Nice album title as well IMO. ↩
The last two didn’t actually mix with song titles at all… but they still seemed musical to me. ↩