@danja@fosstodon.org
Castiglione di Garfagnana
Joined November 2006
- Tweets25.4K
- Following2.9K
- Followers2.1K
- Likes4.7K
I've been making a lot of digital audio workstation plugins recently, with lots of AI assistance. Just reached 100 in the main set so did a write-up of my process.
danny.ayers.name/entries/202…
Danny Ayers 🌳 retweeted
If you pretrain a large enough transformer on text files with the LLM weights (which are in abundance on Hugging Face and GitHub), it will learn to understand the meaning of and connection between the weights the same way it learned to understand the meaning of and the connection between words and elements of programming code.
If you then finetune this model on examples of editing such files, it will learn to edit these weights.
Transformer doesn't care about what's in a text file: Shakespeare, Linux, or Qwen. As long as there are tokens, it will learn to predict the next one.
Happy Halloween!
Most of the backing was created using Valis (Virtual Analog LLM Integrated System), link in the description.
youtu.be/KA5tIFHR0kI
Added another tune to the medieval bestiary-inspired collection : youtu.be/KfUnYG6-syA
JigDAW : a Web-native Digital Audio Plugin specification
danja.github.io/jigdaw/annou…
Danny Ayers 🌳 retweeted
This should ideally in a future iteration be fulfilled from a single graph query, but it does already nicely showcase benefits of the hybrid neurosymbolic approach:
Using ASIMOV, show me Semantic Web OGs from my LinkedIn connections
ALT "Using ASIMOV, show me Semantic Web OGs from my LinkedIn connections"
Valis : Virtual Analog LLM Integrated System
A standalone app and DAW plugin for building virtual analog circuits.
danja.github.io/valis/
First thing : a melodic electronic instrumental (so far), 140 BPM.
8 tracks as .wav files, public domain.
github.com/danja/stems#stems
I've been very amused by Claudisms recently. Notable exception - these blog posts, it's used something remarkably close to my own voice.
Many folks that type like me in the training data..? (yeah, and I too am in on the Anthropic copyright theft case).
danja.github.io/elfquake/blo…
Ok, @RueNahcMohr , Eurorack envelope shaper. Is now in the rack and basically works, though the controls are painfully interdependent. It's just lifted from data sheets. How would you have improved on it?
"something well-formed musically, but that no-one has heard before"
Generative VST plugins, via MCP
youtube.com/shorts/yVnNw1yiP…
Update on my earthquake prediction project.
tl;dr : The most useful results have been defects, not signals
danja.github.io/elfquake/blo…