Why not put a micro-size PC in there running MAX/MSP? The cool “organic” GUI could easily be done with MAX, You could have real-world I/O not just OSC.
The hardware is all available off the shelf, including the touchscreen:
Bonus: Extremely powerful real time audio processing is easily possible with MSP, and very powerful video processing can be done with the Jitter add on.
The audiopad is a great concept, now that is innovative.
It talks about how the objects are magnetically controlled. It reminds me of this new button control surface for the PC I was looking at. The panel had buttons you could arrange in any setup you would like, and you could produce strings and other types for simplifying your programs. If I can find it again I’ll post it.