Again, i'm just sharing the basic idea of it so you know it can be done and implement it in your patches if you wanted to, with some creativity and good knob adn GUI design it could look awesome. I'm sure it has limitations but something is something.
Edit the responsiveness with the decay knob in peak controller.
You could recalibrate the input scaling with some formula controller or fruity x y z controller, but you already know all of that!