Sammy (@pleasewaterme) over at WWC linked the above video in an email titled "for the office", and it tickled the right spots in my head.
Figured it was the perfect time to play around with a bit of rigid body physics (conveniently handled well by matter.js). Next steps are figuring out how to do hand tracking with cheap equipment (webcam?) so that we can get this thing up onto a wall. Possibly going the route of using a kinect/vive instead of a webcam.
Click the image below to play around with it for a bit (not mobile friendly). Click and drag to throw things around. Or hold down shift + click and drag to draw a circle (emulating the two hand zoom gesture from the video).