Thanks for sharing, I’ve taken a look. Really cool project! I’m not able to reproduce the shrinking bug however I have a suspicion it’s related to performance.
Take a look at my reply on this thread here, and follow the steps regarding gltf.report to see if that helps.
