Ran into a little bug messing around with vellum where it looks like pins are set to the cloth even though I have no pins set.
The way to fix is to go into vellum node and change “Mass: Calculate Varying” to “Mass: Unchanged”. That will unstick them.