I wonder if the sudden change in direction would be the bigger problem, as we no longer had the sun to orbit around.

This is a good question for Randall Monroe, if he hasn’t already addressed it.