Okay so in reality you don’t complete the entire frame before starting anything else. It may be 90% complete after initial sorting and flipping of pieces, so there are gaps in the border through which you can move finished portions.
Additionally, I would typically keep most of the unsorted pieces outside the frame and then build portions inside the frame.