My workshop is in the corner of an ungerground parking lot. It will be
impossible to get all the dust out. How much do I need to worry about it?

Try setting up a temporary wall of clear poly to keep out dust until you've finished - sort of like a paint booth.