Today, the modelOutput for a Field Service Routing run doesn't contain any visits that are unassigned.
So, as a consumer of the results you need to cross-check with the input you gave the model to find them.
It would be easier if the output also contained the unassigned visits.