Answer:
We drove to the doctor's office only to find out that they were closed for the day.
Explanation:
Remote reference happens when a pronoun is used to indicate something that was previously mentioned.
From the given sentence, there is no need to rewrite because it is easily understood.