In fact, if they had been thinking of the land that they had left, they would have had opportunity to return.
After being warned in a dream not to return to Herod, they went back by another route to their own country.