Then he said to them, “If you agree that I may bury my dead, then hear me out. Ask Ephron the son of Zohar

So Joseph went up to bury his father; all Pharaoh’s officials went with him – the senior courtiers of his household, all the senior officials of the land of Egypt,

After he buried his father, Joseph returned to Egypt, along with his brothers and all who had accompanied him to bury his father.