They did not Jesus and his family had moved to a house by the time the wise men visited. This would have been months or even a year after Jesus birth./

Source:

Matthew 2:11