They found him at a house. Mary and Joseph had left the stable by then.

Source: Matthew 2:21-35