The Holy Spirit appeared in the New Testament in the form of a Dove.

Source:

Matthew 3:16, Mark 1:10, Luke 3:22, John 1:32