According to Psalms we are to come into his presence with thanksgiving.

Source:

Psalm 95:2 Psalm 100:4