Jesus was angry at their hardness of heart. They were more concerned with Jesus working on the Sabbath than seeing the man get healed.

Source: Mark 3:1-5