His sin was striking a rock twice to get it to bring for water for the people. He was supposed to stand befor it with his staff.

Source: Numbers 20:7-13