The apostle was a tax collector. They were hated for working for the Roman government and notoriously corrupt.

Source: Luke 5:27-31 also many others