They left him behind because he got sick. David fed him and help restore his health.

Source:

1^st Samuel 30:11-16