Generously spray the inside of a crock pot with cooking spray. In a large mixing bowl, mix together cake mix, sour cream, vegetable oil, water and eggs with a hand-held mixer until just combined. Stir in the pudding mix and chocolate chips with a spoon.
Pour mixture into the prepared crock pot. Sprinkle the cherries over top. Cook on high for 4 hours. Serve with ice cream.