– In a large bowl, add milk, banana pudding, and vanilla pudding. Beat with a hand mixer just until the pudding starts to thicken. Immediately pour the pudding over the top of the cake and gently smooth it with the back of a spoon or spatula to help the pudding drip into the holes. Cover and refrigerate for at least 30 minutes or up to 24 hours.