In a small saucepan, combine the cocoa powder, sugar, water, milk, chocolate chips and Peeps on medium-low heat. Continuously stir until the chocolate and marshmallows are melted.
Pour into a mug and top with whipped cream and extra Peeps, if desired.