Add in fluff and beat for 2-3 minutes, then add in vanilla extract. The pies will pull away from the sides of the muffin cups. Prepare the batter: Mix the wet … Bake the pies for 25 to 30 minutes, or until browned and set. With the mixer on low speed, add in powdered sugar 1 … To make frosting: beat butter in the bowl of electric mixer until creamy. Spoon about 1/4 cup of the sweet potato mixture into each muffin cup. How do you make Sweet Potato Pie Cupcakes: Prepare the oven: Preheat it to 350 degrees Fahrenheit. Get your muffin pan and line it with cupcake liners. Tips & Storage: In order to make your own sweet potato puree, puncture a sweet potato all over with a fork and bake it on a foil-lined pan until it’s soft (400F for ~50 minutes).Then, let it cool for a few …