In a mixing bowl whisk together powdered sugar, melted butter, lemon juice or almond extract, vanilla and 4 Tbsp milk until smooth, adding in more milk 1 tsp at a time to thin as needed (you don't want it to be very thin, it should be quite a bit thicker than a doughnut glaze).