In a mixing bowl, combine the creamy peanut butter, softened butter, and vanilla extract.

Using an electric mixer, beat the mixture until smooth and creamy.

Gradually add the sifted powdered sugar, mixing until fully incorporated.

Add milk, one tablespoon at a time, until the desired consistency is reached.

Use immediately or store in an airtight container in the refrigerator.