Preheat the oven to 325 degrees F (165 degrees C). Grease and flour a 9x5 inch loaf pan.

Combine the milk and lavender in a small saucepan over medium heat. Heat to a simmer, then remove from heat, and allow to cool slightly.

In a medium bowl, cream together the butter and sugar until smooth. Beat in the egg until the mixture is light and fluffy. Combine the flour, baking powder, and salt; stir into the creamed mixture alternately with the milk and lavender until just blended. Pour into the prepared pan.

Bake for 50 minutes in the preheated oven, or until a wooden pick inserted into the crown of the loaf comes out clean. Cool in the pan on a wire rack.