Preheat your oven to 350°F (175°C) and grease a loaf pan.
In a large bowl, cream together the sugar and butter until light and fluffy.
Add the eggs one at a time, mixing well after each addition.
Stir in the lemon zest and juice.
In another bowl, mix the flour, baking powder, and salt.
Gradually add the dry ingredients to the wet mixture, alternating with milk.
Mix until just combined; do not overmix.
Pour the batter into the prepared loaf pan.
Bake for 50-60 minutes or until a toothpick inserted in the center comes out clean.
Allow the loaf to cool in the pan for 10 minutes before transferring to a wire rack.