In a large bowl, mash the cooked, cooled, and peeled sweet potatoes. Stir in sugar, butter, vanilla extract, milk, and eggs, and mix well.
Mix the brown sugar, flour, nuts, and butter together and spread evenly over the sweet potato mixture.