How can i soothe my painfull now that i finished feeding after 8 months.?

I have slowly stopped feeding my 8month old son, i tried to make it as slow as poss as did`t want to rush him but at the same time i am a bit worried about feeding him still as he now has his bottom teeth!! and top ones are stating to show too, and some times unexpectedly he bites down Pretty hard when he feels like it! But any way he`s now on food but my are still producing alot of milk and feel quite hard, im worried i might end up with mastitis (sorry if spelt wrong) iv been temped to just let him have a little feed now and then just to empty them a bit. Please let me know if any one knows any tips regarding this, thank you!! xx