These were found scuba diving with bottles from the 1850’s - 1920’s. The more I look, I think there just fishing weights. I have a musket ball that was found metal detecting, but it just doesn’t look the same.
Looks more like a fishing weight to me too, I don't remember ever seeing a musket ball like that. Fishing weight would make the most sense for being in the water as well.