A wire brush will probably cause more damage. I assume that there was a cement mortar applied there. To properly clean the stone, you usually have to remove material, that is, blast, grind, or carefully remove it by hand. I would use a sharpening stone, so not with a machine. It depends on how thick the mortar layer still is. We often glaze small remaining parts because otherwise too much of the stone would have to be taken away. Without photos, however, it is difficult to give a more precise recommendation.