CO says, "I think I should reiterate my point in light of this more accurate information that the defacer essentially just caused damage to a period building, one not directly connected (in the non-physical sense) to the work of the missionaries."

This is incorrect, the building WAS part of the Mission's barracks, it was only later that it was used for other things.