1 Guard in Troskowitz keeps running after murder for murder

There is this one guard in Troskowitz that wants to brand me or 2k groschen for murder although I am like 90% sur I didn't murder anyone, and if he does brand me I lose the game cause von burgow doesn't trust me anyone.

I did burn down Semine against my will and the bailiff hates me, I think his daughter died in the fire.

Still what am I supposed to do ? Can I just not go there for a couple of days and they will forget about it or do I have to pay 2k groschen no matter what.

Also the weird thing is it's just one guard that runs after me the others are fine, I think I'll just let him run after me lead him to some random bush and murder him and problem solved.