I think you’ve got a really interesting take on morality, but for me it really falls down on the biological level. Robert Sapolsky was the writer who convinced me, and his argument goes something like this: no neuron in the brain ever fires of its own accord - its always caused by something that we can agree is out of our control, namely our environment, upbringing, culture, genes, etc. Even if these don’t directly cause neurons to fire, then they create the factors which do - hormone secretion, what neural pathways form as our brains develop. And we can say that our consciousness is bounded by our material brains because of the changes to people who undergo lobotomies or similarly experience losses to parts of their brain, for example Phineas Gage. So, based on this, as our experience of consciousness is tied to the firing of neurons in our physical brains, and that is out of our control, we can say that we don’t truly have agency. This means that no one is ever truly free to make a decision or not, and that, to my mind at least, means it cannot have been their fault if they did something wrong.