That seems like a very backwards way to talk about “rights”. They don’t have the right to infringe upon the rights of others, which is the reason they face legal consequences for doing so.

It’d be like me saying “I have the right to kill indiscriminately, and the state has the right to punish me for it,” instead of simply “I don’t have the right to kill indiscriminately.”