'fine by me' vs. 'fine with me'?

'fine by me' vs. 'fine with me'?

A quick answer would be - not a lot. Both obviously mean I accept that/I agree with that. Possibly and maybe here I'm simply looking for a distinction, with me is more personal than by me.

If, say among friends, you agree to accept a plan/arrangement, you would say: That's fine with me.

If the government has agreed to raise taxes and you agree that this is acceptable, you would say; that's fine by me.