You have to do as your conscience dictates as we all have different levels of risk aversion.
I live a lawful life and I don't worry about my beliefs offending anyone, also my property has cameras, alarms, and attack cats (no seriously they'll bite your ankles).
But if you did get over your "issues" and put the sign up, if your neighbor did then come over to complain you could always hit her with your purse.
Sorry I'm just teasing and I understand your reticence. If you don't want people to know you support 2A then don't put it up. You don't owe anyone here anything either.
Me? Well, I'm going to but a sign up in clear view of my flags and my neighbors and the rest of the world can like it or not.
BTW Guess which one of these flags recent events have prompted me to consider taking down? I will give you a hint, it's not the yellow one.