Oneo f the facets you mentioned about upsetting the “security” of the Asian communities, is that Black People have learned that keeping our heads down, and not trying to draw attention to ourselves, will still end in death for too many of us. It does us no good to keep quiet, or dress well, or be “respectable”. We can still be terrorized by the police, no matter what we do.
Even if we just stay home, the police think nothing of bursting into our homes, to kill us for no reason.
I understand the dynamic of not wanting to draw attention to your communities, but that won’t save you from white peoples wrath, whenever they need a new scapegoat.