To let the chips fall
To let the consequences affect your morale
Worry about your self-esteem
To feel depressed because you lack self-confidence
To not worry about the effects of your actions