Unknown background - dealing with triggers

My rescue is terrified of men with hats. Also brooms. Also trash bags. Basically random things trigger panic mode.

No idea what his history is but clearly something happened. How do I help him work through these fears?