The symptoms you are describing sound like the symptoms of GERD or similar illnesses. Since these can be exacerbated by stress(anger), that may be your answer.
Symptoms of GERD:
But it doesn't have to be this, it could be related to what you are doing while angry:
Shouting, talking or excessive mouth breathing can cause your mouth to dry out and due to the lack of saliva can cause your mouth to develop a sour taste and the excessive shouting or dry throat can cause the burning. Once again this could be related to stress.
The most likely reason is that stress causes your taste buds to
change. How they change differs from person to person, but there is
evidence that under periods of intense stress, a person's sense of
taste is altered with it.
Based on your symptoms it would probably be best if you consulted your doctor on the etiology of this problem.