Should I talk to him about this?

Well if that bothers you so much then maybe you should bring it up. I can understand if you want some closure on this issue. Also probably the best way to ask him about this is to sit him down and ask him very kindly and to not yell at him.