Because of this question, I remembered that I read somewhere that some places or bars in Japan ask for your passport for identification (Old article, can't find it now).
Should I bring it with me everywhere I go in Japan?
Post-trip update :
I got checked in JR Shinagawa Station (in Tokyo). Good thing I had my passport with me.