Microsoft CoPilot seems to think so.
Yes, you can get a replacement SIM card from Y!mobile in Japan and retain your old telephone number. When you return to Japan, you can visit a Y!mobile store or contact their customer support to request a new SIM card. Make sure to bring identification and any relevant account information to facilitate the process.