Banks are so uptight I couldn'y imagine them allowing that on the machine....but I googled and apparently you can. It may depend on the bank, though.
SMBC, for example, says to look for 暗証番号変更 or 各種サービス
Get a teller to help you do this. You don't want to take a chance messing this up. This is one of those few things in life here you don't want to use as a learning experience.