It's your choice whether to take your husband's name, and if he had been Japanese, you get 6 months to make that choice. Ask the ward office or your embassy/consulate if the same applies to this situation.
As for any questions from immigration, just produce a copy of your marriage certificate.