Yes we use that phrase all the time. "Have you already been to Japan?", "Have you already been to the United States?" another way we would likely phrase the same idea is "Have you gone to ... yet/before?". For example "Have you gone to Japan before?", "Have you gone to Australia yet?". I hope this helps.