Oh, yes, you're right!
There's one called ニ谷ニ耽ニ段ニ停?楪 ツ渉ャナスRツ渉、窶弭 (Katana-ya Koyama-shoten) along the Nakamise, a traditional Japanese shopping arcade stretching between the temple and the gate (Kaminari-mon).
It's on your left when walking from the big gate towards the temple (see the yellow star on the map shown in this map with a photo of the shop.)
Here's the page showing some of the swords they're handling.
I'm sure these are what OP is looking for.