The cadastral map.

In the beginning of Meiji period (1870's)  the New Japanese Meiji government made a start to compile Land register and Cadastral map across Japan.
The lot number of your ancestor's address information (domicile address) can indicate the place where your ancestor lived in on old cadastral map.
After getting the cadastral map we might locate the place on Google earth.