Intriguingly, conducting perovskite interfaces between ordinary band insulators are widely explored, whereas similar interfaces with Mott insulators are still not quite understood. Here, we address the (001), (110), and (111) interfaces between the LaTiO3 Mott, and large band gap KTaO3 insulators. Based on first-principles calculations, we reveal a mechanism of interfacial conductivity, which is distinct from a formerly studied one applicable to interfaces between polar wideband insulators.