Are they many?No, just a handful. You better research in advance. Oedo Onsen and LaQua are famous ones in Tokyo. Spa World in Osaka.
Is it possible to travel in Japan sleeping "the public bath way"?
Only if you overnight in cities that have such baths.