Hi, I've been to Japan and did the economy travel thing too.
Hostels are a good choice, I think there is a website that lists all the hostels in Japan with the ratings and prices. Be aware that in Japan, they charge by the person, not by the room.
In Osaka, I stayed in a sports arena...