I am currently working in Japan from the US and dealing with all of the fun tax issues right now. There are several tax related items that you should read over with a fine toothed comb before you make any assumptions.
The first one is for the Japanese taxes on foreign citizens. This can be found here:
http://www.japan-guide.com/e/e2206.html, with official links to both the Ministry of Finance and to the National Tax Agency appearing at the bottom.
The second one that you should read is the US IRS Publication 54, dealing exclusively with foreign earned income, found here:
http://www.irs.gov/publications/p54/index.html. I suggest that you find a tax professional to discuss your actual options before you go.
While you will not be taxed in both countries for all of your income it can be a pain to figure out which portion goes to whom.
Also you need to consider the foreign earned income exclusion carefully. I saw mention of it in an early post, but even if you meet the number of days out of the US requirement you may still not qualify. You must prove to the government that you have a "tax home" in Japan, or some other foreign country. The easiest way to prove this is to be able to say that your expected stay in the foreign country was to be longer than a year, even if it turned out to not last that long. You can get in to lots of trouble if you do not have documentation for this though. Taking this deduction from the US government may make you liable for paying taxes on your "world wide", not just your Japan earned, income to Japan, for that tax year though. Then you would not be responsible for paying taxes in the US.
In my case, since I worked in Japan for one year April-April, but can not claim a "tax home" in Japan, I do not fit the requirement for the tax exclusion. I am responsible for only partial taxes to both countries due to the tax agreement preventing double taxation though. I will pay taxes only on income earned in Japan to the Japanese government. I will pay taxes only on income earned in the US (and my other non-work related "world wide" income) to the US government.
Also keep in mind that if you are here for a period extending in to the next year you will have to file taxes in both countries for both years. In my case, I am here part in 2007 and part in 2008, so I will have to file taxes in both countries in 2008 and 2009.
I hope this helps you out some.