Package still shipping after 4 days with EMS

When I track my package (bought via middleman) the latest update was
Dispatch from outward office of exchange
That was 4 days ago and nothing has changed, when I put the tracking number in the USPS site it says it hasn't even shipped. Not sure why this has happened, isn't EMS supposed to be very quick?
I paid double for shipping and this is what happens ;_;

As far as I know, that description indicates that it has been shipped by the sender in Japan, and that it has left Japan, and seems to indicate that the postal service on the receiving end (your country) has not scanned the parcel to update the status.

I don't know where you are, but in the past I have had a parcel sent from myself in Japan to a relative in the UK, and the status never got updated until after the recipient e-mailed me to say he received it.

Not unusual. My post to the UK generally takes a week to arrive & as @AK says sometimes the status doesnt get updated till after delivery.