What train/bus passes for Kansai region?

Hi, I'll be in Osaka and travelling to Kobe, Arima onsens, Universal Studios, Kyoto, and Nara, over 10 days.

I was looking into the ICOCA card, but it seems that there are some exceptions which it cannot be used. I'm confused as to whether it covers the JR shinkansens. From my understanding it doesn't which brings into the question if I should really bother getting ICOCA, on top of the JR pass.

Here is my itinerary:
Arrive in KIX, immediately go to Kyoto.
Spend 2 nights in Kyoto, then one night in Arima.
Then another night at Universal Studios.
And then there will be day trips to Kobe and Nara in the remaining week.

Any suggestions for the travel options I have will be appreciated. Thanks!