I am american and we do not take our shoes off in our house. The floors are hard wood and old (splinters! -ouch) And we burn wood so there is a lot of dust and wood scraps lying around for a majority of the year.
I do know some Americans who remove their shoes indoors.
I live in Japan now and find no problem removing my shoes in my or other peoples apartments as I love tatami mats.
The only issues I have are at the schools where I work. I visit 3 schools and don't have enough house slippers to go around. The slippers they provide are one-size-fits-small and simply not wide enough for me to wear (men's 9 1/2 extra wide!) nor supportive enough of my feet. Years of working standing up have taken their toll on my feet. And then they also have bathroom slippers for the restroom. The older ladies look aghast at me when I wear my indoor shoes to the restroom, but I cannot wear the slippers there at all. Nor can I buy any here that fit.
If anyone has a good idea I'm all ears.