There is more to Matsumoto than just the castle. Kyu Kaichi Gakko is Japan's first western style elementary school from the Meiji era. It's not a fancy palace-liked bldg. but worth a visit for a bit of interesting Japanese history. It's just 5 min. walk further north from the rear of the Castle.Coming back from the Castle towards the direction of the JR station and before crossing back the river on the left is Nawate Dori. It's a small alley with toy-like old fashion stores selling handicrafts to flowers and fruits. You may even find some antiques there as well. If I remember correctly, there is a stone frog sculpture at the entrance.
After the Nawate Dori, cross the river to the south bank and walk 1 block to Naka-machi district where you can find some unique photogenic restored kura storehouses. If you haven't been up north to Kitakata to see these houses, Matsumoto is the place for it.
There are also interesting side-trips that can be done from Matsumoto if you are staying there for a couple of days. 30 min by train followed by 15 min bike ride is scenic Daio Wasabi Farm, the largest wasabi farm in Japan. 80 min bus from Matsumoto is the Utsukushigahara Open-Air Museum which is similar but bigger that its sister museum in the Hakone area. Unfortunately you are visiting during the latter half of Nov. If you go before mid Nov., you can also take a day-trip to beautiful Kamikochi Valley.