Unfortunately your not the only one with that mind set and thats clear with the dwindling crowds. And its not rocket science, that if "supporters" who dont buy a season ticket, and dont go, then thats less budget for signing quality players.
Last time we were in L1 12/13 for eg. We had 1738 home crowd against Alloa. Last weeks game against alloa we had 965. Thats 773, lets say some were Alloa fans, but thats still roughly 500 folk not turning up paying 18 quid and if thats average, it is around 162k over 18 games a season.
Yet yous wonder how the team have went backwards.