Yes, you are down to your core support just now. A struggling team in recent years and a lack of any real fanbase has culled most of the folk who were hapy to tag along and watch a winning side. And even though you have been doing well this season it looks like most of the hangers on that turned up to watch you when you went through the leagues can't really handle a downturn in fortunes. They are staying away and it's doubtful they will ever come back.
Livi are a much smaller club that Ayr Utd and Raith Rovers. Like I mentioned already, they are only really fit for part time football with the level of support they have. Ayr and Raith have lost support due to similar circumstances to Livi i.e.dreadful form over a few seasons and general depression surrounding the clubs. But make no mistake, if they got their act together they would both have pretty healthy first division sized supports. Livi just don't have that.