It is more fiscally responsible to tax and spend than to borrow and spend. Many local and state governments are required to have zero deficits.
If fiscal responsibility is a conservative goal, then it is conservative to tax and spend--with lots of restraint, though.
I agree that our military budget is much too large. I don't see a way out of this until we give up our Only Standing World Power status. Unfortunately, this has never happened voluntarily in history. It usually is accompanied with lots of internal and external war/strife.
I, too, would like to see a greatly shrunken federal government. We can start with the war on drugs, if only we can get off the addictive notion that all hell will break loose as a result. Then take away all manipulations of the free markets by the feds--dump corporate welfare. I could go on, but if any of us is really serious about shrinking the federal government, I'd suggest reading Harry Browne's book, "The Great Libertarian Offer." Although I'm not a member of the Libertarian party, I sympathize with a lot of the ideas Browne talks about.
There you go, Jaimie--a free plug