A very good point. For example, nearly half of the Department of Energy's budget is devoted to running the military's nuclear program -- warheads, submarines, etc.
Of course the US should have a strong defense, but this doesn't mean we have to write blank checks to military contractors either.