The problem with worm logic is the misconception that if worm castings are good then they must be better than the alternative (compost). If you are composting to get rid of organic waste worms are great, especially if you have a use for the worms, but if you are composting to produce maximal organic ammendment for your soil they act against the purpose.
Compost is perfectly good soil ammendment without being turned into worm castings. With worm-filled compost you are trading off the greater part of the organic soil ammendment end product for organic worm flesh. Plus, even if you did grind up the worms to fertilize your garden soil there is a large loss of energy/organicc matter in the process. It's the basic biology energy-trophic pyramid of energy loss (organic matter = carbon compounds, carbon compounds = chemical energy). You get more carbon/energy by eating the grain than you do by eating the flesh of the cows that you fed the grain to, and in the case of worms you are not even using the worms. The microbial breakdown process of compost gives about a 40% yield of stable organic matter for soil ammendment, i.e 60% of the matter is respired away by the microbial growth process. Add worms to that and they are eating that 40%, turning it into more/bigger worms. Worms, like all animals, have a high protein content, proteins are the single most nitrogen rich biological molecules making up a body, so those worms are robbing the compost of nitrogen, not adding to it.
Those sponge like larger bits of decaying plant matter in your compost hold moisture in sandy soil and separate particles of clay, and thus aerate the soil when mixed in. So it does not need to be turned into fine grained worm poop to benefit your soil.
Worm-free compost, once incorporated into your garden, will feed the populations of your native soil worm species (not red wiggler compost worms). The soil worms will then benefit your garden by burrowing and mixing the soil, which is especially good if you are using no-till methods.
Are worm castings good soil ammendment? Sure, if someone offers you a truck load take it, but if someone offered me 2X as much finished compost from the same amount of raw material I would choose that instead.