We had an extensive discussion on this unpleasant but "there it is anyway" fact of gardening life a few weeks ago at:
Many possible preventive measures were recommended; since you have (I think?) raised beds, some of them will be easier for you to implement than if your garden occupied all of a suburban back yard.
Please check that thread and then come here to ask questions which aren't answered and are specific to your situation. The OP's in that thread were in a similar situation: they have a fenced back yard, many neighbors' cats were helping themselves to the wonderful "kitty boxes," etc.
Cat waste can pose a hazard simply due to being waste to men, women, and children; toxoplasmosis isn't the only hazard, although it may be the best known.
I hope your gardening year picks up from this unfortunate point!
Happier gardening soon....
Sunset Zone 17, USDA Zone 9