Birds can be a problem. I have periodic population explosions of quail. They like ripe tomatoes.
It seems odd that deer will eat what we are told are toxic
plants but I have had some problems with them eating both tomato and potato plants - but not recently.
Mostly, it is weather problems and there have been very few really bad tomato years. With enough room and enough plants out there, I usually have enough ripe fruit to make me tomato-happy
One thing I have to remember is that if the weather beats up on the plants, they seem especially vulnerable to flea beetle attack ..! One, two punch. Oh, and the birds ... the chickadees are absolutely death on the horn worms. Plant some sunflowers for them. They will want to lay claim to those sunflowers months before there are any ripe seeds. Meanwhile, chickadee babies must be getting lots of caterpillars.