" the soil is very dirty"

I sort of thought it was in the nature of soil to be dirty ?
You said "late spring." but you are in LA, zone 10 with very hot dry summers. Your best planting time is NOW (like actually last month). I think Punk is in zone 10, with you, so can maybe say more about planting times.
But you need to look for heat resistant tomato varieties (they usually have names like SunMaster, Solar Flare, etc,). Buy well started transplants from a good nursery (not a big box) and get them planted right away. Peppers too. For you strawberries would actually have been better planted in Dec-Jan, but you can still give them a try. Blueberries, be sure you get the Southern highbush varieties. Northern blueberries need more cold in the winter than you have.
Tomatoes & peppers in containers in your climate will need to be watered every day, maybe twice a day in heat of summer. Since all that watering means you will be flushing nutrients out of the soil, they will also need to be fertilized regularly. They will benefit from some protection from hot afternoon sun. But the point of getting them started now is that you can expect fruit production to slow down or stop in the heat of summer. If you have cared for them really well, they will pick up again when it cools down. Otherwise you might need to start over with new plants in Aug/Sept.