My take on your situation is this. Now this is my opinion as there are many mind you.
I think plants that small should have all flowers/buds removed. At this stage of the game you want your plants to establish a healthy root system that will take them through the coming month's. When a plant is in a flowering stage it is using it's energy to produce flowers and not roots. This is a critical time in their life, they need to make roots much more than they need to make flowers and fruit that the plant may not be able to accommodate due to ti's small size.
It sounds to me that you have some decent soil and weather due to their onslaught of growth. But with the low temps coming you were talking about is even more reason to protect them and keep them roots growing. Without a good root system no plant will do any good.
My 2 cents.