I have a low chill bartlett pear. It was 10 years old when I inherited it and it was a "pet". It produced one whole fruit a year. Two fruit would have been a bonus year. Once it got up to about 10 ft and 15 years old, it did start producing more fruit. It took me a while to figure out when to harvest them. Low chill fruit aren't all that good, so I still consider the tree a "pet".
Microclimate and pollination does affect fruiting. Just because a lot of the flowers drop, does not mean there is something wrong. Most fruit trees produce 2-4 times more male flowers than female flowers. They are only good for pollination and they drop. If your tree is stressed from drought, disease, lack of nutrition, or not enough sun, over pruning or pruning at the wrong time, you will see less flowering and fruiting. You do have to have minimum chill hours for your particular variety.
If your tree did produce a lot of fruit, it would drop some anyway. If too many fruit set, the trees will start dropping fruit it does not need and will only keep the ones it can support. It is called June drop here because that is when most of the fruit start falling. Apples, apricots, peaches usually also have to be culled if enough fruit does not drop on its own. Otherwise if there is not enough space or energy in the plant to support all the fruit, they will be small.
The time to take care of the tree is before it fruits. You need to make sure it has good growing conditions and a healthy canopy to support fruit. You cannot expect a small tree with a sparse canopy to be able to support a lot of fruit. Feed and water the tree as is recommended in your area.
https://baylaurelnursery.com/growing-fr ... kyard.html
Happy gardening in Hawaii. Gardens are where people grow.