If you are saving them for seeds, or for spice wait until they are brown. Do not wait too long after that. The seeds will crack open and spill their contents, unless you want it to reseed. It will probably reseed twenty feet away.
Happy gardening in Hawaii. Gardens are where people grow.