Yeah, if they are large enough seeds to retrieve easily, might be worth doing. The trouble with peat based potting soils is that until the peat is well moistened, it tends to shed water (like a dry sponge), so even though you are watering, none is being taken up.
I had one square of cells (9 cells) that I transplanted basil seedlings in to that I managed to forget to moisten first. Man, that dry peat just sucked the life out of those little seedlings, despite watering afterwards. They just shrivelled up and died. Fortunately, I had a lot more besides those, but it was instructive to watch.