I decided to give up on the peat pots and start over.
I don't know if they are the cause (probably) or what but all my sprouts shriveled up and died.
I'm starting over in recycled coffee cans and flower pots that I had lying around.
I'll post if I have any more issues!