Oh, yes, please. I'm with you there. I've been posting pictures of weeds here and begging for ID's (which many, many people have helped me with).
I tried very hard to plant in regular patterns in my beds, which helps. I figure if I have a neat pattern of seedlings where I know I planted my seeds, it's probably my baby veggies. And I mapped my beds obsessively. But I still don't know what's what for a while if my plant doesn't come up at all! I recently probably killed some peppers when I replanted tomatoes in that bed -- I thought they weren't making, then several came up shortly after I dug big fat holes where some of my peppers would have been for the tomatoes (by this time, I could ID the peppers because I'd also given up and bought some pepper seedlings). Good luck!