Peach Leaf Curl

[boomshot]

I have 3 year old Nectarine the got a nasty curl on it this year, lots of fruit, but massive curl. I am fairly certain it is. My question is this, would it matter if I pulled every affected leaf off and disposed properly of?
Would that help the health of the tree and perhaps this summers fruit?

Thanks.