If properly tuned, the EGR would actually provide better part throttle hp. Since you are saying it runs better without it, my guess is that the EGR parameters are too aggressive and affect engine performance negatively.
Does it cause a MIL to come on?