This is symptomatic of a vacuum leak or a throttle plate that is not fully closed.

Check the vacuum lines and the PCV system. Also look for cracks in the intake tube and verify the throttle opens and closes cleanly.