The difference is night and day. Overall, the Mark II is at least three stops better in terms of high ISO noise. The AF is radically improved: it's not the fastest, but it's very accurate and works well in low light.
Obviously the leap in resolution is significant - you have to think much more carefully about aperture selection to avoid diffraction, and you will need the best (most expensive) lenses to exploit that resolution - but well handled Mark II captures are on a completely different level to the Mark I.
The screen is useable; the Mark I's isn't. Live View enables you to focus manually with absolute precision; it's completely hit-and-miss with the Mark I. I could go on . . .
Given the price difference between a used Mark I and a used Mark II, especially now we're well past the half-way point of its lifecycle - the Mark II is amazing value, especially compared to the nearest Nikon equivalent, or even the 1-Series Canons.