To put it in the simplest terms, oversampling is a form of digital feedback.
This is entirely wrong.
Sorry.
The correct replay of sampled audio requires a reconstruction low-pass filter after the conversion to analogue.
The sampling theorem, in all its beauty, prescribes a particular type of filter: Sinc(x).
The job of the Sinc filter is to remove the raw staircase output of the DAC, turning it into a fluid and continuous signal
exactly identical to the band-limited signal that was sampled during recording.
This filter cannot be realised in the analogue domain.
However, oversampling the original data allows to implement this filter (largely) in the digital domain, where it is feasible to arbitrary accuracy (this is simply an engineering problem). After this the signal is converted to analogue and a mild analogue filter completes the process.
Turning this oversampling with digital reconstruction filtering off allows the signal's ultrasonic images ('images', emphatically not 'aliases') which correspond to the staircase steps to pass on to the rest of the system. It is then up to your speakers and ultimately your ears to provide the reconstruction filtering and reject the images. Which they will, being hard-limited to 12-20kHz depending on your age. All of this may sound
different, it is also demonstrably less
accurate. But then a turntable also isn't very accurate, and many people like its sound (perhaps for very valid reasons).
The terms oversampling/upsampling also are used in the context of ADCs and of delta-sigma modulation, where they mean somewhat different but conceptually related things.