Yes, you'd treat the 24V DC supply from a printer PSU in the same way as the 24V DC supply from the battery. However, this cheap switch mode power supply is not designed to supply audio circuits and I'd be very surprised if you got results you'd be happy with.
However, batteries are a great power source for audio circuits, still used quite often in good simple designs. They're not used more frequently because of their inconvenience. And there's no need to regulate the output from a battery either, it'll add nothing.
EDIT
There are three common types of power supply.
1. Battery
2. Linear. Transformer + Rectifier(s) + Regulator(s). e.g SNAPS. HiCap, etc.
3. Switched Mode Power Supply (SMPS). These circuits are not commonly used in audio, but now very common in household applies (printer PSU, etc.)
1 is always simple.
2 is usually relatively simple, but costs increase with capacity and quality of components used.
3 is nearly always quite complex, with cheaper designs being noisy.