You won't lose out on most Leica and Voightlander glass, but it is difficult to go cheap. The reality is that whereas you will generally get your money back, and sometimes make a nice profit, the cost is the holding cost of the money invested.
I'm not a fan of the fast Voightlanders, as optically they're not really up to the job. At 35mm the 35/f2.5 Color Skopar is a very good lens and small, the Zeiss 35/f2 and f2.8 much better but heavier. On an M8 or M9 you just haver to deal with the light as best you can given the poor ISO performance.
I built up a set of lenses over years, fairly typical, my regulars are a 90/f2.8 that I got for £300 off eBay, a 50/f1.4 that was £2,000, has been that price for years and you will never lose money on and a 28/f5.6 that is a quirky lens that is great fun and surprisingly good optics. I have various others and share with my son, but there is no getting around the fact that you have to make the investment. They do work well on Fujifilm and Sony.
https://live.staticflickr.com/65535/50265461527_0218783be9_c.jpg