Interesting thread. I've had similar conundrums, once owning a fair amount of considerably expensive Naim kit when I lived in a small London flat. Not as much as you quoted, but over 30k from memory. It felt excessive and overly complex for low-level listening in a modestly sized room.
I hit the reset button and went down the Devialet route and Harbeth. Simpler, 'lighter', less fuss, more enjoyment. I since moved home and have a bit more space, and a bit more of an itch here and there so I have ended up with bigger Harbeths, a valve amp, a DAC, a mac... it sounds wonderful and I get daily enjoyment from it, but it's about as 'complex' as I want it. I do sometimes think about simplifying further as I only play digital. Convenience and 'ease of play' are key for me.
I found in the past that the more gear I have (and the higher end it gets), the more I find myself listening to that gear, and it's less about the music. I agree with an earlier comment that possessions can own you, especially with hobbies / interests as it's easy to become very immersed in the kit.
Have you read 'Goodbye Things' on Penguin? Minimalism, for many people, is an extreme way of life but a little dose of it certainly gets you thinking and defining what's important to you. I liked an example where one minimalist had lost all of their home entertainment and only kept their piano. Steve Jobs famously photographed with no furniture, but only his hi-fi. It's ok to be maximal in some ways, and minimalist with others. Whatever suits. But, if things are weighing me down, and not maximising enjoyment, I always feel better with a bit of a reset.