Another Fuji addict - I have an XE1, a X100 and a X10 - being an indecisive sort.
If I had to rescue one from the proverbial fire it would be the X100 and I am wondering if it's all I need.
The XE1 is a lovely camera, now a real bargain on sites like MPB photographic. I tried both the XE1 and the X pro and found the XE1 felt better in my hand , just a tad more compact.
The OVF/EVF wasn't and issue and I find I rarely use the OVF on the X100.
Given surest prices, I'd go for the XE1, get some extra lenses (35 + one other prime) and then thing about upgrading in a few versions time. It's a great value body at current prices and the you can collect lenses before doing a body upgrade in year or so if you feel you need it.
Kevin