Dive what is safe for you to dive.
As for some of the arguments against...
Custom Hoses - I didn't get any custom hoses actually for my inverted set. I did change a couple of hoses, but they were all 'off the shelf' ones.
Entanglement hazard - Rubbish! Diving with valves up and all those hoses exposed and ready to catch onto anything you swim through is more of a hazard than the clean base of inverted tanks. I have been entangled a number of times, and never has it been the valve guard, which keeps all the regs and hoses safe from entanglements and damage.
Shut Downs - Easy

Even with stages and reels hanging off the back of my waist band I have no problem.
The only 'real' problems I have found with inverts are when using RIBS a lot - which I do all the time.
I rest them on the base of the tanks, then have to swing them round every time before donning, which can be a problem on a small RIB.
Moving them about on the RIB and getting someone to help you don your set is awkward as you/they don't have a manifold of valve to hold onto to move or stabilise the set.
Also if you do a lot of shore diving and have nothing but rocks to rest your set on whilst kitting up, this can be a bit of a problem too.
I changed to inverts as my last suit wouldn't let me do shutdowns. I have a new suit so am trying to dive them valves up to save on the hassle on a RIB, but as yet I have not convinced myself that this is a good idea. I will try for a while longer and see how it goes, but Inverts are rather nice otherwise. The jury is still out whether I leave them valve up, or invert them again.
If you have the accuracy and skill of a stampeding elephant when going through openings in wrecks, rocks etc, then having the base of your cylinders forward and not the delicate regs is a real plus

Not that I know anything of this trim problem personally you understand
Oh, my valve guards are a couple of bits of 3mm stainless bent at right angles then fixed to the neck of the cylinders. They work and are cheap.
PM me if you want to discuss inverting your set.
.