I shot 3 deer opening day of early MZ here in Maryland. I shoot Rem inline 700ML 54 cal, 110 grs of triple 7 loose. The 325gr flex tip is a monster of a bullet out my my gun. I have shot 4 deer with it and none of them have stopped one yet. Thru and thru from any angle. One of the does had about 14 inches of her spine pulverized by the Hornady. It entered her front shoulder and exited her off side hind quater. probably more then needed but it shoots well from my rifle. Hard to load due the 458, size but worth the effort. 2 does in the morning and a 8pt. buck in the evening. This bullet/powder combo gives two hole every time. I have heard complaints about it at high speeds from 458 win mag and some 45-70 shoots. But is a death ray from a smoke pole.
I've been using the .458 325gr FTX for the last couple years with great success, it's been a very good long range bullet for me out of my ML10-II.
If the .458 is loading hard for you in your 54 then maybe you might want to look at trying a different sabot, I'm loading them in a 50cal with no trouble at all.