I like the wall color, very rich and warm and it looks very nice with your floor color. I might think about painting the brick fireplace area a little darker and more complimentary to the walls, something close to the rug color that shows in the pic would look very nice. That would tone down the look of your wall color.

I like the wall color but I see that the white FP wall gives a lot of contrast. Maybe you could paint the FP in a lighter shade of Dorset Gold? Adding some white to the paint color would lighten it.