What temperature zone do you live? If it is cold climate, you might be better off replacing the insert with a new one that looks better. Is the plan to burn wood?

I live in VA. In my prior house I had a real fireplace but had to put glass doors on it due to drafts and heat loss. In the new house, I have a Fireplace Xtrodinare wood burner insert with glass doors. Aside from looking great, this thing works as my backup heater and has no drafts - I love it.

If you are in a moderate to warm climate then you probably can get away without the insert. But before you pull it out, you should make sure that the hearth, mantle, and flue meet modern fire codes for an open wood burner.