When I was remodeling a couple of years ago, the price of my panel-ready SZ French door was about $800 or so less than the same model in stainless. So it might be a wash, depending on the line of cabinets you are using. The panels are clearly pricey, and they have to be installed separately, but you should save by not getting a stainless fridge.

My Thermador was also less expensive in "panel ready" than it was in stainless, unfortunately I do not remember what we paid for the panels. Don't forget the cost of installation, unless you're DIY - it took our contractor the better part of a day to do our fridge surround and panels.

As the others said, it's usually about a wash depending on how ornate your panels are. I know with a dishwasher, it can even be less with a panel vs stainless.
Remember you will need to add your own appliance pulls, which can be pricey....

Slightly over a thousand for custom panels (simple shaker) and 2 pulls.
Not counting the fridge cost.
Custom cabinetmaker

By comparison paneled dw was $175 for the installed panels.