The air heat pump is very likely to be much lower in operating cost than baseboard electric. The heat pump will cost more to install initially, but also will provide air conditioning for the warmer season.

My husband put radiant heat in the floor of the basement under the main floor. The water is heated with propane going through the tankless water heater. It is a very inexpensive form of heat and also a very clean form since there is no moving air.

Our modular home came with a regular propane furnace that we used until we got the tubing put under the main floor and operating. Our modular was just set in January so things are taking more time than we thought. We put the radiant heat in the coach house (apt. with garage under it.) which we built ourselves. (We lived in that while we were building the basement for the modular to sit on.) We were very happy with the heating even in the coldest weather.

I don't know where you are located, but a heat pump is not real reliable in northern climates.

I have a friend that has a heat pump. And while he likes it I found it to be "cold". He told ne that when he wants the home to be 70 degrees, the air coming out of the vents is 70 degrees. I'm used to HEAT coming out of the vents at 120 degrees and shutting off when the room reaches the selected temp.
Have the newer heat pumps changed any?

When we lived in the Chicago area, we had a three story townhouse with a heat pump. When the outdoor temps reached the teens or lower, our heat wouldn't go above 55 degrees.

That was fine for overnight but not at all acceptable during the day. We had electric space heaters all over the place!

Systems must be properly designed and installed for satisfactory results. The Chicago system did not meet those criteria.