Electric furnaces are easiest to replace and cost the least, while high-efficiency gas furnaces cost the most. A heat pump is a viable alternative to a furnace in many parts of North America ...