Older houses burn oil for heating the house and water but even most of them have heatpumps installed. New houses usually also have heatpumps or geothermal so direct electric heating is more and more uncommon. Apartment buildings generally all have district heating and even some private homes do.

Yes it’s expensive but so is everything else too. Our houses are way better insulated than in most places though so that helps a little.