It depends on the system. Some heating options have minimal visual and physical impact on the building. Infrared heaters mount on walls or ceilings and need only an electrical connection. Panel heaters and storage heaters are similarly straightforward.
Heat pumps need an external unit, which may need planning permission and faculty consent depending on its size and location. Underfloor heating requires lifting the floor, which in a listed building can trigger archaeological requirements and significant additional cost. Gas systems need a flue, which creates a penetration through the building fabric.
The Diocesan Advisory Committee will want to know that you have considered the impact on the building's character and significance. A well-prepared proposal that demonstrates minimal harm and clear benefit is much more likely to receive support.