Windows can be responsible for up to 25% of heat loss in the home. Single-paned windows are common in older homes, and lose a lot of heat.
Even double-glazed windows can lose a lot of heat if they are not properly installed. Cracks or gaps around the edges can easily let heat out, so checking these can be very useful, and are usually easy to fix.