The electrical panel also contains the converter. It converts 120 VAC to 12 VDC in order to charge the batteries and supply power to any DC system. This converter is a solid-state device that requires cooling when supplying DC. The fan is thermostatically operated depending on the temperature of the heat sink in the converter.
Thus charging batteries or supplying lights, pumps, furnace, refrigerator on 12V, and other DC accessories will place some demand on the converter. It is just doing its job.
Bob