In the paper, the finite-time output regulation (FTOR) problem for a class of singular heterogeneous linear multi-agent systems (MASs) is investigated based on a proposed distributed observer approach. It is presumed that solely the children of the leader node are able to access the exosystem's state. The finite-time distributed observers over undirected graphs are designed to estimate the exact state of the leader node. Furthermore, the result is broadened to the directed case.