The aggregation, arrangement and bonding together of a set of components to form mitochondrial respiratory chain complex I.