How did the major political parties choose their nominees prior to the introduction of the direct primary around the turn of the century?

The national chairman of the party chose them.

Party leaders chose them.

National conventions chose them in open votes.

Caucuses selected them.