The past tense of keep a rein on is kept a rein on.
The third-person singular simple present indicative form of keep a rein on is keeps a rein on.
The present participle of keep a rein on is keeping a rein on.
The past participle of keep a rein on is kept a rein on.