Ora et Labora
When do I get my clergymen back in the short game?
The rulebook says so.
- Ora et Labora rulebook · Rulebook · The Short Multiplayer Game
Each player has only 1 prior and 1 lay brother, so at the start of each round you take them back if both are on buildings.