SourceTree constantly asking for password despite “Always Allow”

SourceTree seems to be forgetting that I hit “Always Allow” but still on every operation (fetch, pull, push) I have to enter my login credentials to macOS keychain.