Google now forces apps to use SAF with specific permission for each file.
If it is lost by SD card (or OEM), the apps can do nothing, but ask it again.
(for security, Google allows user only to initiate the process)
Something strange seems to happen in your device or workflow,
as I cannot reproduce it.
Or you took out the card and open the app,
or you connected the phone with pc and open the app?
(where the card was used by the pc)
See also a related report above: