The session authentication expires mid pipeline because the pipeline runtime is longer or behaves differently than the authentication system expects. This happens because
-
Scrapping jobs
-
ml/data pipelines
-
Notebook automation
-
Distributed workers
-
CI/CD jobs
-
Long running ETL systems
The most common reason is
Session cookie TTL expired
-
Session cookies
-
JWT’S
-
OAuth access tokens
Example :
Session valid for 60 minutes
Pipeline runs for 3 hours