Repeatable login failure this morning

The attached is what I get repeatedly trying to start a server this morning. I’m on Chrome 138.0.7204.101. All I did was click ‘start’ with the default env and cpus.

@Tess_Jaffe - We are looking into this.

I was able to log in a few hours later FWIW. But not now.

This is an issue with what’s running after the notebook container has started but before the user is presented the Launcher; I believe that these are taking more than 30 seconds and causing the notebook to fail to start.

Entered start.sh with args: jupyterhub-singleuser                                                                                                                                                                                                                │
│ Running hooks in: /usr/local/bin/start-notebook.d as uid: 1000 gid: 100                                                                                                                                                                                          │
│ Sourcing shell script: /usr/local/bin/start-notebook.d/10activate-conda-env.sh                                                                                                                                                                                   │
│ Done running hooks in: /usr/local/bin/start-notebook.d                                                                                                                                                                                                           │
│ Running hooks in: /usr/local/bin/before-notebook.d as uid: 1000 gid: 100                                                                                                                                                                                         │
│ Sourcing shell script: /usr/local/bin/before-notebook.d/10-set-default-env.sh                                                                                                                                                                                    │
│ Sourcing shell script: /usr/local/bin/before-notebook.d/20-pre-notebook.sh                                                                                                                                                                                       │
│ Cloning the notebooks to /opt/notebooks ...                                                                                                                                                                                                                      │
│ $ git fetch                                                                                                                                                                                                                                                      │
│                                                                                                                                                                                                                                                                  │
│ $ git reset --mixed                                                                                                                                                                                                                                              │
│                                                                                                                                                                                                                                                                  │
│ $ git -c user.email=nbgitpuller@nbgitpuller.link -c user.name=nbgitpuller merge -Xours origin/main                                                                                                                                                               │
│                                                                                                                                                                                                                                                                  │
│ Already up to date.                                                                                                                                                                                                                                              │
│                                                                                                                                                                                                                                                                  │
│ $ git fetch                                                                                                                                                                                                                                                      │
│                                                                                                                                                                                                                                                                  │
│ $ git reset --mixed                                                                                                                                                                                                                                              │
│                                                                                                                                                                                                                                                                  │
│ $ git -c user.email=nbgitpuller@nbgitpuller.link -c user.name=nbgitpuller merge -Xours origin/main                                                                                                                                                               │
│                                                                                                                                                                                                                                                                  │
│ Already up to date.                                                                                                                                                                                                                                              │
│                                                                                                                                                                                                                                                                  │
│   py-multiband_photometry      /opt/conda/share/jupyter/kernels/py-multiband_photometry                                                                                                                                                                          │
│ [jupytext] Reading forced_photometry/multiband_photometry.md in format md                                                                                                                                                                                        │
│ [jupytext] Setting kernel py-multiband_photometry                                                                                                                                                                                                                │
│ [jupytext] Updating notebook metadata with '{"kernelspec": {"name": "py-multiband_photometry", "language": "python", "display_name": "py-multiband_photometry"}}'                                                                                                │
│ [jupytext] Writing forced_photometry/multiband_photometry.md in format md:myst                                                                                                                                                                                   │
│ [jupytext] Reading light_curves/light_curve_generator.md in format md                                                                                                                                                                                            │
│ [jupytext] Setting kernel py-light_curve_generator
│ [jupytext] Updating notebook metadata with '{"kernelspec": {"name": "py-light_curve_generator", "language": "python", "display_name": "py-light_curve_generator"}}'                                                                                              │
│ [jupytext] Writing light_curves/light_curve_generator.md in format md:myst                                                                                                                                                                                       │
│ [jupytext] Reading light_curves/light_curve_classifier.md in format md                                                                                                                                                                                           │
│ [jupytext] Setting kernel py-light_curve_classifier                                                                                                                                                                                                              │
│ [jupytext] Updating notebook metadata with '{"kernelspec": {"name": "py-light_curve_classifier", "language": "python", "display_name": "py-light_curve_classifier"}}'                                                                                            │
│ [jupytext] Writing light_curves/light_curve_classifier.md in format md:myst                                                                                                                                                                                      │
│ [jupytext] Reading light_curves/ML_AGNzoo.md in format md                                                                                                                                                                                                        │
│ [jupytext] Setting kernel py-ml_agnzoo                                                                                                                                                                                                                           │
│ [jupytext] Updating notebook metadata with '{"kernelspec": {"name": "py-ml_agnzoo", "language": "python", "display_name": "py-ml_agnzoo"}}'                                                                                                                      │
│ [jupytext] Writing light_curves/ML_AGNzoo.md in format md:myst                                                                                                                                                                                                   │
│ [jupytext] Reading light_curves/scale_up.md in format md                                                                                                                                                                                                         │
│ [jupytext] Setting kernel py-scale_up                                                                                                                                                                                                                            │
│ [jupytext] Updating notebook metadata with '{"kernelspec": {"name": "py-scale_up", "language": "python", "display_name": "py-scale_up"}}'                                                                                                                        │
│ [jupytext] Writing light_curves/scale_up.md in format md:myst                                                                                                                                                                                                    │
│ [jupytext] Reading spectroscopy/spectra_generator.md in format md                                                                                                                                                                                                │
│ [jupytext] Setting kernel py-spectra_generator                                                                                                                                                                                                                   │
│ [jupytext] Updating notebook metadata with '{"kernelspec": {"name": "py-spectra_generator", "language": "python", "display_name": "py-spectra_generator"}}'                                                                                                      │
│ [jupytext] Writing spectroscopy/spectra_generator.md in format md:myst                                                                                                                                                                                           │
│ Done running hooks in: /usr/local/bin/before-notebook.d                                                                                                                                                                                                          │
│ Executing the command: jupyterhub-singleuser
 [I 2025-07-11 19:39:36.664 ServerApp] Extension package dask_labextension took 0.8594s to import                                                                                                                                                                 │
│ [W 2025-07-11 19:39:36.664 ServerApp] A `_jupyter_server_extension_points` function was not found in dask_labextension. Instead, a `_jupyter_server_extension_paths` function was found and will be used for now. This function name will be deprecated in futur │
│ [I 2025-07-11 19:39:36.899 ServerApp] Extension package jupyterlab took 0.1844s to import                                                                                                                                                                        │
│ [I 2025-07-11 19:39:38.622 ServerApp] Extension package jupyterlab_jupytext took 0.1267s to import                                                                                                                                                               │
│ [I 2025-07-11 19:39:38.645 ServerApp] dask_labextension | extension was successfully linked.                                                                                                                                                                     │
│ [I 2025-07-11 19:39:38.646 ServerApp] jupyter_cpu_alive | extension was successfully linked.                                                                                                                                                                     │
│ [I 2025-07-11 19:39:38.646 ServerApp] jupyter_keepalive | extension was successfully linked.                                                                                                                                                                     │
│ [I 2025-07-11 19:39:38.647 ServerApp] jupyter_lsp | extension was successfully linked.                                                                                                                                                                           │
│ [I 2025-07-11 19:39:38.647 ServerApp] jupyter_resource_usage | extension was successfully linked.                                                                                                                                                                │
│ [I 2025-07-11 19:39:38.664 ServerApp] jupyter_server_mathjax | extension was successfully linked.                                                                                                                                                                │
│ [I 2025-07-11 19:39:38.664 ServerApp] jupyter_server_proxy | extension was successfully linked.                                                                                                                                                                  │
│ [I 2025-07-11 19:39:38.676 ServerApp] jupyter_server_terminals | extension was successfully linked.                                                                                                                                                              │
│ [I 2025-07-11 19:39:38.677 JupyterHubSingleUser] Starting jupyterhub single-user server extension version 5.2.1                                                                                                                                                  │
│ [I 2025-07-11 19:39:38.678 JupyterHubSingleUser] Using default url from server extension lab: /lab                                                                                                                                                               │
│ [I 2025-07-11 19:39:38.691 ServerApp] jupyterhub | extension was successfully linked.                                                                                                                                                                            │
│ [W 2025-07-11 19:39:38.702 LabApp] 'extra_template_paths' was found in both NotebookApp and ServerApp. This is likely a recent change. This config will only be set in NotebookApp. Please check if you should also config these traits in ServerApp for your pu │
│ [I 2025-07-11 19:39:38.714 ServerApp] jupyterlab | extension was successfully linked.                                                                                                                                                                            │
│ [I 2025-07-11 19:39:38.714 ServerApp] jupyterlab_git | extension was successfully linked.                                                                                                                                                                        │
│ [I 2025-07-11 19:39:38.714 ServerApp] jupyterlab_jupytext | extension was successfully linked.                                                                                                                                                                   │
│ [I 2025-07-11 19:39:38.714 ServerApp] jupyterlab_myst | extension was successfully linked.                                                                                                                                                                       │
│ [I 2025-07-11 19:39:38.715 ServerApp] nbdime | extension was successfully linked.                                                                                                                                                                                │
│ [I 2025-07-11 19:39:38.715 ServerApp] nbgitpuller | extension was successfully linked.                                                                                                                                                                           │
│ [W 2025-07-11 19:39:38.721 JupyterNotebookApp] 'extra_template_paths' was found in both NotebookApp and ServerApp. This is likely a recent change. This config will only be set in NotebookApp. Please check if you should also config these traits in ServerApp │
│ [I 2025-07-11 19:39:38.733 ServerApp] notebook | extension was successfully linked.                                                                                                                                                                              │
│ [I 2025-07-11 19:39:39.341 ServerApp] notebook_shim | extension was successfully linked.                                                                                                                                                                         │
│ [I 2025-07-11 19:39:39.393 ServerApp] notebook_shim | extension was successfully loaded.                                                                                                                                                                         │
│ [I 2025-07-11 19:39:39.395 ServerApp] dask_labextension | extension was successfully loaded.                                                                                                                                                                     │
│ [I 2025-07-11 19:39:39.396 ServerApp] jupyter_cpu_alive starting with: percent_min: 70.0, interval: 300.0                                                                                                                                                        │
│ [I 2025-07-11 19:39:39.396 ServerApp] jupyter_cpu_alive | extension was successfully loaded.