2025-12-11 09:51:27,050 - distributed.worker.memory - WARNING - Worker is at 59% memory usage. Resuming worker. Process memory: 41.34 GiB -- Worker memory limit: 70.00 GiB

2025-12-11 09:51:25,621 - distributed.worker.memory - WARNING - Worker is at 60% memory usage. Pausing worker. Process memory: 42.03 GiB -- Worker memory limit: 70.00 GiB

2025-12-11 09:51:03,088 - distributed.worker.memory - WARNING - Worker is at 59% memory usage. Resuming worker. Process memory: 41.37 GiB -- Worker memory limit: 70.00 GiB

2025-12-11 09:51:01,623 - distributed.worker.memory - WARNING - Worker is at 60% memory usage. Pausing worker. Process memory: 42.05 GiB -- Worker memory limit: 70.00 GiB

2025-12-11 09:50:43,474 - distributed.worker.memory - WARNING - Worker is at 59% memory usage. Resuming worker. Process memory: 41.40 GiB -- Worker memory limit: 70.00 GiB

2025-12-11 09:50:42,046 - distributed.worker.memory - WARNING - Worker is at 60% memory usage. Pausing worker. Process memory: 42.08 GiB -- Worker memory limit: 70.00 GiB

2025-12-11 09:50:24,710 - distributed.worker.memory - WARNING - Worker is at 59% memory usage. Resuming worker. Process memory: 41.40 GiB -- Worker memory limit: 70.00 GiB

2025-12-11 09:50:23,406 - distributed.worker.memory - WARNING - Worker is at 60% memory usage. Pausing worker. Process memory: 42.07 GiB -- Worker memory limit: 70.00 GiB

2025-12-11 09:50:08,108 - distributed.worker.memory - WARNING - Worker is at 59% memory usage. Resuming worker. Process memory: 41.44 GiB -- Worker memory limit: 70.00 GiB

2025-12-11 09:50:06,512 - distributed.worker.memory - WARNING - Worker is at 60% memory usage. Pausing worker. Process memory: 42.11 GiB -- Worker memory limit: 70.00 GiB

2025-12-11 09:49:50,473 - distributed.worker.memory - WARNING - Worker is at 59% memory usage. Resuming worker. Process memory: 41.44 GiB -- Worker memory limit: 70.00 GiB

2025-12-11 09:49:49,698 - distributed.worker.memory - WARNING - Worker is at 60% memory usage. Pausing worker. Process memory: 42.09 GiB -- Worker memory limit: 70.00 GiB

2025-12-11 09:49:37,131 - distributed.worker.memory - WARNING - Worker is at 59% memory usage. Resuming worker. Process memory: 41.44 GiB -- Worker memory limit: 70.00 GiB

2025-12-11 09:49:35,736 - distributed.worker.memory - WARNING - Worker is at 60% memory usage. Pausing worker. Process memory: 42.09 GiB -- Worker memory limit: 70.00 GiB

2025-12-11 09:49:19,073 - distributed.worker.memory - WARNING - Worker is at 59% memory usage. Resuming worker. Process memory: 41.44 GiB -- Worker memory limit: 70.00 GiB

2025-12-11 09:49:17,783 - distributed.worker.memory - WARNING - Worker is at 60% memory usage. Pausing worker. Process memory: 42.10 GiB -- Worker memory limit: 70.00 GiB

2025-12-11 09:49:02,189 - distributed.worker.memory - WARNING - Worker is at 59% memory usage. Resuming worker. Process memory: 41.41 GiB -- Worker memory limit: 70.00 GiB

2025-12-11 09:49:00,267 - distributed.worker.memory - WARNING - Worker is at 60% memory usage. Pausing worker. Process memory: 42.07 GiB -- Worker memory limit: 70.00 GiB

2025-12-11 09:48:42,970 - distributed.worker.memory - WARNING - Worker is at 59% memory usage. Resuming worker. Process memory: 41.45 GiB -- Worker memory limit: 70.00 GiB

2025-12-11 09:48:42,037 - distributed.worker.memory - WARNING - Worker is at 60% memory usage. Pausing worker. Process memory: 42.10 GiB -- Worker memory limit: 70.00 GiB

2025-12-11 09:48:31,766 - distributed.worker.memory - WARNING - Worker is at 58% memory usage. Resuming worker. Process memory: 40.89 GiB -- Worker memory limit: 70.00 GiB

2025-12-11 09:48:31,091 - distributed.worker.memory - WARNING - Worker is at 60% memory usage. Pausing worker. Process memory: 42.24 GiB -- Worker memory limit: 70.00 GiB

2025-11-27 10:30:45,781 - distributed.worker - ERROR - Compute Failed Key: ('get_cylindrical_am-4087d63d62cf0e9b6381b78244571706', 129) State: executing Task: <Task ('get_cylindrical_am-4087d63d62cf0e9b6381b78244571706', 129) apply_and_enforce(..., ...)> Exception: 'NameError("name \'R\' is not defined")' Traceback: ' File "/opt/conda/lib/python3.12/site-packages/dask/dataframe/core.py", line 98, in apply_and_enforce\n df = func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/tmp/ipykernel_180/4060781933.py", line 232, in get_cylindrical_am\n'

2025-11-27 10:30:45,746 - distributed.worker - ERROR - Compute Failed Key: ('get_cylindrical_am-4087d63d62cf0e9b6381b78244571706', 160) State: executing Task: <Task ('get_cylindrical_am-4087d63d62cf0e9b6381b78244571706', 160) apply_and_enforce(..., ...)> Exception: 'NameError("name \'R\' is not defined")' Traceback: ' File "/opt/conda/lib/python3.12/site-packages/dask/dataframe/core.py", line 98, in apply_and_enforce\n df = func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/tmp/ipykernel_180/4060781933.py", line 232, in get_cylindrical_am\n'

2025-11-27 10:30:45,735 - distributed.worker - ERROR - Compute Failed Key: ('get_cylindrical_am-4087d63d62cf0e9b6381b78244571706', 143) State: executing Task: <Task ('get_cylindrical_am-4087d63d62cf0e9b6381b78244571706', 143) apply_and_enforce(..., ...)> Exception: 'NameError("name \'R\' is not defined")' Traceback: ' File "/opt/conda/lib/python3.12/site-packages/dask/dataframe/core.py", line 98, in apply_and_enforce\n df = func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/tmp/ipykernel_180/4060781933.py", line 232, in get_cylindrical_am\n'

2025-11-27 09:48:06,182 - distributed.worker - INFO - -------------------------------------------------

2025-11-27 09:48:06,182 - distributed.worker - INFO - Registered to: tcp://simple-scheduler.dask-operator.svc.cluster.local:8786

2025-11-27 09:48:06,181 - distributed.worker - INFO - Starting Worker plugin shuffle

2025-11-27 09:48:06,155 - distributed.worker - INFO - -------------------------------------------------

2025-11-27 09:48:06,155 - distributed.worker - INFO - Local Directory: /mnt/scratch/dask-scratch-space/worker-247q3wa7

2025-11-27 09:48:06,155 - distributed.worker - INFO - Memory: 70.00 GiB

2025-11-27 09:48:06,155 - distributed.worker - INFO - Threads: 5

2025-11-27 09:48:06,155 - distributed.worker - INFO - -------------------------------------------------

2025-11-27 09:48:06,155 - distributed.worker - INFO - Waiting to connect to: tcp://simple-scheduler.dask-operator.svc.cluster.local:8786

2025-11-27 09:48:06,155 - distributed.worker - INFO - dashboard at: 172.18.196.157:8788

2025-11-27 09:48:06,155 - distributed.worker - INFO - Worker name: simple-default-worker-202e1055fd

2025-11-27 09:48:06,155 - distributed.worker - INFO - Listening to: tcp://172.18.196.157:46591

2025-11-27 09:48:06,154 - distributed.worker - INFO - Start worker at: tcp://172.18.196.157:46591