2025-11-27 09:51:58,054 - distributed.worker - ERROR - Compute Failed Key: ('apply_azimuthal_mask-aff4271a6f4643bfdcebce331a3d7240', 164) State: executing Task: <Task ('apply_azimuthal_mask-aff4271a6f4643bfdcebce331a3d7240', 164) apply_and_enforce(..., ...)> Exception: 'NameError("name \'get_azimuthal_difference\' is not defined")' Traceback: ' File "/opt/conda/lib/python3.12/site-packages/dask/dataframe/core.py", line 98, in apply_and_enforce\n df = func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/tmp/ipykernel_180/181146782.py", line 25, in apply_azimuthal_mask\n'
2025-11-27 09:49:55,129 - distributed.worker - ERROR - Compute Failed Key: ('apply_azimuthal_mask-65f67c8f59d8c6ce3bcd61eddf1da9f6', 77) State: executing Task: <Task ('apply_azimuthal_mask-65f67c8f59d8c6ce3bcd61eddf1da9f6', 77) apply_and_enforce(..., ...)> Exception: 'NameError("name \'get_azimuthal_difference\' is not defined")' Traceback: ' File "/opt/conda/lib/python3.12/site-packages/dask/dataframe/core.py", line 98, in apply_and_enforce\n df = func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/tmp/ipykernel_180/181146782.py", line 25, in apply_azimuthal_mask\n'
2025-11-27 09:48:06,180 - distributed.worker - INFO - -------------------------------------------------
2025-11-27 09:48:06,180 - distributed.worker - INFO - Registered to: tcp://simple-scheduler.dask-operator.svc.cluster.local:8786
2025-11-27 09:48:06,180 - distributed.worker - INFO - Starting Worker plugin shuffle
2025-11-27 09:48:06,139 - distributed.worker - INFO - -------------------------------------------------
2025-11-27 09:48:06,139 - distributed.worker - INFO - Local Directory: /mnt/scratch/dask-scratch-space/worker-wknomi0h
2025-11-27 09:48:06,139 - distributed.worker - INFO - Memory: 70.00 GiB
2025-11-27 09:48:06,139 - distributed.worker - INFO - Threads: 5
2025-11-27 09:48:06,139 - distributed.worker - INFO - -------------------------------------------------
2025-11-27 09:48:06,139 - distributed.worker - INFO - Waiting to connect to: tcp://simple-scheduler.dask-operator.svc.cluster.local:8786
2025-11-27 09:48:06,139 - distributed.worker - INFO - dashboard at: 172.18.196.162:8788
2025-11-27 09:48:06,138 - distributed.worker - INFO - Worker name: simple-default-worker-e1e9402968
2025-11-27 09:48:06,138 - distributed.worker - INFO - Listening to: tcp://172.18.196.162:37523
2025-11-27 09:48:06,138 - distributed.worker - INFO - Start worker at: tcp://172.18.196.162:37523