Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded: curl/8.4.0
(required by: htslib/1.16)
-------------------------------------------------------------------------------




The following have been reloaded with a version change:
  1) curl/8.4.0 => curl/8.17.0     2) openssl/3.0.7 => openssl/3.6.0

2025-11-17 16:46:02.978445: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:47:45.769085: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-11-17 16:47:45.790899: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2025-11-17 16:47:45.842016: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:89:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5
coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.75GiB deviceMemoryBandwidth: 573.69GiB/s
2025-11-17 16:47:45.842154: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:47:46.633265: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:47:46.633398: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:47:46.961430: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-11-17 16:47:47.357183: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-11-17 16:47:47.920933: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-11-17 16:47:48.124593: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-11-17 16:47:48.334070: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:47:48.335305: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-11-17 16:47:48.336126: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2025-11-17 16:47:48.339445: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-11-17 16:47:48.340116: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:89:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5
coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.75GiB deviceMemoryBandwidth: 573.69GiB/s
2025-11-17 16:47:48.340178: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:47:48.340217: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:47:48.340250: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:47:48.340282: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-11-17 16:47:48.340314: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-11-17 16:47:48.340346: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-11-17 16:47:48.340376: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-11-17 16:47:48.340434: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:47:48.341438: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-11-17 16:47:48.341510: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:47:50.812207: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2025-11-17 16:47:50.812317: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2025-11-17 16:47:50.812333: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2025-11-17 16:47:50.813592: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10064 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:89:00.0, compute capability: 7.5)
2025-11-17 16:48:02.197294: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2025-11-17 16:48:02.198073: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2499970000 Hz
2025-11-17 16:48:03.618835: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:48:05.243519: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:48:05.249563: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:48:18.652987: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2025-11-17 16:48:18.716956: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'jitters', 'index', 'status', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
2025-11-17 16:53:53.678283: W tensorflow/python/util/util.cc:348] Sets are not currently considered sequences, but this may change in the future, so consider avoiding using them.
2025-11-17 16:53:58.532898: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:54:09.708684: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-11-17 16:54:09.710051: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2025-11-17 16:54:09.739006: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:89:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5
coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.75GiB deviceMemoryBandwidth: 573.69GiB/s
2025-11-17 16:54:09.739111: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:54:09.744947: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:54:09.744997: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:54:09.748580: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-11-17 16:54:09.750930: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-11-17 16:54:09.755991: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-11-17 16:54:09.758838: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-11-17 16:54:09.760910: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:54:09.761867: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-11-17 16:54:09.762291: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2025-11-17 16:54:09.765163: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-11-17 16:54:09.765689: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:89:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5
coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.75GiB deviceMemoryBandwidth: 573.69GiB/s
2025-11-17 16:54:09.765735: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:54:09.765763: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:54:09.765788: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:54:09.765833: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-11-17 16:54:09.765861: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-11-17 16:54:09.765885: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-11-17 16:54:09.765908: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-11-17 16:54:09.765932: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:54:09.766742: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-11-17 16:54:09.766795: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:54:10.228256: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2025-11-17 16:54:10.228351: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2025-11-17 16:54:10.228364: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2025-11-17 16:54:10.229621: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10064 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:89:00.0, compute capability: 7.5)
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)

batch:   0%|          | 0/58 [00:00<?, ?it/s]2025-11-17 16:54:11.769007: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2025-11-17 16:54:11.769747: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2499970000 Hz
2025-11-17 16:54:12.027168: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:54:12.383205: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:54:12.385395: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:54:13.667103: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2025-11-17 16:54:13.734050: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'true_profiles', 'true_logcounts', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])

batch:   2%|▏         | 1/58 [00:22<21:25, 22.55s/it]
batch:   3%|▎         | 2/58 [00:22<08:50,  9.48s/it]
batch:   5%|▌         | 3/58 [00:23<04:51,  5.29s/it]
batch:   7%|▋         | 4/58 [00:23<02:59,  3.33s/it]
batch:   9%|▊         | 5/58 [00:23<01:58,  2.24s/it]
batch:  10%|█         | 6/58 [00:24<01:22,  1.58s/it]
batch:  12%|█▏        | 7/58 [00:24<00:59,  1.17s/it]
batch:  14%|█▍        | 8/58 [00:24<00:44,  1.11it/s]
batch:  16%|█▌        | 9/58 [00:25<00:35,  1.40it/s]
batch:  17%|█▋        | 10/58 [00:25<00:28,  1.69it/s]
batch:  19%|█▉        | 11/58 [00:25<00:23,  1.98it/s]
batch:  21%|██        | 12/58 [00:26<00:20,  2.24it/s]
batch:  22%|██▏       | 13/58 [00:26<00:18,  2.47it/s]
batch:  24%|██▍       | 14/58 [00:26<00:16,  2.66it/s]
batch:  26%|██▌       | 15/58 [00:26<00:15,  2.81it/s]
batch:  28%|██▊       | 16/58 [00:27<00:14,  2.91it/s]
batch:  29%|██▉       | 17/58 [00:27<00:13,  2.98it/s]
batch:  31%|███       | 18/58 [00:27<00:13,  2.93it/s]
batch:  33%|███▎      | 19/58 [00:28<00:12,  3.02it/s]
batch:  34%|███▍      | 20/58 [00:28<00:12,  3.06it/s]
batch:  36%|███▌      | 21/58 [00:28<00:11,  3.11it/s]
batch:  38%|███▊      | 22/58 [00:29<00:11,  3.14it/s]
batch:  40%|███▉      | 23/58 [00:29<00:11,  3.16it/s]
batch:  41%|████▏     | 24/58 [00:29<00:10,  3.18it/s]
batch:  43%|████▎     | 25/58 [00:30<00:10,  3.18it/s]
batch:  45%|████▍     | 26/58 [00:30<00:10,  3.19it/s]
batch:  47%|████▋     | 27/58 [00:30<00:09,  3.19it/s]
batch:  48%|████▊     | 28/58 [00:31<00:09,  3.20it/s]
batch:  50%|█████     | 29/58 [00:31<00:09,  3.21it/s]
batch:  52%|█████▏    | 30/58 [00:31<00:08,  3.22it/s]
batch:  53%|█████▎    | 31/58 [00:31<00:08,  3.21it/s]
batch:  55%|█████▌    | 32/58 [00:32<00:08,  3.21it/s]
batch:  57%|█████▋    | 33/58 [00:32<00:07,  3.21it/s]
batch:  59%|█████▊    | 34/58 [00:32<00:07,  3.16it/s]
batch:  60%|██████    | 35/58 [00:33<00:07,  3.17it/s]
batch:  62%|██████▏   | 36/58 [00:33<00:06,  3.17it/s]
batch:  64%|██████▍   | 37/58 [00:33<00:06,  3.17it/s]
batch:  66%|██████▌   | 38/58 [00:34<00:06,  3.19it/s]
batch:  67%|██████▋   | 39/58 [00:34<00:05,  3.19it/s]
batch:  69%|██████▉   | 40/58 [00:34<00:05,  3.20it/s]
batch:  71%|███████   | 41/58 [00:35<00:05,  3.19it/s]
batch:  72%|███████▏  | 42/58 [00:35<00:04,  3.21it/s]
batch:  74%|███████▍  | 43/58 [00:35<00:04,  3.22it/s]
batch:  76%|███████▌  | 44/58 [00:36<00:04,  3.21it/s]
batch:  78%|███████▊  | 45/58 [00:36<00:04,  3.21it/s]
batch:  79%|███████▉  | 46/58 [00:36<00:03,  3.20it/s]
batch:  81%|████████  | 47/58 [00:36<00:03,  3.21it/s]
batch:  83%|████████▎ | 48/58 [00:37<00:03,  3.21it/s]
batch:  84%|████████▍ | 49/58 [00:37<00:02,  3.21it/s]
batch:  86%|████████▌ | 50/58 [00:38<00:02,  2.72it/s]
batch:  88%|████████▊ | 51/58 [00:38<00:02,  2.86it/s]
batch:  90%|████████▉ | 52/58 [00:38<00:02,  2.96it/s]
batch:  91%|█████████▏| 53/58 [00:39<00:01,  3.03it/s]
batch:  93%|█████████▎| 54/58 [00:39<00:01,  3.07it/s]
batch:  95%|█████████▍| 55/58 [00:39<00:00,  3.11it/s]
batch:  97%|█████████▋| 56/58 [00:39<00:00,  3.13it/s]
batch:  98%|█████████▊| 57/58 [00:40<00:00,  3.14it/s]
batch: 100%|██████████| 58/58 [00:40<00:00,  3.96it/s]
batch: 100%|██████████| 58/58 [00:40<00:00,  1.44it/s]

  0%|          | 0/3656 [00:00<?, ?it/s]
  3%|▎         | 97/3656 [00:00<00:03, 961.53it/s]
  5%|▌         | 199/3656 [00:00<00:03, 985.31it/s]
  8%|▊         | 301/3656 [00:00<00:03, 991.39it/s]
 11%|█         | 401/3656 [00:00<00:03, 993.37it/s]
 14%|█▎        | 502/3656 [00:00<00:03, 992.33it/s]
 16%|█▋        | 602/3656 [00:00<00:03, 990.39it/s]
 19%|█▉        | 702/3656 [00:00<00:02, 984.82it/s]
 22%|██▏       | 801/3656 [00:00<00:02, 983.20it/s]
 25%|██▍       | 900/3656 [00:00<00:02, 981.21it/s]
 27%|██▋       | 999/3656 [00:01<00:02, 973.88it/s]
 30%|███       | 1098/3656 [00:01<00:02, 978.00it/s]
 33%|███▎      | 1196/3656 [00:01<00:02, 971.06it/s]
 35%|███▌      | 1294/3656 [00:01<00:02, 963.56it/s]
 38%|███▊      | 1391/3656 [00:01<00:02, 963.81it/s]
 41%|████      | 1488/3656 [00:01<00:02, 955.11it/s]
 43%|████▎     | 1584/3656 [00:01<00:02, 951.98it/s]
 46%|████▌     | 1680/3656 [00:01<00:02, 950.46it/s]
 49%|████▊     | 1776/3656 [00:01<00:01, 950.62it/s]
 51%|█████     | 1872/3656 [00:01<00:01, 945.75it/s]
 54%|█████▍    | 1967/3656 [00:02<00:01, 945.27it/s]
 56%|█████▋    | 2062/3656 [00:02<00:01, 946.05it/s]
 59%|█████▉    | 2157/3656 [00:02<00:01, 942.35it/s]
 62%|██████▏   | 2252/3656 [00:02<00:01, 942.15it/s]
 64%|██████▍   | 2347/3656 [00:02<00:01, 931.79it/s]
 67%|██████▋   | 2441/3656 [00:02<00:01, 929.85it/s]
 69%|██████▉   | 2535/3656 [00:02<00:01, 931.36it/s]
 72%|███████▏  | 2629/3656 [00:02<00:01, 925.00it/s]
 74%|███████▍  | 2722/3656 [00:02<00:01, 919.72it/s]
 77%|███████▋  | 2815/3656 [00:02<00:00, 918.33it/s]
 80%|███████▉  | 2907/3656 [00:03<00:00, 918.40it/s]
 82%|████████▏ | 2999/3656 [00:03<00:00, 906.50it/s]
 85%|████████▍ | 3090/3656 [00:03<00:00, 901.60it/s]
 87%|████████▋ | 3181/3656 [00:03<00:00, 895.36it/s]
 89%|████████▉ | 3271/3656 [00:03<00:00, 887.54it/s]
 92%|█████████▏| 3360/3656 [00:03<00:00, 884.41it/s]
 94%|█████████▍| 3449/3656 [00:03<00:00, 879.78it/s]
 97%|█████████▋| 3537/3656 [00:03<00:00, 876.73it/s]
 99%|█████████▉| 3625/3656 [00:03<00:00, 874.32it/s]
100%|██████████| 3656/3656 [00:03<00:00, 934.84it/s]

  0%|          | 0/3656 [00:00<?, ?it/s]
  3%|▎         | 97/3656 [00:00<00:03, 964.48it/s]
  5%|▌         | 197/3656 [00:00<00:03, 979.35it/s]
  8%|▊         | 298/3656 [00:00<00:03, 993.00it/s]
 11%|█         | 398/3656 [00:00<00:03, 986.25it/s]
 14%|█▎        | 499/3656 [00:00<00:03, 988.50it/s]
 16%|█▋        | 599/3656 [00:00<00:03, 987.20it/s]
 19%|█▉        | 698/3656 [00:00<00:03, 985.65it/s]
 22%|██▏       | 797/3656 [00:00<00:02, 982.61it/s]
 25%|██▍       | 896/3656 [00:00<00:02, 977.04it/s]
 27%|██▋       | 994/3656 [00:01<00:02, 974.62it/s]
 30%|██▉       | 1092/3656 [00:01<00:02, 975.87it/s]
 33%|███▎      | 1190/3656 [00:01<00:02, 970.20it/s]
 35%|███▌      | 1288/3656 [00:01<00:02, 968.74it/s]
 38%|███▊      | 1385/3656 [00:01<00:02, 959.96it/s]
 41%|████      | 1482/3656 [00:01<00:02, 959.35it/s]
 43%|████▎     | 1578/3656 [00:01<00:02, 951.34it/s]
 46%|████▌     | 1674/3656 [00:01<00:02, 952.54it/s]
 48%|████▊     | 1770/3656 [00:01<00:01, 947.49it/s]
 51%|█████     | 1866/3656 [00:01<00:01, 945.47it/s]
 54%|█████▎    | 1961/3656 [00:02<00:01, 946.47it/s]
 56%|█████▋    | 2057/3656 [00:02<00:01, 944.70it/s]
 59%|█████▉    | 2153/3656 [00:02<00:01, 948.41it/s]
 61%|██████▏   | 2248/3656 [00:02<00:01, 947.71it/s]
 64%|██████▍   | 2343/3656 [00:02<00:01, 927.43it/s]
 67%|██████▋   | 2436/3656 [00:02<00:01, 923.40it/s]
 69%|██████▉   | 2529/3656 [00:02<00:01, 923.74it/s]
 72%|███████▏  | 2622/3656 [00:02<00:01, 922.82it/s]
 74%|███████▍  | 2715/3656 [00:02<00:01, 918.09it/s]
 77%|███████▋  | 2807/3656 [00:02<00:00, 915.28it/s]
 79%|███████▉  | 2899/3656 [00:03<00:00, 910.86it/s]
 82%|████████▏ | 2991/3656 [00:03<00:00, 903.52it/s]
 84%|████████▍ | 3082/3656 [00:03<00:00, 898.03it/s]
 87%|████████▋ | 3172/3656 [00:03<00:00, 891.05it/s]
 89%|████████▉ | 3262/3656 [00:03<00:00, 884.34it/s]
 92%|█████████▏| 3351/3656 [00:03<00:00, 881.48it/s]
 94%|█████████▍| 3440/3656 [00:03<00:00, 878.03it/s]
 96%|█████████▋| 3528/3656 [00:03<00:00, 875.46it/s]
 99%|█████████▉| 3616/3656 [00:03<00:00, 872.95it/s]
100%|██████████| 3656/3656 [00:03<00:00, 933.43it/s]
2025-11-17 16:55:39.718052: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:56:05.639763: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-11-17 16:56:05.640708: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2025-11-17 16:56:05.669720: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:89:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5
coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.75GiB deviceMemoryBandwidth: 573.69GiB/s
2025-11-17 16:56:05.669896: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:56:05.676753: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:56:05.676885: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:56:05.679970: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-11-17 16:56:05.681745: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-11-17 16:56:05.686087: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-11-17 16:56:05.688751: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-11-17 16:56:05.690390: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:56:05.691396: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-11-17 16:56:05.691900: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2025-11-17 16:56:05.694577: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-11-17 16:56:05.695130: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:89:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5
coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.75GiB deviceMemoryBandwidth: 573.69GiB/s
2025-11-17 16:56:05.695189: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:56:05.695224: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:56:05.695257: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:56:05.695288: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-11-17 16:56:05.695319: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-11-17 16:56:05.695349: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-11-17 16:56:05.695380: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-11-17 16:56:05.695410: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:56:05.696277: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-11-17 16:56:05.696346: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:56:06.161757: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2025-11-17 16:56:06.161859: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2025-11-17 16:56:06.161873: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2025-11-17 16:56:06.163178: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10064 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:89:00.0, compute capability: 7.5)
2025-11-17 16:56:06.211317: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:196] None of the MLIR optimization passes are enabled (registered 0 passes)
2025-11-17 16:56:06.231872: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2499970000 Hz
2025-11-17 16:56:09.908346: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:56:10.259833: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:56:10.264785: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:56:11.552157: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2025-11-17 16:56:11.618323: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
RuntimeError: module compiled against API version 0xe but this version of numpy is 0xd
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)