Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded: curl/8.4.0
(required by: htslib/1.16)
-------------------------------------------------------------------------------




The following have been reloaded with a version change:
  1) curl/8.4.0 => curl/8.17.0     2) openssl/3.0.7 => openssl/3.6.0

2026-05-28 11:46:28.840124: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-28 11:46:54.812447: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-28 11:46:54.822766: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-28 11:46:54.856096: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:86:00.0 name: NVIDIA TITAN Xp computeCapability: 6.1
coreClock: 1.911GHz coreCount: 30 deviceMemorySize: 11.90GiB deviceMemoryBandwidth: 510.07GiB/s
2026-05-28 11:46:54.856237: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-28 11:46:55.405219: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-28 11:46:55.405400: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-28 11:46:55.752073: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-28 11:46:56.417810: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-28 11:46:56.929354: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-28 11:46:57.152647: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-28 11:46:57.275634: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-28 11:46:57.276881: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-28 11:46:57.277540: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-28 11:46:57.277827: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-28 11:46:57.278424: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:86:00.0 name: NVIDIA TITAN Xp computeCapability: 6.1
coreClock: 1.911GHz coreCount: 30 deviceMemorySize: 11.90GiB deviceMemoryBandwidth: 510.07GiB/s
2026-05-28 11:46:57.278489: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-28 11:46:57.278533: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-28 11:46:57.278564: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-28 11:46:57.278593: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-28 11:46:57.278622: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-28 11:46:57.278650: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-28 11:46:57.278678: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-28 11:46:57.278728: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-28 11:46:57.279486: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-28 11:46:57.279536: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-28 11:47:00.230743: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-28 11:47:00.230884: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-28 11:47:00.230913: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-28 11:47:00.232343: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11209 MB memory) -> physical GPU (device: 0, name: NVIDIA TITAN Xp, pci bus id: 0000:86:00.0, compute capability: 6.1)
2026-05-28 11:47:04.386528: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2026-05-28 11:47:04.387256: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2399840000 Hz
2026-05-28 11:47:21.335945: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-28 11:47:23.372157: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-28 11:47:23.380618: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-28 11:47:36.772624: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-28 11:47:36.866306: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'jitters', 'index', 'status', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
2026-05-28 12:09:33.521149: W tensorflow/python/util/util.cc:348] Sets are not currently considered sequences, but this may change in the future, so consider avoiding using them.
2026-05-28 12:09:39.477024: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-28 12:09:47.905086: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-28 12:09:47.906573: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-28 12:09:47.947355: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:86:00.0 name: NVIDIA TITAN Xp computeCapability: 6.1
coreClock: 1.911GHz coreCount: 30 deviceMemorySize: 11.90GiB deviceMemoryBandwidth: 510.07GiB/s
2026-05-28 12:09:47.947484: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-28 12:09:47.953442: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-28 12:09:47.953544: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-28 12:09:47.956292: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-28 12:09:47.957956: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-28 12:09:47.962971: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-28 12:09:47.965059: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-28 12:09:47.966256: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-28 12:09:47.967365: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-28 12:09:47.967817: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-28 12:09:47.968020: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-28 12:09:47.968552: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:86:00.0 name: NVIDIA TITAN Xp computeCapability: 6.1
coreClock: 1.911GHz coreCount: 30 deviceMemorySize: 11.90GiB deviceMemoryBandwidth: 510.07GiB/s
2026-05-28 12:09:47.968608: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-28 12:09:47.968653: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-28 12:09:47.968692: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-28 12:09:47.968731: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-28 12:09:47.968769: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-28 12:09:47.968807: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-28 12:09:47.968845: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-28 12:09:47.968883: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-28 12:09:47.969692: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-28 12:09:47.969757: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-28 12:09:48.719214: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-28 12:09:48.719320: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-28 12:09:48.719342: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-28 12:09:48.729143: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11209 MB memory) -> physical GPU (device: 0, name: NVIDIA TITAN Xp, pci bus id: 0000:86:00.0, compute capability: 6.1)
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)

batch:   0%|          | 0/92 [00:00<?, ?it/s]2026-05-28 12:09:51.352890: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2026-05-28 12:09:51.353612: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2399840000 Hz
2026-05-28 12:09:52.208955: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-28 12:09:52.934410: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-28 12:09:52.936308: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-28 12:09:55.166207: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-28 12:09:55.332200: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'true_profiles', 'true_logcounts', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])

batch:   1%|          | 1/92 [00:20<31:26, 20.73s/it]
batch:   2%|▏         | 2/92 [00:21<13:14,  8.83s/it]
batch:   3%|▎         | 3/92 [00:21<07:26,  5.02s/it]
batch:   4%|▍         | 4/92 [00:22<04:44,  3.24s/it]
batch:   5%|▌         | 5/92 [00:22<03:15,  2.25s/it]
batch:   7%|▋         | 6/92 [00:23<02:22,  1.65s/it]
batch:   8%|▊         | 7/92 [00:23<01:47,  1.26s/it]
batch:   9%|▊         | 8/92 [00:24<01:25,  1.02s/it]
batch:  10%|▉         | 9/92 [00:24<01:11,  1.16it/s]
batch:  11%|█         | 10/92 [00:25<01:01,  1.34it/s]
batch:  12%|█▏        | 11/92 [00:25<00:53,  1.50it/s]
batch:  13%|█▎        | 12/92 [00:26<00:48,  1.65it/s]
batch:  14%|█▍        | 13/92 [00:26<00:45,  1.75it/s]
batch:  15%|█▌        | 14/92 [00:27<00:42,  1.85it/s]
batch:  16%|█▋        | 15/92 [00:27<00:40,  1.92it/s]
batch:  17%|█▋        | 16/92 [00:28<00:38,  1.99it/s]
batch:  18%|█▊        | 17/92 [00:28<00:37,  2.01it/s]
batch:  20%|█▉        | 18/92 [00:29<00:36,  2.01it/s]
batch:  21%|██        | 19/92 [00:29<00:36,  2.02it/s]
batch:  22%|██▏       | 20/92 [00:29<00:35,  2.05it/s]
batch:  23%|██▎       | 21/92 [00:30<00:34,  2.09it/s]
batch:  24%|██▍       | 22/92 [00:30<00:33,  2.11it/s]
batch:  25%|██▌       | 23/92 [00:31<00:33,  2.06it/s]
batch:  26%|██▌       | 24/92 [00:31<00:33,  2.06it/s]
batch:  27%|██▋       | 25/92 [00:32<00:32,  2.04it/s]
batch:  28%|██▊       | 26/92 [00:32<00:31,  2.07it/s]
batch:  29%|██▉       | 27/92 [00:33<00:31,  2.04it/s]
batch:  30%|███       | 28/92 [00:33<00:31,  2.03it/s]
batch:  32%|███▏      | 29/92 [00:34<00:31,  2.03it/s]
batch:  33%|███▎      | 30/92 [00:34<00:30,  2.07it/s]
batch:  34%|███▎      | 31/92 [00:35<00:29,  2.05it/s]
batch:  35%|███▍      | 32/92 [00:35<00:29,  2.07it/s]
batch:  36%|███▌      | 33/92 [00:36<00:28,  2.09it/s]
batch:  37%|███▋      | 34/92 [00:36<00:27,  2.11it/s]
batch:  38%|███▊      | 35/92 [00:37<00:27,  2.08it/s]
batch:  39%|███▉      | 36/92 [00:37<00:27,  2.06it/s]
batch:  40%|████      | 37/92 [00:38<00:27,  2.04it/s]
batch:  41%|████▏     | 38/92 [00:38<00:26,  2.06it/s]
batch:  42%|████▏     | 39/92 [00:39<00:25,  2.08it/s]
batch:  43%|████▎     | 40/92 [00:39<00:25,  2.04it/s]
batch:  45%|████▍     | 41/92 [00:40<00:24,  2.04it/s]
batch:  46%|████▌     | 42/92 [00:40<00:24,  2.06it/s]
batch:  47%|████▋     | 43/92 [00:41<00:23,  2.09it/s]
batch:  48%|████▊     | 44/92 [00:41<00:22,  2.11it/s]
batch:  49%|████▉     | 45/92 [00:42<00:22,  2.07it/s]
batch:  50%|█████     | 46/92 [00:42<00:22,  2.04it/s]
batch:  51%|█████     | 47/92 [00:43<00:22,  2.02it/s]
batch:  52%|█████▏    | 48/92 [00:43<00:21,  2.02it/s]
batch:  53%|█████▎    | 49/92 [00:44<00:21,  2.02it/s]
batch:  54%|█████▍    | 50/92 [00:44<00:20,  2.02it/s]
batch:  55%|█████▌    | 51/92 [00:45<00:20,  2.03it/s]
batch:  57%|█████▋    | 52/92 [00:45<00:19,  2.05it/s]
batch:  58%|█████▊    | 53/92 [00:45<00:18,  2.09it/s]
batch:  59%|█████▊    | 54/92 [00:46<00:18,  2.07it/s]
batch:  60%|█████▉    | 55/92 [00:46<00:17,  2.09it/s]
batch:  61%|██████    | 56/92 [00:47<00:17,  2.09it/s]
batch:  62%|██████▏   | 57/92 [00:47<00:17,  2.04it/s]
batch:  63%|██████▎   | 58/92 [00:48<00:16,  2.01it/s]
batch:  64%|██████▍   | 59/92 [00:48<00:16,  2.02it/s]
batch:  65%|██████▌   | 60/92 [00:49<00:15,  2.05it/s]
batch:  66%|██████▋   | 61/92 [00:49<00:14,  2.07it/s]
batch:  67%|██████▋   | 62/92 [00:50<00:14,  2.10it/s]
batch:  68%|██████▊   | 63/92 [00:50<00:13,  2.12it/s]
batch:  70%|██████▉   | 64/92 [00:51<00:13,  2.13it/s]
batch:  71%|███████   | 65/92 [00:51<00:12,  2.13it/s]
batch:  72%|███████▏  | 66/92 [00:52<00:13,  1.93it/s]
batch:  73%|███████▎  | 67/92 [00:52<00:12,  2.00it/s]
batch:  74%|███████▍  | 68/92 [00:53<00:11,  2.00it/s]
batch:  75%|███████▌  | 69/92 [00:53<00:11,  2.01it/s]
batch:  76%|███████▌  | 70/92 [00:54<00:10,  2.02it/s]
batch:  77%|███████▋  | 71/92 [00:54<00:10,  2.04it/s]
batch:  78%|███████▊  | 72/92 [00:55<00:09,  2.08it/s]
batch:  79%|███████▉  | 73/92 [00:55<00:09,  2.06it/s]
batch:  80%|████████  | 74/92 [00:56<00:08,  2.08it/s]
batch:  82%|████████▏ | 75/92 [00:56<00:08,  2.10it/s]
batch:  83%|████████▎ | 76/92 [00:57<00:07,  2.07it/s]
batch:  84%|████████▎ | 77/92 [00:57<00:07,  2.05it/s]
batch:  85%|████████▍ | 78/92 [00:58<00:06,  2.08it/s]
batch:  86%|████████▌ | 79/92 [00:58<00:06,  2.10it/s]
batch:  87%|████████▋ | 80/92 [00:59<00:05,  2.11it/s]
batch:  88%|████████▊ | 81/92 [00:59<00:05,  2.08it/s]
batch:  89%|████████▉ | 82/92 [01:00<00:04,  2.07it/s]
batch:  90%|█████████ | 83/92 [01:00<00:04,  2.09it/s]
batch:  91%|█████████▏| 84/92 [01:00<00:03,  2.10it/s]
batch:  92%|█████████▏| 85/92 [01:01<00:03,  2.08it/s]
batch:  93%|█████████▎| 86/92 [01:01<00:02,  2.08it/s]
batch:  95%|█████████▍| 87/92 [01:02<00:02,  2.10it/s]
batch:  96%|█████████▌| 88/92 [01:02<00:01,  2.06it/s]
batch:  97%|█████████▋| 89/92 [01:03<00:01,  2.05it/s]
batch:  98%|█████████▊| 90/92 [01:03<00:00,  2.04it/s]
batch:  99%|█████████▉| 91/92 [01:04<00:00,  2.12it/s]
batch: 100%|██████████| 92/92 [01:04<00:00,  1.43it/s]

  0%|          | 0/5814 [00:00<?, ?it/s]
  1%|▏         | 77/5814 [00:00<00:07, 767.41it/s]
  3%|▎         | 154/5814 [00:00<00:07, 755.65it/s]
  4%|▍         | 230/5814 [00:00<00:07, 754.39it/s]
  5%|▌         | 306/5814 [00:00<00:07, 753.99it/s]
  7%|▋         | 383/5814 [00:00<00:07, 753.36it/s]
  8%|▊         | 459/5814 [00:00<00:07, 752.60it/s]
  9%|▉         | 535/5814 [00:00<00:06, 754.71it/s]
 11%|█         | 611/5814 [00:00<00:06, 751.96it/s]
 12%|█▏        | 687/5814 [00:00<00:06, 748.35it/s]
 13%|█▎        | 764/5814 [00:01<00:06, 748.59it/s]
 14%|█▍        | 839/5814 [00:01<00:06, 747.65it/s]
 16%|█▌        | 914/5814 [00:01<00:06, 748.11it/s]
 17%|█▋        | 989/5814 [00:01<00:06, 748.40it/s]
 18%|█▊        | 1064/5814 [00:01<00:06, 740.16it/s]
 20%|█▉        | 1139/5814 [00:01<00:06, 740.86it/s]
 21%|██        | 1214/5814 [00:01<00:06, 740.35it/s]
 22%|██▏       | 1289/5814 [00:01<00:06, 740.68it/s]
 23%|██▎       | 1364/5814 [00:01<00:06, 735.60it/s]
 25%|██▍       | 1439/5814 [00:01<00:05, 739.75it/s]
 26%|██▌       | 1514/5814 [00:02<00:05, 742.41it/s]
 27%|██▋       | 1589/5814 [00:02<00:05, 742.38it/s]
 29%|██▊       | 1664/5814 [00:02<00:05, 738.02it/s]
 30%|██▉       | 1740/5814 [00:02<00:05, 740.42it/s]
 31%|███       | 1815/5814 [00:02<00:05, 739.61it/s]
 32%|███▏      | 1889/5814 [00:02<00:05, 738.45it/s]
 34%|███▍      | 1963/5814 [00:02<00:05, 738.20it/s]
 35%|███▌      | 2037/5814 [00:02<00:05, 736.03it/s]
 36%|███▋      | 2111/5814 [00:02<00:05, 733.71it/s]
 38%|███▊      | 2185/5814 [00:02<00:04, 729.89it/s]
 39%|███▉      | 2258/5814 [00:03<00:04, 726.93it/s]
 40%|████      | 2331/5814 [00:03<00:04, 725.82it/s]
 41%|████▏     | 2404/5814 [00:03<00:04, 714.89it/s]
 43%|████▎     | 2476/5814 [00:03<00:04, 715.12it/s]
 44%|████▍     | 2548/5814 [00:03<00:04, 716.23it/s]
 45%|████▌     | 2620/5814 [00:03<00:04, 711.27it/s]
 46%|████▋     | 2694/5814 [00:03<00:04, 713.88it/s]
 48%|████▊     | 2768/5814 [00:03<00:04, 715.75it/s]
 49%|████▉     | 2840/5814 [00:03<00:04, 714.99it/s]
 50%|█████     | 2913/5814 [00:03<00:04, 716.02it/s]
 51%|█████▏    | 2986/5814 [00:04<00:03, 717.39it/s]
 53%|█████▎    | 3058/5814 [00:04<00:03, 716.28it/s]
 54%|█████▍    | 3130/5814 [00:04<00:03, 717.14it/s]
 55%|█████▌    | 3202/5814 [00:04<00:03, 712.85it/s]
 56%|█████▋    | 3274/5814 [00:04<00:03, 713.71it/s]
 58%|█████▊    | 3347/5814 [00:04<00:03, 714.51it/s]
 59%|█████▉    | 3420/5814 [00:04<00:03, 714.87it/s]
 60%|██████    | 3494/5814 [00:04<00:03, 716.00it/s]
 61%|██████▏   | 3566/5814 [00:04<00:03, 716.62it/s]
 63%|██████▎   | 3638/5814 [00:04<00:03, 711.87it/s]
 64%|██████▍   | 3710/5814 [00:05<00:02, 706.26it/s]
 65%|██████▌   | 3781/5814 [00:05<00:02, 703.72it/s]
 66%|██████▋   | 3853/5814 [00:05<00:02, 703.96it/s]
 67%|██████▋   | 3924/5814 [00:05<00:02, 700.59it/s]
 69%|██████▊   | 3995/5814 [00:05<00:02, 695.10it/s]
 70%|██████▉   | 4066/5814 [00:05<00:02, 693.79it/s]
 71%|███████   | 4136/5814 [00:05<00:02, 695.57it/s]
 72%|███████▏  | 4206/5814 [00:05<00:02, 692.27it/s]
 74%|███████▎  | 4276/5814 [00:05<00:02, 689.82it/s]
 75%|███████▍  | 4345/5814 [00:06<00:02, 687.64it/s]
 76%|███████▌  | 4414/5814 [00:06<00:02, 682.87it/s]
 77%|███████▋  | 4484/5814 [00:06<00:01, 681.94it/s]
 78%|███████▊  | 4553/5814 [00:06<00:01, 681.90it/s]
 79%|███████▉  | 4622/5814 [00:06<00:01, 681.83it/s]
 81%|████████  | 4691/5814 [00:06<00:01, 682.25it/s]
 82%|████████▏ | 4760/5814 [00:06<00:01, 678.39it/s]
 83%|████████▎ | 4829/5814 [00:06<00:01, 677.38it/s]
 84%|████████▍ | 4897/5814 [00:06<00:01, 676.54it/s]
 85%|████████▌ | 4965/5814 [00:06<00:01, 643.81it/s]
 87%|████████▋ | 5032/5814 [00:07<00:01, 646.06it/s]
 88%|████████▊ | 5097/5814 [00:07<00:01, 645.72it/s]
 89%|████████▉ | 5167/5814 [00:07<00:00, 657.26it/s]
 90%|█████████ | 5236/5814 [00:07<00:00, 663.67it/s]
 91%|█████████ | 5304/5814 [00:07<00:00, 662.58it/s]
 92%|█████████▏| 5371/5814 [00:07<00:00, 664.46it/s]
 94%|█████████▎| 5438/5814 [00:07<00:00, 665.14it/s]
 95%|█████████▍| 5505/5814 [00:07<00:00, 657.17it/s]
 96%|█████████▌| 5573/5814 [00:07<00:00, 659.54it/s]
 97%|█████████▋| 5639/5814 [00:07<00:00, 658.32it/s]
 98%|█████████▊| 5706/5814 [00:08<00:00, 660.67it/s]
 99%|█████████▉| 5773/5814 [00:08<00:00, 657.15it/s]
100%|██████████| 5814/5814 [00:08<00:00, 707.44it/s]

  0%|          | 0/5814 [00:00<?, ?it/s]
  1%|▏         | 79/5814 [00:00<00:07, 787.75it/s]
  3%|▎         | 158/5814 [00:00<00:07, 776.40it/s]
  4%|▍         | 236/5814 [00:00<00:07, 777.95it/s]
  5%|▌         | 314/5814 [00:00<00:07, 772.41it/s]
  7%|▋         | 393/5814 [00:00<00:07, 773.18it/s]
  8%|▊         | 471/5814 [00:00<00:06, 770.93it/s]
  9%|▉         | 549/5814 [00:00<00:06, 770.11it/s]
 11%|█         | 627/5814 [00:00<00:06, 760.89it/s]
 12%|█▏        | 704/5814 [00:00<00:06, 757.39it/s]
 13%|█▎        | 780/5814 [00:01<00:06, 755.43it/s]
 15%|█▍        | 856/5814 [00:01<00:06, 754.67it/s]
 16%|█▌        | 932/5814 [00:01<00:06, 753.66it/s]
 17%|█▋        | 1009/5814 [00:01<00:06, 754.87it/s]
 19%|█▊        | 1085/5814 [00:01<00:06, 751.91it/s]
 20%|█▉        | 1162/5814 [00:01<00:06, 755.05it/s]
 21%|██▏       | 1239/5814 [00:01<00:06, 759.07it/s]
 23%|██▎       | 1315/5814 [00:01<00:05, 755.72it/s]
 24%|██▍       | 1391/5814 [00:01<00:05, 753.18it/s]
 25%|██▌       | 1467/5814 [00:01<00:05, 753.43it/s]
 27%|██▋       | 1543/5814 [00:02<00:05, 752.02it/s]
 28%|██▊       | 1619/5814 [00:02<00:05, 750.51it/s]
 29%|██▉       | 1695/5814 [00:02<00:05, 741.92it/s]
 30%|███       | 1770/5814 [00:02<00:05, 742.41it/s]
 32%|███▏      | 1845/5814 [00:02<00:05, 742.39it/s]
 33%|███▎      | 1920/5814 [00:02<00:05, 737.78it/s]
 34%|███▍      | 1994/5814 [00:02<00:05, 736.77it/s]
 36%|███▌      | 2068/5814 [00:02<00:05, 736.81it/s]
 37%|███▋      | 2142/5814 [00:02<00:04, 737.36it/s]
 38%|███▊      | 2217/5814 [00:02<00:04, 735.43it/s]
 39%|███▉      | 2291/5814 [00:03<00:04, 733.55it/s]
 41%|████      | 2365/5814 [00:03<00:04, 730.57it/s]
 42%|████▏     | 2439/5814 [00:03<00:04, 728.62it/s]
 43%|████▎     | 2513/5814 [00:03<00:04, 725.81it/s]
 44%|████▍     | 2587/5814 [00:03<00:04, 724.73it/s]
 46%|████▌     | 2661/5814 [00:03<00:04, 723.41it/s]
 47%|████▋     | 2734/5814 [00:03<00:04, 721.81it/s]
 48%|████▊     | 2807/5814 [00:03<00:04, 716.76it/s]
 50%|████▉     | 2879/5814 [00:03<00:04, 716.85it/s]
 51%|█████     | 2951/5814 [00:03<00:04, 713.02it/s]
 52%|█████▏    | 3024/5814 [00:04<00:03, 715.51it/s]
 53%|█████▎    | 3096/5814 [00:04<00:03, 716.24it/s]
 54%|█████▍    | 3168/5814 [00:04<00:03, 714.56it/s]
 56%|█████▌    | 3240/5814 [00:04<00:03, 709.91it/s]
 57%|█████▋    | 3312/5814 [00:04<00:03, 712.40it/s]
 58%|█████▊    | 3384/5814 [00:04<00:03, 708.43it/s]
 59%|█████▉    | 3458/5814 [00:04<00:03, 712.07it/s]
 61%|██████    | 3531/5814 [00:04<00:03, 716.33it/s]
 62%|██████▏   | 3603/5814 [00:04<00:03, 710.32it/s]
 63%|██████▎   | 3675/5814 [00:04<00:03, 709.83it/s]
 64%|██████▍   | 3746/5814 [00:05<00:02, 706.52it/s]
 66%|██████▌   | 3817/5814 [00:05<00:02, 704.93it/s]
 67%|██████▋   | 3888/5814 [00:05<00:02, 703.76it/s]
 68%|██████▊   | 3960/5814 [00:05<00:02, 702.47it/s]
 69%|██████▉   | 4031/5814 [00:05<00:02, 700.82it/s]
 71%|███████   | 4102/5814 [00:05<00:02, 689.81it/s]
 72%|███████▏  | 4172/5814 [00:05<00:02, 692.25it/s]
 73%|███████▎  | 4244/5814 [00:05<00:02, 700.40it/s]
 74%|███████▍  | 4315/5814 [00:05<00:02, 697.28it/s]
 75%|███████▌  | 4385/5814 [00:06<00:02, 694.59it/s]
 77%|███████▋  | 4455/5814 [00:06<00:01, 689.36it/s]
 78%|███████▊  | 4525/5814 [00:06<00:01, 688.97it/s]
 79%|███████▉  | 4594/5814 [00:06<00:01, 686.18it/s]
 80%|████████  | 4663/5814 [00:06<00:01, 686.76it/s]
 81%|████████▏ | 4733/5814 [00:06<00:01, 685.20it/s]
 83%|████████▎ | 4802/5814 [00:06<00:01, 684.24it/s]
 84%|████████▍ | 4873/5814 [00:06<00:01, 686.87it/s]
 85%|████████▌ | 4944/5814 [00:06<00:01, 688.88it/s]
 86%|████████▌ | 5013/5814 [00:06<00:01, 684.85it/s]
 87%|████████▋ | 5082/5814 [00:07<00:01, 679.49it/s]
 89%|████████▊ | 5150/5814 [00:07<00:00, 675.09it/s]
 90%|████████▉ | 5219/5814 [00:07<00:00, 675.03it/s]
 91%|█████████ | 5287/5814 [00:07<00:00, 672.35it/s]
 92%|█████████▏| 5355/5814 [00:07<00:00, 666.09it/s]
 93%|█████████▎| 5422/5814 [00:07<00:00, 660.85it/s]
 94%|█████████▍| 5489/5814 [00:07<00:00, 659.64it/s]
 96%|█████████▌| 5555/5814 [00:07<00:00, 658.99it/s]
 97%|█████████▋| 5621/5814 [00:07<00:00, 659.26it/s]
 98%|█████████▊| 5687/5814 [00:07<00:00, 658.84it/s]
 99%|█████████▉| 5754/5814 [00:08<00:00, 656.73it/s]
100%|██████████| 5814/5814 [00:08<00:00, 714.22it/s]
2026-05-28 12:11:32.982385: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-28 12:11:41.790682: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-28 12:11:41.792613: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-28 12:11:41.832421: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:86:00.0 name: NVIDIA TITAN Xp computeCapability: 6.1
coreClock: 1.911GHz coreCount: 30 deviceMemorySize: 11.90GiB deviceMemoryBandwidth: 510.07GiB/s
2026-05-28 12:11:41.832592: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-28 12:11:41.838767: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-28 12:11:41.838912: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-28 12:11:41.841877: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-28 12:11:41.843228: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-28 12:11:41.848284: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-28 12:11:41.850264: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-28 12:11:41.851569: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-28 12:11:41.853688: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-28 12:11:41.854346: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-28 12:11:41.854563: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-28 12:11:41.855114: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:86:00.0 name: NVIDIA TITAN Xp computeCapability: 6.1
coreClock: 1.911GHz coreCount: 30 deviceMemorySize: 11.90GiB deviceMemoryBandwidth: 510.07GiB/s
2026-05-28 12:11:41.855212: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-28 12:11:41.855273: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-28 12:11:41.855327: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-28 12:11:41.855380: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-28 12:11:41.855434: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-28 12:11:41.855487: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-28 12:11:41.855539: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-28 12:11:41.855592: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-28 12:11:41.856493: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-28 12:11:41.856574: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-28 12:11:42.563729: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-28 12:11:42.563840: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-28 12:11:42.563864: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-28 12:11:42.565362: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11209 MB memory) -> physical GPU (device: 0, name: NVIDIA TITAN Xp, pci bus id: 0000:86:00.0, compute capability: 6.1)
2026-05-28 12:11:42.667656: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:196] None of the MLIR optimization passes are enabled (registered 0 passes)
2026-05-28 12:11:42.696491: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2399840000 Hz
2026-05-28 12:11:51.030815: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-28 12:11:51.367026: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-28 12:11:51.372950: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-28 12:11:52.497153: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-28 12:11:52.588106: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
RuntimeError: module compiled against API version 0xe but this version of numpy is 0xd
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)