Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded: curl/8.4.0
(required by: htslib/1.16)
-------------------------------------------------------------------------------




The following have been reloaded with a version change:
  1) curl/8.4.0 => curl/8.17.0     2) openssl/3.0.7 => openssl/3.6.0

2026-05-11 02:50:32.233921: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 02:54:48.786296: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 02:54:48.810305: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-11 02:54:48.874131: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:82:00.0 name: Tesla P100-PCIE-16GB computeCapability: 6.0
coreClock: 1.3285GHz coreCount: 56 deviceMemorySize: 15.89GiB deviceMemoryBandwidth: 681.88GiB/s
2026-05-11 02:54:48.874277: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 02:54:49.555941: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 02:54:49.556099: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 02:54:49.926461: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 02:54:50.455234: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 02:54:51.279262: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 02:54:51.468470: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 02:54:51.847505: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 02:54:51.848865: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 02:54:51.849757: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-11 02:54:51.850027: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 02:54:51.850754: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:82:00.0 name: Tesla P100-PCIE-16GB computeCapability: 6.0
coreClock: 1.3285GHz coreCount: 56 deviceMemorySize: 15.89GiB deviceMemoryBandwidth: 681.88GiB/s
2026-05-11 02:54:51.850850: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 02:54:51.850919: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 02:54:51.851010: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 02:54:51.851073: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 02:54:51.851131: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 02:54:51.851190: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 02:54:51.851247: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 02:54:51.851350: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 02:54:51.852677: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 02:54:51.852783: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 02:54:54.595182: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-11 02:54:54.595360: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-11 02:54:54.595391: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-11 02:54:54.596393: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 14950 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-16GB, pci bus id: 0000:82:00.0, compute capability: 6.0)
2026-05-11 02:55:02.096181: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2026-05-11 02:55:02.096977: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2400130000 Hz
2026-05-11 02:55:15.134499: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 02:55:17.066967: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 02:55:17.118691: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 02:55:29.818252: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-11 02:55:29.969529: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'jitters', 'index', 'status', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
2026-05-11 03:19:47.841712: W tensorflow/python/util/util.cc:348] Sets are not currently considered sequences, but this may change in the future, so consider avoiding using them.
2026-05-11 03:20:56.099414: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:22:40.752259: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:22:40.754220: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-11 03:22:40.801543: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:82:00.0 name: Tesla P100-PCIE-16GB computeCapability: 6.0
coreClock: 1.3285GHz coreCount: 56 deviceMemorySize: 15.89GiB deviceMemoryBandwidth: 681.88GiB/s
2026-05-11 03:22:40.801669: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:22:40.821402: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:22:40.821519: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:22:40.832037: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:22:40.840107: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:22:40.853692: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:22:40.862629: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:22:40.870692: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:22:40.871537: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:22:40.872133: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-11 03:22:40.872339: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:22:40.873097: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:82:00.0 name: Tesla P100-PCIE-16GB computeCapability: 6.0
coreClock: 1.3285GHz coreCount: 56 deviceMemorySize: 15.89GiB deviceMemoryBandwidth: 681.88GiB/s
2026-05-11 03:22:40.873183: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:22:40.873250: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:22:40.873309: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:22:40.873365: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:22:40.873419: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:22:40.873473: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:22:40.873527: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:22:40.873581: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:22:40.874294: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:22:40.874383: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:22:41.552409: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-11 03:22:41.552551: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-11 03:22:41.552577: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-11 03:22:41.553864: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 14950 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-16GB, pci bus id: 0000:82:00.0, compute capability: 6.0)
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)

batch:   0%|          | 0/104 [00:00<?, ?it/s]2026-05-11 03:22:44.158554: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2026-05-11 03:22:44.159253: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2400130000 Hz
2026-05-11 03:22:44.895980: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:22:45.421526: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:22:45.449296: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:22:47.448433: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-11 03:22:47.645229: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'true_profiles', 'true_logcounts', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])

batch:   1%|          | 1/104 [00:30<52:11, 30.40s/it]
batch:   2%|▏         | 2/104 [00:30<21:46, 12.81s/it]
batch:   3%|▎         | 3/104 [00:31<12:06,  7.19s/it]
batch:   4%|▍         | 4/104 [00:31<07:36,  4.57s/it]
batch:   5%|▍         | 5/104 [00:32<05:06,  3.10s/it]
batch:   6%|▌         | 6/104 [00:32<03:33,  2.18s/it]
batch:   7%|▋         | 7/104 [00:33<02:34,  1.59s/it]
batch:   8%|▊         | 8/104 [00:33<01:56,  1.21s/it]
batch:   9%|▊         | 9/104 [00:34<01:35,  1.00s/it]
batch:  10%|▉         | 10/104 [00:34<01:19,  1.18it/s]
batch:  11%|█         | 11/104 [00:35<01:10,  1.32it/s]
batch:  12%|█▏        | 12/104 [00:35<01:02,  1.48it/s]
batch:  12%|█▎        | 13/104 [00:36<00:53,  1.69it/s]
batch:  13%|█▎        | 14/104 [00:36<00:50,  1.76it/s]
batch:  14%|█▍        | 15/104 [00:37<00:48,  1.83it/s]
batch:  15%|█▌        | 16/104 [00:37<00:48,  1.80it/s]
batch:  16%|█▋        | 17/104 [00:38<00:47,  1.82it/s]
batch:  17%|█▋        | 18/104 [00:38<00:45,  1.91it/s]
batch:  18%|█▊        | 19/104 [00:39<00:44,  1.89it/s]
batch:  19%|█▉        | 20/104 [00:39<00:43,  1.93it/s]
batch:  20%|██        | 21/104 [00:40<00:42,  1.95it/s]
batch:  21%|██        | 22/104 [00:40<00:40,  2.00it/s]
batch:  22%|██▏       | 23/104 [00:41<00:37,  2.17it/s]
batch:  23%|██▎       | 24/104 [00:41<00:38,  2.07it/s]
batch:  24%|██▍       | 25/104 [00:42<00:39,  2.00it/s]
batch:  25%|██▌       | 26/104 [00:42<00:40,  1.93it/s]
batch:  26%|██▌       | 27/104 [00:43<00:39,  1.95it/s]
batch:  27%|██▋       | 28/104 [00:43<00:39,  1.95it/s]
batch:  28%|██▊       | 29/104 [00:44<00:39,  1.91it/s]
batch:  29%|██▉       | 30/104 [00:44<00:37,  1.96it/s]
batch:  30%|██▉       | 31/104 [00:45<00:34,  2.11it/s]
batch:  31%|███       | 32/104 [00:45<00:32,  2.21it/s]
batch:  32%|███▏      | 33/104 [00:45<00:30,  2.30it/s]
batch:  33%|███▎      | 34/104 [00:46<00:29,  2.36it/s]
batch:  34%|███▎      | 35/104 [00:46<00:30,  2.23it/s]
batch:  35%|███▍      | 36/104 [00:47<00:31,  2.19it/s]
batch:  36%|███▌      | 37/104 [00:47<00:29,  2.30it/s]
batch:  37%|███▋      | 38/104 [00:48<00:27,  2.41it/s]
batch:  38%|███▊      | 39/104 [00:48<00:26,  2.48it/s]
batch:  38%|███▊      | 40/104 [00:48<00:28,  2.26it/s]
batch:  39%|███▉      | 41/104 [00:49<00:27,  2.33it/s]
batch:  40%|████      | 42/104 [00:49<00:25,  2.42it/s]
batch:  41%|████▏     | 43/104 [00:50<00:24,  2.46it/s]
batch:  42%|████▏     | 44/104 [00:50<00:23,  2.52it/s]
batch:  43%|████▎     | 45/104 [00:51<00:25,  2.29it/s]
batch:  44%|████▍     | 46/104 [00:51<00:24,  2.36it/s]
batch:  45%|████▌     | 47/104 [00:51<00:23,  2.45it/s]
batch:  46%|████▌     | 48/104 [00:52<00:22,  2.51it/s]
batch:  47%|████▋     | 49/104 [00:52<00:21,  2.55it/s]
batch:  48%|████▊     | 50/104 [00:53<00:23,  2.32it/s]
batch:  49%|████▉     | 51/104 [00:53<00:23,  2.28it/s]
batch:  50%|█████     | 52/104 [00:54<00:23,  2.17it/s]
batch:  51%|█████     | 53/104 [00:54<00:22,  2.24it/s]
batch:  52%|█████▏    | 54/104 [00:54<00:21,  2.29it/s]
batch:  53%|█████▎    | 55/104 [00:55<00:22,  2.15it/s]
batch:  54%|█████▍    | 56/104 [00:55<00:22,  2.14it/s]
batch:  55%|█████▍    | 57/104 [00:56<00:20,  2.24it/s]
batch:  56%|█████▌    | 58/104 [00:56<00:21,  2.16it/s]
batch:  57%|█████▋    | 59/104 [00:57<00:21,  2.05it/s]
batch:  58%|█████▊    | 60/104 [00:57<00:21,  2.09it/s]
batch:  59%|█████▊    | 61/104 [00:58<00:19,  2.21it/s]
batch:  60%|█████▉    | 62/104 [00:58<00:18,  2.30it/s]
batch:  61%|██████    | 63/104 [00:58<00:17,  2.36it/s]
batch:  62%|██████▏   | 64/104 [00:59<00:16,  2.41it/s]
batch:  62%|██████▎   | 65/104 [00:59<00:17,  2.26it/s]
batch:  63%|██████▎   | 66/104 [01:00<00:18,  2.04it/s]
batch:  64%|██████▍   | 67/104 [01:01<00:18,  1.97it/s]
batch:  65%|██████▌   | 68/104 [01:01<00:18,  1.94it/s]
batch:  66%|██████▋   | 69/104 [01:02<00:18,  1.93it/s]
batch:  67%|██████▋   | 70/104 [01:02<00:17,  1.93it/s]
batch:  68%|██████▊   | 71/104 [01:03<00:17,  1.93it/s]
batch:  69%|██████▉   | 72/104 [01:03<00:15,  2.04it/s]
batch:  70%|███████   | 73/104 [01:03<00:14,  2.17it/s]
batch:  71%|███████   | 74/104 [01:04<00:14,  2.11it/s]
batch:  72%|███████▏  | 75/104 [01:04<00:13,  2.20it/s]
batch:  73%|███████▎  | 76/104 [01:05<00:12,  2.29it/s]
batch:  74%|███████▍  | 77/104 [01:05<00:12,  2.18it/s]
batch:  75%|███████▌  | 78/104 [01:06<00:11,  2.17it/s]
batch:  76%|███████▌  | 79/104 [01:06<00:12,  2.08it/s]
batch:  77%|███████▋  | 80/104 [01:07<00:11,  2.03it/s]
batch:  78%|███████▊  | 81/104 [01:07<00:11,  2.09it/s]
batch:  79%|███████▉  | 82/104 [01:08<00:09,  2.24it/s]
batch:  80%|███████▉  | 83/104 [01:08<00:08,  2.35it/s]
batch:  81%|████████  | 84/104 [01:08<00:09,  2.19it/s]
batch:  82%|████████▏ | 85/104 [01:09<00:08,  2.28it/s]
batch:  83%|████████▎ | 86/104 [01:09<00:07,  2.39it/s]
batch:  84%|████████▎ | 87/104 [01:10<00:07,  2.22it/s]
batch:  85%|████████▍ | 88/104 [01:10<00:07,  2.21it/s]
batch:  86%|████████▌ | 89/104 [01:11<00:06,  2.30it/s]
batch:  87%|████████▋ | 90/104 [01:11<00:06,  2.19it/s]
batch:  88%|████████▊ | 91/104 [01:12<00:06,  2.14it/s]
batch:  88%|████████▊ | 92/104 [01:12<00:05,  2.05it/s]
batch:  89%|████████▉ | 93/104 [01:13<00:05,  2.00it/s]
batch:  90%|█████████ | 94/104 [01:13<00:05,  1.98it/s]
batch:  91%|█████████▏| 95/104 [01:14<00:04,  1.96it/s]
batch:  92%|█████████▏| 96/104 [01:14<00:03,  2.09it/s]
batch:  93%|█████████▎| 97/104 [01:15<00:03,  2.01it/s]
batch:  94%|█████████▍| 98/104 [01:15<00:02,  2.01it/s]
batch:  95%|█████████▌| 99/104 [01:16<00:02,  2.15it/s]
batch:  96%|█████████▌| 100/104 [01:16<00:01,  2.06it/s]
batch:  97%|█████████▋| 101/104 [01:17<00:01,  2.01it/s]
batch:  98%|█████████▊| 102/104 [01:17<00:00,  2.11it/s]
batch:  99%|█████████▉| 103/104 [01:17<00:00,  2.35it/s]
batch: 100%|██████████| 104/104 [01:17<00:00,  1.33it/s]

  0%|          | 0/6562 [00:00<?, ?it/s]
  1%|          | 56/6562 [00:00<00:11, 555.98it/s]
  2%|▏         | 139/6562 [00:00<00:09, 709.55it/s]
  4%|▎         | 239/6562 [00:00<00:07, 837.87it/s]
  5%|▌         | 341/6562 [00:00<00:06, 908.36it/s]
  7%|▋         | 442/6562 [00:00<00:06, 944.17it/s]
  8%|▊         | 541/6562 [00:00<00:06, 959.59it/s]
 10%|▉         | 645/6562 [00:00<00:06, 983.43it/s]
 11%|█▏        | 746/6562 [00:00<00:05, 985.13it/s]
 13%|█▎        | 848/6562 [00:00<00:05, 990.78it/s]
 14%|█▍        | 949/6562 [00:01<00:05, 993.42it/s]
 16%|█▌        | 1049/6562 [00:01<00:05, 989.92it/s]
 17%|█▋        | 1148/6562 [00:01<00:05, 986.38it/s]
 19%|█▉        | 1247/6562 [00:01<00:05, 983.04it/s]
 21%|██        | 1346/6562 [00:01<00:05, 980.87it/s]
 22%|██▏       | 1445/6562 [00:01<00:05, 975.21it/s]
 24%|██▎       | 1543/6562 [00:01<00:05, 973.06it/s]
 25%|██▌       | 1641/6562 [00:01<00:05, 968.77it/s]
 27%|██▋       | 1739/6562 [00:01<00:04, 971.69it/s]
 28%|██▊       | 1837/6562 [00:01<00:04, 967.31it/s]
 29%|██▉       | 1934/6562 [00:02<00:04, 966.30it/s]
 31%|███       | 2032/6562 [00:02<00:04, 968.70it/s]
 32%|███▏      | 2130/6562 [00:02<00:04, 967.56it/s]
 34%|███▍      | 2228/6562 [00:02<00:04, 966.90it/s]
 35%|███▌      | 2325/6562 [00:02<00:04, 962.61it/s]
 37%|███▋      | 2422/6562 [00:02<00:04, 961.93it/s]
 38%|███▊      | 2519/6562 [00:02<00:04, 948.78it/s]
 40%|███▉      | 2616/6562 [00:02<00:04, 954.48it/s]
 41%|████▏     | 2712/6562 [00:02<00:04, 949.02it/s]
 43%|████▎     | 2811/6562 [00:02<00:03, 954.96it/s]
 44%|████▍     | 2910/6562 [00:03<00:03, 964.36it/s]
 46%|████▌     | 3007/6562 [00:03<00:03, 956.54it/s]
 47%|████▋     | 3103/6562 [00:03<00:03, 947.21it/s]
 49%|████▊     | 3198/6562 [00:03<00:03, 937.15it/s]
 50%|█████     | 3293/6562 [00:03<00:03, 937.10it/s]
 52%|█████▏    | 3388/6562 [00:03<00:03, 937.63it/s]
 53%|█████▎    | 3484/6562 [00:03<00:03, 941.10it/s]
 55%|█████▍    | 3579/6562 [00:03<00:03, 940.83it/s]
 56%|█████▌    | 3674/6562 [00:03<00:03, 939.05it/s]
 57%|█████▋    | 3768/6562 [00:03<00:02, 934.89it/s]
 59%|█████▉    | 3864/6562 [00:04<00:02, 936.47it/s]
 60%|██████    | 3958/6562 [00:04<00:02, 933.00it/s]
 62%|██████▏   | 4052/6562 [00:04<00:02, 926.66it/s]
 63%|██████▎   | 4145/6562 [00:04<00:02, 923.36it/s]
 65%|██████▍   | 4238/6562 [00:04<00:02, 923.30it/s]
 66%|██████▌   | 4331/6562 [00:04<00:02, 923.90it/s]
 67%|██████▋   | 4424/6562 [00:04<00:02, 925.61it/s]
 69%|██████▉   | 4517/6562 [00:04<00:02, 918.55it/s]
 70%|███████   | 4610/6562 [00:04<00:02, 918.84it/s]
 72%|███████▏  | 4703/6562 [00:04<00:02, 917.59it/s]
 73%|███████▎  | 4795/6562 [00:05<00:01, 917.06it/s]
 74%|███████▍  | 4887/6562 [00:05<00:01, 913.93it/s]
 76%|███████▌  | 4979/6562 [00:05<00:01, 911.47it/s]
 77%|███████▋  | 5072/6562 [00:05<00:01, 912.28it/s]
 79%|███████▊  | 5164/6562 [00:05<00:01, 907.19it/s]
 80%|████████  | 5255/6562 [00:05<00:01, 903.17it/s]
 81%|████████▏ | 5346/6562 [00:05<00:01, 899.56it/s]
 83%|████████▎ | 5436/6562 [00:05<00:01, 899.02it/s]
 84%|████████▍ | 5528/6562 [00:05<00:01, 900.16it/s]
 86%|████████▌ | 5619/6562 [00:05<00:01, 898.59it/s]
 87%|████████▋ | 5709/6562 [00:06<00:00, 892.77it/s]
 88%|████████▊ | 5799/6562 [00:06<00:00, 890.68it/s]
 90%|████████▉ | 5889/6562 [00:06<00:00, 881.19it/s]
 91%|█████████ | 5978/6562 [00:06<00:00, 873.16it/s]
 92%|█████████▏| 6066/6562 [00:06<00:00, 872.39it/s]
 94%|█████████▍| 6154/6562 [00:06<00:00, 873.42it/s]
 95%|█████████▌| 6242/6562 [00:06<00:00, 869.45it/s]
 96%|█████████▋| 6329/6562 [00:06<00:00, 850.54it/s]
 98%|█████████▊| 6415/6562 [00:06<00:00, 833.57it/s]
 99%|█████████▉| 6499/6562 [00:07<00:00, 817.78it/s]
100%|██████████| 6562/6562 [00:07<00:00, 922.32it/s]

  0%|          | 0/6562 [00:00<?, ?it/s]
  2%|▏         | 100/6562 [00:00<00:06, 986.31it/s]
  3%|▎         | 200/6562 [00:00<00:06, 993.43it/s]
  5%|▍         | 304/6562 [00:00<00:06, 1005.97it/s]
  6%|▌         | 406/6562 [00:00<00:06, 1010.76it/s]
  8%|▊         | 508/6562 [00:00<00:06, 1003.77it/s]
  9%|▉         | 612/6562 [00:00<00:05, 1015.27it/s]
 11%|█         | 714/6562 [00:00<00:05, 1013.82it/s]
 12%|█▏        | 816/6562 [00:00<00:05, 1010.23it/s]
 14%|█▍        | 918/6562 [00:00<00:05, 1001.07it/s]
 16%|█▌        | 1019/6562 [00:01<00:05, 1000.50it/s]
 17%|█▋        | 1120/6562 [00:01<00:05, 993.91it/s] 
 19%|█▊        | 1220/6562 [00:01<00:05, 992.22it/s]
 20%|██        | 1320/6562 [00:01<00:05, 993.75it/s]
 22%|██▏       | 1420/6562 [00:01<00:05, 980.78it/s]
 23%|██▎       | 1520/6562 [00:01<00:05, 981.46it/s]
 25%|██▍       | 1620/6562 [00:01<00:05, 981.69it/s]
 26%|██▌       | 1719/6562 [00:01<00:04, 983.22it/s]
 28%|██▊       | 1818/6562 [00:01<00:04, 978.53it/s]
 29%|██▉       | 1916/6562 [00:01<00:04, 969.91it/s]
 31%|███       | 2015/6562 [00:02<00:04, 974.27it/s]
 32%|███▏      | 2113/6562 [00:02<00:04, 971.47it/s]
 34%|███▎      | 2211/6562 [00:02<00:04, 971.97it/s]
 35%|███▌      | 2309/6562 [00:02<00:04, 969.20it/s]
 37%|███▋      | 2406/6562 [00:02<00:04, 965.52it/s]
 38%|███▊      | 2503/6562 [00:02<00:04, 961.14it/s]
 40%|███▉      | 2600/6562 [00:02<00:04, 958.60it/s]
 41%|████      | 2697/6562 [00:02<00:04, 957.07it/s]
 43%|████▎     | 2794/6562 [00:02<00:03, 960.38it/s]
 44%|████▍     | 2893/6562 [00:02<00:03, 968.74it/s]
 46%|████▌     | 2990/6562 [00:03<00:03, 967.18it/s]
 47%|████▋     | 3087/6562 [00:03<00:03, 952.94it/s]
 49%|████▊     | 3183/6562 [00:03<00:03, 944.39it/s]
 50%|████▉     | 3278/6562 [00:03<00:03, 941.37it/s]
 51%|█████▏    | 3373/6562 [00:03<00:03, 941.91it/s]
 53%|█████▎    | 3468/6562 [00:03<00:03, 940.42it/s]
 54%|█████▍    | 3563/6562 [00:03<00:03, 935.26it/s]
 56%|█████▌    | 3657/6562 [00:03<00:03, 935.79it/s]
 57%|█████▋    | 3751/6562 [00:03<00:03, 934.33it/s]
 59%|█████▊    | 3847/6562 [00:03<00:02, 936.16it/s]
 60%|██████    | 3941/6562 [00:04<00:02, 937.07it/s]
 61%|██████▏   | 4035/6562 [00:04<00:02, 929.28it/s]
 63%|██████▎   | 4128/6562 [00:04<00:02, 928.22it/s]
 64%|██████▍   | 4221/6562 [00:04<00:02, 928.39it/s]
 66%|██████▌   | 4314/6562 [00:04<00:02, 926.43it/s]
 67%|██████▋   | 4408/6562 [00:04<00:02, 924.76it/s]
 69%|██████▊   | 4501/6562 [00:04<00:02, 922.43it/s]
 70%|███████   | 4594/6562 [00:04<00:02, 922.73it/s]
 71%|███████▏  | 4687/6562 [00:04<00:02, 920.13it/s]
 73%|███████▎  | 4780/6562 [00:04<00:01, 922.62it/s]
 74%|███████▍  | 4873/6562 [00:05<00:01, 916.62it/s]
 76%|███████▌  | 4966/6562 [00:05<00:01, 917.34it/s]
 77%|███████▋  | 5058/6562 [00:05<00:01, 914.87it/s]
 78%|███████▊  | 5150/6562 [00:05<00:01, 908.29it/s]
 80%|███████▉  | 5241/6562 [00:05<00:01, 904.83it/s]
 81%|████████▏ | 5332/6562 [00:05<00:01, 900.86it/s]
 83%|████████▎ | 5424/6562 [00:05<00:01, 900.61it/s]
 84%|████████▍ | 5517/6562 [00:05<00:01, 904.19it/s]
 85%|████████▌ | 5608/6562 [00:05<00:01, 901.59it/s]
 87%|████████▋ | 5699/6562 [00:05<00:00, 898.71it/s]
 88%|████████▊ | 5789/6562 [00:06<00:00, 891.34it/s]
 90%|████████▉ | 5879/6562 [00:06<00:00, 889.13it/s]
 91%|█████████ | 5968/6562 [00:06<00:00, 886.33it/s]
 92%|█████████▏| 6057/6562 [00:06<00:00, 879.68it/s]
 94%|█████████▎| 6146/6562 [00:06<00:00, 881.93it/s]
 95%|█████████▌| 6235/6562 [00:06<00:00, 874.04it/s]
 96%|█████████▋| 6325/6562 [00:06<00:00, 881.06it/s]
 98%|█████████▊| 6414/6562 [00:06<00:00, 876.38it/s]
 99%|█████████▉| 6502/6562 [00:06<00:00, 864.94it/s]
100%|██████████| 6562/6562 [00:06<00:00, 938.87it/s]
2026-05-11 03:25:02.092135: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:25:49.145337: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:25:49.155316: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-11 03:25:49.188094: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:82:00.0 name: Tesla P100-PCIE-16GB computeCapability: 6.0
coreClock: 1.3285GHz coreCount: 56 deviceMemorySize: 15.89GiB deviceMemoryBandwidth: 681.88GiB/s
2026-05-11 03:25:49.188217: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:25:49.196046: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:25:49.196128: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:25:49.200641: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:25:49.203472: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:25:49.209283: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:25:49.212709: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:25:49.215562: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:25:49.216237: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:25:49.216771: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-11 03:25:49.216929: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:25:49.217417: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:82:00.0 name: Tesla P100-PCIE-16GB computeCapability: 6.0
coreClock: 1.3285GHz coreCount: 56 deviceMemorySize: 15.89GiB deviceMemoryBandwidth: 681.88GiB/s
2026-05-11 03:25:49.217483: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:25:49.217534: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:25:49.217582: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:25:49.217629: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:25:49.217702: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:25:49.217751: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:25:49.217798: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:25:49.217845: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:25:49.218385: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:25:49.218459: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:25:49.777056: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-11 03:25:49.777201: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-11 03:25:49.777227: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-11 03:25:49.778264: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 14950 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-16GB, pci bus id: 0000:82:00.0, compute capability: 6.0)
2026-05-11 03:25:49.845988: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:196] None of the MLIR optimization passes are enabled (registered 0 passes)
2026-05-11 03:25:49.866212: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2400130000 Hz
2026-05-11 03:25:57.313190: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:25:57.634284: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:25:57.640532: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:25:58.720919: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-11 03:25:58.840836: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
RuntimeError: module compiled against API version 0xe but this version of numpy is 0xd
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)