Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded: curl/8.4.0
(required by: htslib/1.16)
-------------------------------------------------------------------------------




The following have been reloaded with a version change:
  1) curl/8.4.0 => curl/8.17.0     2) openssl/3.0.7 => openssl/3.6.0

2026-05-11 03:23:27.375503: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:24:18.315566: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:24:18.321150: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-11 03:24:18.338282: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:82:00.0 name: Tesla P100-PCIE-16GB computeCapability: 6.0
coreClock: 1.3285GHz coreCount: 56 deviceMemorySize: 15.89GiB deviceMemoryBandwidth: 681.88GiB/s
2026-05-11 03:24:18.338361: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:24:18.344091: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:24:18.344158: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:24:18.346921: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:24:18.348474: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:24:18.353234: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:24:18.355549: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:24:18.357066: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:24:18.357566: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:24:18.358032: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-11 03:24:18.358186: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:24:18.358896: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:82:00.0 name: Tesla P100-PCIE-16GB computeCapability: 6.0
coreClock: 1.3285GHz coreCount: 56 deviceMemorySize: 15.89GiB deviceMemoryBandwidth: 681.88GiB/s
2026-05-11 03:24:18.359002: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:24:18.359072: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:24:18.359126: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:24:18.359175: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:24:18.359224: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:24:18.359272: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:24:18.359320: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:24:18.359403: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:24:18.360202: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:24:18.360295: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:24:19.052517: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-11 03:24:19.052665: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-11 03:24:19.052692: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-11 03:24:19.053698: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 14950 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-16GB, pci bus id: 0000:82:00.0, compute capability: 6.0)
2026-05-11 03:24:22.017304: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2026-05-11 03:24:22.018176: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2399890000 Hz
2026-05-11 03:24:29.766939: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:24:30.789209: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:24:30.823481: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:24:31.956018: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-11 03:24:32.088169: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'jitters', 'index', 'status', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
2026-05-11 03:43:07.698056: W tensorflow/python/util/util.cc:348] Sets are not currently considered sequences, but this may change in the future, so consider avoiding using them.
2026-05-11 03:45:14.399656: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:51:38.915263: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:51:38.917418: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-11 03:51:38.996676: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:82:00.0 name: Tesla P100-PCIE-16GB computeCapability: 6.0
coreClock: 1.3285GHz coreCount: 56 deviceMemorySize: 15.89GiB deviceMemoryBandwidth: 681.88GiB/s
2026-05-11 03:51:38.996836: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:51:39.046156: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:51:39.046304: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:51:39.069580: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:51:39.077616: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:51:39.092658: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:51:39.102072: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:51:39.111483: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:51:39.112505: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:51:39.113196: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-11 03:51:39.113659: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:51:39.114337: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:82:00.0 name: Tesla P100-PCIE-16GB computeCapability: 6.0
coreClock: 1.3285GHz coreCount: 56 deviceMemorySize: 15.89GiB deviceMemoryBandwidth: 681.88GiB/s
2026-05-11 03:51:39.114432: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:51:39.114522: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:51:39.114584: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:51:39.114642: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:51:39.114699: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:51:39.114756: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:51:39.114812: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:51:39.114869: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:51:39.115692: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:51:39.115798: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:51:39.824892: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-11 03:51:39.825054: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-11 03:51:39.825079: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-11 03:51:39.826366: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 14950 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-16GB, pci bus id: 0000:82:00.0, compute capability: 6.0)
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)

batch:   0%|          | 0/68 [00:00<?, ?it/s]2026-05-11 03:51:42.367389: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2026-05-11 03:51:42.368206: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2399890000 Hz
2026-05-11 03:51:42.914899: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:51:43.230500: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:51:43.232238: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:51:44.515314: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-11 03:51:44.610547: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'true_profiles', 'true_logcounts', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])

batch:   1%|▏         | 1/68 [00:58<1:05:36, 58.75s/it]
batch:   3%|▎         | 2/68 [00:59<26:57, 24.51s/it]  
batch:   4%|▍         | 3/68 [00:59<14:41, 13.56s/it]
batch:   6%|▌         | 4/68 [01:00<08:58,  8.42s/it]
batch:   7%|▋         | 5/68 [01:00<05:49,  5.55s/it]
batch:   9%|▉         | 6/68 [01:01<03:55,  3.79s/it]
batch:  10%|█         | 7/68 [01:01<02:43,  2.68s/it]
batch:  12%|█▏        | 8/68 [01:01<01:56,  1.95s/it]
batch:  13%|█▎        | 9/68 [01:02<01:25,  1.46s/it]
batch:  15%|█▍        | 10/68 [01:02<01:05,  1.12s/it]
batch:  16%|█▌        | 11/68 [01:03<00:51,  1.12it/s]
batch:  18%|█▊        | 12/68 [01:03<00:44,  1.26it/s]
batch:  19%|█▉        | 13/68 [01:04<00:39,  1.40it/s]
batch:  21%|██        | 14/68 [01:04<00:35,  1.52it/s]
batch:  22%|██▏       | 15/68 [01:05<00:31,  1.68it/s]
batch:  24%|██▎       | 16/68 [01:05<00:27,  1.89it/s]
batch:  25%|██▌       | 17/68 [01:05<00:24,  2.06it/s]
batch:  26%|██▋       | 18/68 [01:06<00:22,  2.21it/s]
batch:  28%|██▊       | 19/68 [01:06<00:21,  2.33it/s]
batch:  29%|██▉       | 20/68 [01:07<00:22,  2.17it/s]
batch:  31%|███       | 21/68 [01:07<00:22,  2.08it/s]
batch:  32%|███▏      | 22/68 [01:08<00:22,  2.03it/s]
batch:  34%|███▍      | 23/68 [01:08<00:21,  2.09it/s]
batch:  35%|███▌      | 24/68 [01:09<00:19,  2.22it/s]
batch:  37%|███▋      | 25/68 [01:09<00:18,  2.31it/s]
batch:  38%|███▊      | 26/68 [01:09<00:17,  2.40it/s]
batch:  40%|███▉      | 27/68 [01:10<00:18,  2.21it/s]
batch:  41%|████      | 28/68 [01:10<00:19,  2.10it/s]
batch:  43%|████▎     | 29/68 [01:11<00:19,  2.03it/s]
batch:  44%|████▍     | 30/68 [01:11<00:19,  1.99it/s]
batch:  46%|████▌     | 31/68 [01:12<00:18,  1.97it/s]
batch:  47%|████▋     | 32/68 [01:13<00:18,  1.94it/s]
batch:  49%|████▊     | 33/68 [01:13<00:18,  1.93it/s]
batch:  50%|█████     | 34/68 [01:14<00:17,  1.92it/s]
batch:  51%|█████▏    | 35/68 [01:14<00:17,  1.92it/s]
batch:  53%|█████▎    | 36/68 [01:15<00:16,  1.90it/s]
batch:  54%|█████▍    | 37/68 [01:15<00:15,  1.96it/s]
batch:  56%|█████▌    | 38/68 [01:16<00:14,  2.10it/s]
batch:  57%|█████▋    | 39/68 [01:16<00:13,  2.20it/s]
batch:  59%|█████▉    | 40/68 [01:16<00:13,  2.12it/s]
batch:  60%|██████    | 41/68 [01:17<00:12,  2.08it/s]
batch:  62%|██████▏   | 42/68 [01:17<00:12,  2.06it/s]
batch:  63%|██████▎   | 43/68 [01:18<00:12,  1.97it/s]
batch:  65%|██████▍   | 44/68 [01:19<00:12,  1.94it/s]
batch:  66%|██████▌   | 45/68 [01:19<00:11,  1.93it/s]
batch:  68%|██████▊   | 46/68 [01:20<00:11,  1.90it/s]
batch:  69%|██████▉   | 47/68 [01:20<00:10,  1.94it/s]
batch:  71%|███████   | 48/68 [01:20<00:09,  2.11it/s]
batch:  72%|███████▏  | 49/68 [01:21<00:08,  2.24it/s]
batch:  74%|███████▎  | 50/68 [01:21<00:07,  2.34it/s]
batch:  75%|███████▌  | 51/68 [01:22<00:07,  2.21it/s]
batch:  76%|███████▋  | 52/68 [01:22<00:07,  2.11it/s]
batch:  78%|███████▊  | 53/68 [01:23<00:07,  2.01it/s]
batch:  79%|███████▉  | 54/68 [01:23<00:07,  1.97it/s]
batch:  81%|████████  | 55/68 [01:24<00:06,  1.95it/s]
batch:  82%|████████▏ | 56/68 [01:24<00:05,  2.03it/s]
batch:  84%|████████▍ | 57/68 [01:25<00:05,  2.18it/s]
batch:  85%|████████▌ | 58/68 [01:25<00:04,  2.11it/s]
batch:  87%|████████▋ | 59/68 [01:26<00:04,  2.14it/s]
batch:  88%|████████▊ | 60/68 [01:26<00:03,  2.27it/s]
batch:  90%|████████▉ | 61/68 [01:27<00:03,  2.12it/s]
batch:  91%|█████████ | 62/68 [01:27<00:02,  2.07it/s]
batch:  93%|█████████▎| 63/68 [01:28<00:02,  2.17it/s]
batch:  94%|█████████▍| 64/68 [01:28<00:01,  2.10it/s]
batch:  96%|█████████▌| 65/68 [01:29<00:01,  2.07it/s]
batch:  97%|█████████▋| 66/68 [01:29<00:01,  1.87it/s]
batch:  99%|█████████▊| 67/68 [01:30<00:00,  2.04it/s]
batch: 100%|██████████| 68/68 [01:30<00:00,  2.32it/s]
batch: 100%|██████████| 68/68 [01:30<00:00,  1.33s/it]

  0%|          | 0/4312 [00:00<?, ?it/s]
  2%|▏         | 97/4312 [00:00<00:04, 967.03it/s]
  5%|▍         | 201/4312 [00:00<00:04, 1008.83it/s]
  7%|▋         | 302/4312 [00:00<00:03, 1009.22it/s]
  9%|▉         | 406/4312 [00:00<00:03, 1016.05it/s]
 12%|█▏        | 510/4312 [00:00<00:03, 1023.57it/s]
 14%|█▍        | 613/4312 [00:00<00:03, 1023.82it/s]
 17%|█▋        | 716/4312 [00:00<00:03, 1015.91it/s]
 19%|█▉        | 818/4312 [00:00<00:03, 1006.27it/s]
 21%|██▏       | 920/4312 [00:00<00:03, 1009.50it/s]
 24%|██▎       | 1024/4312 [00:01<00:03, 1014.40it/s]
 26%|██▌       | 1126/4312 [00:01<00:03, 1008.95it/s]
 29%|██▊       | 1229/4312 [00:01<00:03, 1012.03it/s]
 31%|███       | 1331/4312 [00:01<00:02, 1006.90it/s]
 33%|███▎      | 1432/4312 [00:01<00:02, 1006.92it/s]
 36%|███▌      | 1533/4312 [00:01<00:02, 1000.93it/s]
 38%|███▊      | 1634/4312 [00:01<00:02, 992.68it/s] 
 40%|████      | 1734/4312 [00:01<00:02, 986.04it/s]
 43%|████▎     | 1835/4312 [00:01<00:02, 987.97it/s]
 45%|████▍     | 1936/4312 [00:01<00:02, 992.09it/s]
 47%|████▋     | 2036/4312 [00:02<00:02, 979.39it/s]
 49%|████▉     | 2134/4312 [00:02<00:02, 970.61it/s]
 52%|█████▏    | 2232/4312 [00:02<00:02, 966.09it/s]
 54%|█████▍    | 2330/4312 [00:02<00:02, 968.84it/s]
 56%|█████▋    | 2428/4312 [00:02<00:01, 971.08it/s]
 59%|█████▊    | 2526/4312 [00:02<00:01, 958.97it/s]
 61%|██████    | 2622/4312 [00:02<00:01, 927.05it/s]
 63%|██████▎   | 2715/4312 [00:02<00:01, 910.79it/s]
 65%|██████▌   | 2807/4312 [00:02<00:01, 912.05it/s]
 67%|██████▋   | 2899/4312 [00:02<00:01, 914.16it/s]
 69%|██████▉   | 2992/4312 [00:03<00:01, 918.05it/s]
 72%|███████▏  | 3084/4312 [00:03<00:01, 916.22it/s]
 74%|███████▎  | 3178/4312 [00:03<00:01, 921.60it/s]
 76%|███████▌  | 3271/4312 [00:03<00:01, 923.95it/s]
 78%|███████▊  | 3365/4312 [00:03<00:01, 926.81it/s]
 80%|████████  | 3458/4312 [00:03<00:00, 921.78it/s]
 82%|████████▏ | 3555/4312 [00:03<00:00, 930.64it/s]
 85%|████████▍ | 3649/4312 [00:03<00:00, 927.63it/s]
 87%|████████▋ | 3742/4312 [00:03<00:00, 924.28it/s]
 89%|████████▉ | 3835/4312 [00:03<00:00, 914.00it/s]
 91%|█████████ | 3927/4312 [00:04<00:00, 899.82it/s]
 93%|█████████▎| 4020/4312 [00:04<00:00, 902.55it/s]
 95%|█████████▌| 4111/4312 [00:04<00:00, 895.32it/s]
 97%|█████████▋| 4201/4312 [00:04<00:00, 888.64it/s]
 99%|█████████▉| 4290/4312 [00:04<00:00, 879.66it/s]
100%|██████████| 4312/4312 [00:04<00:00, 953.14it/s]

  0%|          | 0/4312 [00:00<?, ?it/s]
  2%|▏         | 97/4312 [00:00<00:04, 956.69it/s]
  4%|▍         | 194/4312 [00:00<00:04, 962.56it/s]
  7%|▋         | 291/4312 [00:00<00:04, 951.07it/s]
  9%|▉         | 390/4312 [00:00<00:04, 963.06it/s]
 11%|█▏        | 492/4312 [00:00<00:03, 981.50it/s]
 14%|█▍        | 595/4312 [00:00<00:03, 996.27it/s]
 16%|█▌        | 699/4312 [00:00<00:03, 1003.46it/s]
 19%|█▊        | 800/4312 [00:00<00:03, 1001.52it/s]
 21%|██        | 901/4312 [00:00<00:03, 1000.78it/s]
 23%|██▎       | 1002/4312 [00:01<00:03, 999.73it/s]
 26%|██▌       | 1106/4312 [00:01<00:03, 1006.75it/s]
 28%|██▊       | 1209/4312 [00:01<00:03, 1013.29it/s]
 30%|███       | 1311/4312 [00:01<00:03, 997.96it/s] 
 33%|███▎      | 1412/4312 [00:01<00:02, 1000.04it/s]
 35%|███▌      | 1513/4312 [00:01<00:02, 1001.51it/s]
 37%|███▋      | 1614/4312 [00:01<00:02, 987.99it/s] 
 40%|███▉      | 1713/4312 [00:01<00:02, 982.28it/s]
 42%|████▏     | 1814/4312 [00:01<00:02, 985.10it/s]
 44%|████▍     | 1914/4312 [00:01<00:02, 984.64it/s]
 47%|████▋     | 2014/4312 [00:02<00:02, 988.10it/s]
 49%|████▉     | 2113/4312 [00:02<00:02, 972.15it/s]
 51%|█████▏    | 2211/4312 [00:02<00:02, 964.71it/s]
 54%|█████▎    | 2310/4312 [00:02<00:02, 969.64it/s]
 56%|█████▌    | 2408/4312 [00:02<00:01, 969.27it/s]
 58%|█████▊    | 2505/4312 [00:02<00:01, 968.19it/s]
 60%|██████    | 2602/4312 [00:02<00:01, 956.95it/s]
 63%|██████▎   | 2698/4312 [00:02<00:01, 957.57it/s]
 65%|██████▍   | 2794/4312 [00:02<00:01, 943.08it/s]
 67%|██████▋   | 2889/4312 [00:02<00:01, 934.94it/s]
 69%|██████▉   | 2983/4312 [00:03<00:01, 929.11it/s]
 71%|███████▏  | 3076/4312 [00:03<00:01, 926.84it/s]
 74%|███████▎  | 3173/4312 [00:03<00:01, 938.49it/s]
 76%|███████▌  | 3267/4312 [00:03<00:01, 932.60it/s]
 78%|███████▊  | 3362/4312 [00:03<00:01, 933.72it/s]
 80%|████████  | 3456/4312 [00:03<00:00, 928.48it/s]
 82%|████████▏ | 3552/4312 [00:03<00:00, 933.47it/s]
 85%|████████▍ | 3646/4312 [00:03<00:00, 931.62it/s]
 87%|████████▋ | 3740/4312 [00:03<00:00, 928.93it/s]
 89%|████████▉ | 3833/4312 [00:03<00:00, 916.91it/s]
 91%|█████████ | 3925/4312 [00:04<00:00, 902.59it/s]
 93%|█████████▎| 4017/4312 [00:04<00:00, 903.29it/s]
 95%|█████████▌| 4108/4312 [00:04<00:00, 898.10it/s]
 97%|█████████▋| 4198/4312 [00:04<00:00, 891.39it/s]
 99%|█████████▉| 4288/4312 [00:04<00:00, 877.26it/s]
100%|██████████| 4312/4312 [00:04<00:00, 953.11it/s]
2026-05-11 03:57:11.079335: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:59:18.486599: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:59:18.494297: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-11 03:59:18.517908: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:82:00.0 name: Tesla P100-PCIE-16GB computeCapability: 6.0
coreClock: 1.3285GHz coreCount: 56 deviceMemorySize: 15.89GiB deviceMemoryBandwidth: 681.88GiB/s
2026-05-11 03:59:18.518048: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:59:18.531087: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:59:18.531167: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:59:18.537092: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:59:18.543024: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:59:18.551048: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:59:18.557060: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:59:18.562667: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:59:18.563301: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:59:18.563807: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-11 03:59:18.564009: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:59:18.564524: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:82:00.0 name: Tesla P100-PCIE-16GB computeCapability: 6.0
coreClock: 1.3285GHz coreCount: 56 deviceMemorySize: 15.89GiB deviceMemoryBandwidth: 681.88GiB/s
2026-05-11 03:59:18.564587: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:59:18.564633: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:59:18.564674: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:59:18.564715: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:59:18.564756: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:59:18.564796: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:59:18.564836: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:59:18.564877: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:59:18.565361: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:59:18.565429: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:59:19.136421: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-11 03:59:19.136564: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-11 03:59:19.136590: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-11 03:59:19.137537: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 14950 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-16GB, pci bus id: 0000:82:00.0, compute capability: 6.0)
2026-05-11 03:59:19.204199: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:196] None of the MLIR optimization passes are enabled (registered 0 passes)
2026-05-11 03:59:19.222608: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2399890000 Hz
2026-05-11 03:59:24.831808: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:59:25.087905: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:59:25.095258: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:59:26.226553: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-11 03:59:26.353735: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
RuntimeError: module compiled against API version 0xe but this version of numpy is 0xd
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)