Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded: curl/8.4.0
(required by: htslib/1.16)
-------------------------------------------------------------------------------




The following have been reloaded with a version change:
  1) curl/8.4.0 => curl/8.17.0     2) openssl/3.0.7 => openssl/3.6.0

2026-05-11 02:50:32.414785: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 02:54:32.885197: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 02:54:32.898794: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-11 02:54:32.946138: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:07:00.0 name: Tesla V100-SXM2-16GB computeCapability: 7.0
coreClock: 1.53GHz coreCount: 80 deviceMemorySize: 15.77GiB deviceMemoryBandwidth: 836.37GiB/s
2026-05-11 02:54:32.946262: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 02:54:33.526114: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 02:54:33.526316: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 02:54:33.927075: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 02:54:34.549028: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 02:54:35.155996: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 02:54:35.410010: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 02:54:35.623894: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 02:54:35.625103: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 02:54:35.625874: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-11 02:54:35.626135: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 02:54:35.626902: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:07:00.0 name: Tesla V100-SXM2-16GB computeCapability: 7.0
coreClock: 1.53GHz coreCount: 80 deviceMemorySize: 15.77GiB deviceMemoryBandwidth: 836.37GiB/s
2026-05-11 02:54:35.626981: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 02:54:35.627041: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 02:54:35.627090: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 02:54:35.627135: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 02:54:35.627178: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 02:54:35.627222: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 02:54:35.627264: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 02:54:35.627341: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 02:54:35.628119: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 02:54:35.628202: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 02:54:38.423222: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-11 02:54:38.423356: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-11 02:54:38.423393: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-11 02:54:38.424485: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 14751 MB memory) -> physical GPU (device: 0, name: Tesla V100-SXM2-16GB, pci bus id: 0000:07:00.0, compute capability: 7.0)
2026-05-11 02:54:46.737908: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2026-05-11 02:54:46.738604: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2399920000 Hz
2026-05-11 02:54:50.949090: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 02:54:53.583922: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 02:54:53.627976: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 02:55:10.457828: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-11 02:55:10.589259: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'jitters', 'index', 'status', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
2026-05-11 03:28:01.692212: W tensorflow/python/util/util.cc:348] Sets are not currently considered sequences, but this may change in the future, so consider avoiding using them.
2026-05-11 03:28:30.358106: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:29:12.461740: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:29:12.472061: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-11 03:29:12.518147: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:07:00.0 name: Tesla V100-SXM2-16GB computeCapability: 7.0
coreClock: 1.53GHz coreCount: 80 deviceMemorySize: 15.77GiB deviceMemoryBandwidth: 836.37GiB/s
2026-05-11 03:29:12.518284: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:29:12.532051: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:29:12.532127: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:29:12.538158: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:29:12.544039: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:29:12.553053: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:29:12.561472: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:29:12.568994: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:29:12.569726: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:29:12.570121: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-11 03:29:12.570258: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:29:12.570685: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:07:00.0 name: Tesla V100-SXM2-16GB computeCapability: 7.0
coreClock: 1.53GHz coreCount: 80 deviceMemorySize: 15.77GiB deviceMemoryBandwidth: 836.37GiB/s
2026-05-11 03:29:12.570732: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:29:12.570766: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:29:12.570795: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:29:12.570823: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:29:12.570851: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:29:12.570879: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:29:12.570906: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:29:12.570938: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:29:12.571470: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:29:12.571521: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:29:13.253964: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-11 03:29:13.254099: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-11 03:29:13.254123: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-11 03:29:13.255194: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 14751 MB memory) -> physical GPU (device: 0, name: Tesla V100-SXM2-16GB, pci bus id: 0000:07:00.0, compute capability: 7.0)
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)

batch:   0%|          | 0/104 [00:00<?, ?it/s]2026-05-11 03:29:15.940545: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2026-05-11 03:29:15.941251: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2399920000 Hz
2026-05-11 03:29:16.697282: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:29:17.537909: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:29:17.540016: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:29:19.684480: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-11 03:29:19.844423: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'true_profiles', 'true_logcounts', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])

batch:   1%|          | 1/104 [00:38<1:06:31, 38.75s/it]
batch:   2%|▏         | 2/104 [00:39<27:38, 16.26s/it]  
batch:   3%|▎         | 3/104 [00:39<15:13,  9.04s/it]
batch:   4%|▍         | 4/104 [00:40<09:26,  5.67s/it]
batch:   5%|▍         | 5/104 [00:40<06:16,  3.80s/it]
batch:   6%|▌         | 6/104 [00:41<04:23,  2.68s/it]
batch:   7%|▋         | 7/104 [00:41<03:11,  1.97s/it]
batch:   8%|▊         | 8/104 [00:42<02:23,  1.50s/it]
batch:   9%|▊         | 9/104 [00:42<01:52,  1.18s/it]
batch:  10%|▉         | 10/104 [00:43<01:31,  1.03it/s]
batch:  11%|█         | 11/104 [00:43<01:16,  1.21it/s]
batch:  12%|█▏        | 12/104 [00:44<01:06,  1.38it/s]
batch:  12%|█▎        | 13/104 [00:44<00:58,  1.55it/s]
batch:  13%|█▎        | 14/104 [00:45<00:53,  1.67it/s]
batch:  14%|█▍        | 15/104 [00:45<00:49,  1.79it/s]
batch:  15%|█▌        | 16/104 [00:46<00:46,  1.90it/s]
batch:  16%|█▋        | 17/104 [00:46<00:43,  1.98it/s]
batch:  17%|█▋        | 18/104 [00:46<00:41,  2.05it/s]
batch:  18%|█▊        | 19/104 [00:47<00:40,  2.10it/s]
batch:  19%|█▉        | 20/104 [00:47<00:40,  2.07it/s]
batch:  20%|██        | 21/104 [00:48<00:39,  2.09it/s]
batch:  21%|██        | 22/104 [00:48<00:38,  2.13it/s]
batch:  22%|██▏       | 23/104 [00:49<00:37,  2.16it/s]
batch:  23%|██▎       | 24/104 [00:49<00:36,  2.18it/s]
batch:  24%|██▍       | 25/104 [00:50<00:36,  2.19it/s]
batch:  25%|██▌       | 26/104 [00:50<00:35,  2.20it/s]
batch:  26%|██▌       | 27/104 [00:51<00:35,  2.19it/s]
batch:  27%|██▋       | 28/104 [00:51<00:35,  2.16it/s]
batch:  28%|██▊       | 29/104 [00:52<00:35,  2.13it/s]
batch:  29%|██▉       | 30/104 [00:52<00:34,  2.15it/s]
batch:  30%|██▉       | 31/104 [00:52<00:33,  2.18it/s]
batch:  31%|███       | 32/104 [00:53<00:32,  2.18it/s]
batch:  32%|███▏      | 33/104 [00:53<00:33,  2.13it/s]
batch:  33%|███▎      | 34/104 [00:54<00:32,  2.13it/s]
batch:  34%|███▎      | 35/104 [00:54<00:33,  2.07it/s]
batch:  35%|███▍      | 36/104 [00:55<00:33,  2.05it/s]
batch:  36%|███▌      | 37/104 [00:55<00:32,  2.07it/s]
batch:  37%|███▋      | 38/104 [00:56<00:31,  2.11it/s]
batch:  38%|███▊      | 39/104 [00:56<00:30,  2.14it/s]
batch:  38%|███▊      | 40/104 [00:57<00:29,  2.17it/s]
batch:  39%|███▉      | 41/104 [00:57<00:28,  2.19it/s]
batch:  40%|████      | 42/104 [00:58<00:29,  2.13it/s]
batch:  41%|████▏     | 43/104 [00:58<00:28,  2.14it/s]
batch:  42%|████▏     | 44/104 [00:59<00:28,  2.09it/s]
batch:  43%|████▎     | 45/104 [00:59<00:28,  2.07it/s]
batch:  44%|████▍     | 46/104 [01:00<00:27,  2.09it/s]
batch:  45%|████▌     | 47/104 [01:00<00:27,  2.07it/s]
batch:  46%|████▌     | 48/104 [01:01<00:26,  2.09it/s]
batch:  47%|████▋     | 49/104 [01:01<00:26,  2.06it/s]
batch:  48%|████▊     | 50/104 [01:01<00:25,  2.09it/s]
batch:  49%|████▉     | 51/104 [01:02<00:25,  2.08it/s]
batch:  50%|█████     | 52/104 [01:02<00:25,  2.04it/s]
batch:  51%|█████     | 53/104 [01:03<00:24,  2.06it/s]
batch:  52%|█████▏    | 54/104 [01:03<00:23,  2.10it/s]
batch:  53%|█████▎    | 55/104 [01:04<00:22,  2.13it/s]
batch:  54%|█████▍    | 56/104 [01:04<00:22,  2.09it/s]
batch:  55%|█████▍    | 57/104 [01:05<00:22,  2.10it/s]
batch:  56%|█████▌    | 58/104 [01:05<00:22,  2.05it/s]
batch:  57%|█████▋    | 59/104 [01:06<00:21,  2.06it/s]
batch:  58%|█████▊    | 60/104 [01:06<00:21,  2.02it/s]
batch:  59%|█████▊    | 61/104 [01:07<00:21,  2.04it/s]
batch:  60%|█████▉    | 62/104 [01:07<00:20,  2.03it/s]
batch:  61%|██████    | 63/104 [01:08<00:20,  2.05it/s]
batch:  62%|██████▏   | 64/104 [01:08<00:19,  2.10it/s]
batch:  62%|██████▎   | 65/104 [01:09<00:18,  2.13it/s]
batch:  63%|██████▎   | 66/104 [01:09<00:19,  1.91it/s]
batch:  64%|██████▍   | 67/104 [01:10<00:18,  1.95it/s]
batch:  65%|██████▌   | 68/104 [01:10<00:18,  1.98it/s]
batch:  66%|██████▋   | 69/104 [01:11<00:17,  1.98it/s]
batch:  67%|██████▋   | 70/104 [01:11<00:17,  1.96it/s]
batch:  68%|██████▊   | 71/104 [01:12<00:16,  1.97it/s]
batch:  69%|██████▉   | 72/104 [01:12<00:15,  2.01it/s]
batch:  70%|███████   | 73/104 [01:13<00:15,  1.98it/s]
batch:  71%|███████   | 74/104 [01:13<00:14,  2.02it/s]
batch:  72%|███████▏  | 75/104 [01:14<00:13,  2.08it/s]
batch:  73%|███████▎  | 76/104 [01:14<00:13,  2.05it/s]
batch:  74%|███████▍  | 77/104 [01:15<00:13,  2.06it/s]
batch:  75%|███████▌  | 78/104 [01:15<00:12,  2.02it/s]
batch:  76%|███████▌  | 79/104 [01:16<00:12,  2.04it/s]
batch:  77%|███████▋  | 80/104 [01:16<00:11,  2.02it/s]
batch:  78%|███████▊  | 81/104 [01:17<00:11,  2.04it/s]
batch:  79%|███████▉  | 82/104 [01:17<00:10,  2.09it/s]
batch:  80%|███████▉  | 83/104 [01:18<00:09,  2.13it/s]
batch:  81%|████████  | 84/104 [01:18<00:09,  2.15it/s]
batch:  82%|████████▏ | 85/104 [01:19<00:08,  2.17it/s]
batch:  83%|████████▎ | 86/104 [01:19<00:08,  2.19it/s]
batch:  84%|████████▎ | 87/104 [01:19<00:07,  2.15it/s]
batch:  85%|████████▍ | 88/104 [01:20<00:07,  2.10it/s]
batch:  86%|████████▌ | 89/104 [01:20<00:07,  2.11it/s]
batch:  87%|████████▋ | 90/104 [01:21<00:06,  2.08it/s]
batch:  88%|████████▊ | 91/104 [01:21<00:06,  2.10it/s]
batch:  88%|████████▊ | 92/104 [01:22<00:05,  2.14it/s]
batch:  89%|████████▉ | 93/104 [01:22<00:05,  2.15it/s]
batch:  90%|█████████ | 94/104 [01:23<00:04,  2.07it/s]
batch:  91%|█████████▏| 95/104 [01:23<00:04,  2.07it/s]
batch:  92%|█████████▏| 96/104 [01:24<00:03,  2.03it/s]
batch:  93%|█████████▎| 97/104 [01:24<00:03,  2.00it/s]
batch:  94%|█████████▍| 98/104 [01:25<00:03,  1.99it/s]
batch:  95%|█████████▌| 99/104 [01:25<00:02,  2.02it/s]
batch:  96%|█████████▌| 100/104 [01:26<00:01,  2.08it/s]
batch:  97%|█████████▋| 101/104 [01:26<00:01,  2.12it/s]
batch:  98%|█████████▊| 102/104 [01:27<00:00,  2.15it/s]
batch:  99%|█████████▉| 103/104 [01:27<00:00,  2.45it/s]
batch: 100%|██████████| 104/104 [01:27<00:00,  1.19it/s]

  0%|          | 0/6562 [00:00<?, ?it/s]
  1%|          | 56/6562 [00:00<00:11, 554.01it/s]
  2%|▏         | 130/6562 [00:00<00:09, 658.36it/s]
  3%|▎         | 208/6562 [00:00<00:09, 705.98it/s]
  4%|▍         | 287/6562 [00:00<00:08, 737.20it/s]
  6%|▌         | 366/6562 [00:00<00:08, 750.67it/s]
  7%|▋         | 444/6562 [00:00<00:08, 756.59it/s]
  8%|▊         | 521/6562 [00:00<00:08, 754.75it/s]
  9%|▉         | 602/6562 [00:00<00:07, 771.61it/s]
 10%|█         | 680/6562 [00:00<00:07, 773.03it/s]
 12%|█▏        | 758/6562 [00:01<00:07, 770.58it/s]
 13%|█▎        | 836/6562 [00:01<00:07, 771.10it/s]
 14%|█▍        | 914/6562 [00:01<00:07, 766.50it/s]
 15%|█▌        | 991/6562 [00:01<00:07, 762.41it/s]
 16%|█▋        | 1068/6562 [00:01<00:07, 760.35it/s]
 17%|█▋        | 1145/6562 [00:01<00:07, 755.51it/s]
 19%|█▊        | 1222/6562 [00:01<00:07, 755.99it/s]
 20%|█▉        | 1300/6562 [00:01<00:06, 757.18it/s]
 21%|██        | 1376/6562 [00:01<00:06, 746.66it/s]
 22%|██▏       | 1452/6562 [00:01<00:06, 750.36it/s]
 23%|██▎       | 1528/6562 [00:02<00:06, 749.26it/s]
 24%|██▍       | 1606/6562 [00:02<00:06, 752.86it/s]
 26%|██▌       | 1682/6562 [00:02<00:06, 751.37it/s]
 27%|██▋       | 1759/6562 [00:02<00:06, 756.13it/s]
 28%|██▊       | 1835/6562 [00:02<00:06, 749.73it/s]
 29%|██▉       | 1910/6562 [00:02<00:06, 748.02it/s]
 30%|███       | 1985/6562 [00:02<00:06, 748.04it/s]
 31%|███▏      | 2060/6562 [00:02<00:06, 744.80it/s]
 33%|███▎      | 2136/6562 [00:02<00:05, 748.02it/s]
 34%|███▎      | 2211/6562 [00:02<00:05, 747.26it/s]
 35%|███▍      | 2286/6562 [00:03<00:05, 742.80it/s]
 36%|███▌      | 2361/6562 [00:03<00:05, 743.17it/s]
 37%|███▋      | 2436/6562 [00:03<00:05, 737.99it/s]
 38%|███▊      | 2511/6562 [00:03<00:05, 736.21it/s]
 39%|███▉      | 2586/6562 [00:03<00:05, 735.02it/s]
 41%|████      | 2661/6562 [00:03<00:05, 735.78it/s]
 42%|████▏     | 2735/6562 [00:03<00:05, 735.64it/s]
 43%|████▎     | 2810/6562 [00:03<00:05, 739.17it/s]
 44%|████▍     | 2885/6562 [00:03<00:04, 739.54it/s]
 45%|████▌     | 2961/6562 [00:03<00:04, 745.14it/s]
 46%|████▋     | 3036/6562 [00:04<00:04, 739.92it/s]
 47%|████▋     | 3111/6562 [00:04<00:04, 728.37it/s]
 49%|████▊     | 3184/6562 [00:04<00:04, 726.60it/s]
 50%|████▉     | 3257/6562 [00:04<00:04, 725.95it/s]
 51%|█████     | 3330/6562 [00:04<00:04, 723.47it/s]
 52%|█████▏    | 3403/6562 [00:04<00:04, 722.97it/s]
 53%|█████▎    | 3477/6562 [00:04<00:04, 727.44it/s]
 54%|█████▍    | 3550/6562 [00:04<00:04, 724.78it/s]
 55%|█████▌    | 3624/6562 [00:04<00:04, 723.07it/s]
 56%|█████▋    | 3697/6562 [00:04<00:03, 724.14it/s]
 57%|█████▋    | 3770/6562 [00:05<00:03, 724.32it/s]
 59%|█████▊    | 3843/6562 [00:05<00:03, 723.11it/s]
 60%|█████▉    | 3916/6562 [00:05<00:03, 722.54it/s]
 61%|██████    | 3989/6562 [00:05<00:03, 718.18it/s]
 62%|██████▏   | 4061/6562 [00:05<00:03, 715.69it/s]
 63%|██████▎   | 4133/6562 [00:05<00:03, 713.39it/s]
 64%|██████▍   | 4206/6562 [00:05<00:03, 717.94it/s]
 65%|██████▌   | 4278/6562 [00:05<00:03, 713.81it/s]
 66%|██████▋   | 4350/6562 [00:05<00:03, 711.57it/s]
 67%|██████▋   | 4422/6562 [00:05<00:03, 711.76it/s]
 68%|██████▊   | 4494/6562 [00:06<00:02, 708.26it/s]
 70%|██████▉   | 4567/6562 [00:06<00:02, 714.49it/s]
 71%|███████   | 4639/6562 [00:06<00:02, 708.40it/s]
 72%|███████▏  | 4712/6562 [00:06<00:02, 708.74it/s]
 73%|███████▎  | 4784/6562 [00:06<00:02, 708.48it/s]
 74%|███████▍  | 4856/6562 [00:06<00:02, 706.53it/s]
 75%|███████▌  | 4927/6562 [00:06<00:02, 706.15it/s]
 76%|███████▌  | 4998/6562 [00:06<00:02, 704.25it/s]
 77%|███████▋  | 5069/6562 [00:06<00:02, 700.55it/s]
 78%|███████▊  | 5140/6562 [00:07<00:02, 696.72it/s]
 79%|███████▉  | 5211/6562 [00:07<00:01, 697.32it/s]
 80%|████████  | 5281/6562 [00:07<00:01, 694.72it/s]
 82%|████████▏ | 5351/6562 [00:07<00:01, 694.02it/s]
 83%|████████▎ | 5421/6562 [00:07<00:01, 693.36it/s]
 84%|████████▎ | 5491/6562 [00:07<00:01, 689.67it/s]
 85%|████████▍ | 5561/6562 [00:07<00:01, 692.44it/s]
 86%|████████▌ | 5631/6562 [00:07<00:01, 692.14it/s]
 87%|████████▋ | 5701/6562 [00:07<00:01, 687.49it/s]
 88%|████████▊ | 5770/6562 [00:07<00:01, 683.72it/s]
 89%|████████▉ | 5839/6562 [00:08<00:01, 680.46it/s]
 90%|█████████ | 5908/6562 [00:08<00:00, 679.46it/s]
 91%|█████████ | 5977/6562 [00:08<00:00, 681.77it/s]
 92%|█████████▏| 6046/6562 [00:08<00:00, 678.18it/s]
 93%|█████████▎| 6114/6562 [00:08<00:00, 678.33it/s]
 94%|█████████▍| 6182/6562 [00:08<00:00, 677.55it/s]
 95%|█████████▌| 6250/6562 [00:08<00:00, 675.80it/s]
 96%|█████████▋| 6319/6562 [00:08<00:00, 679.79it/s]
 97%|█████████▋| 6388/6562 [00:08<00:00, 677.34it/s]
 98%|█████████▊| 6456/6562 [00:08<00:00, 673.63it/s]
 99%|█████████▉| 6524/6562 [00:09<00:00, 664.51it/s]
100%|██████████| 6562/6562 [00:09<00:00, 719.83it/s]

  0%|          | 0/6562 [00:00<?, ?it/s]
  1%|          | 58/6562 [00:00<00:11, 579.32it/s]
  2%|▏         | 128/6562 [00:00<00:09, 648.89it/s]
  3%|▎         | 199/6562 [00:00<00:09, 673.27it/s]
  4%|▍         | 271/6562 [00:00<00:09, 690.83it/s]
  5%|▌         | 344/6562 [00:00<00:08, 703.16it/s]
  6%|▋         | 417/6562 [00:00<00:08, 708.57it/s]
  7%|▋         | 491/6562 [00:00<00:08, 713.14it/s]
  9%|▊         | 569/6562 [00:00<00:08, 732.97it/s]
 10%|▉         | 651/6562 [00:00<00:07, 754.66it/s]
 11%|█         | 730/6562 [00:01<00:07, 760.75it/s]
 12%|█▏        | 809/6562 [00:01<00:07, 765.36it/s]
 14%|█▎        | 886/6562 [00:01<00:07, 763.88it/s]
 15%|█▍        | 965/6562 [00:01<00:07, 768.77it/s]
 16%|█▌        | 1042/6562 [00:01<00:07, 763.30it/s]
 17%|█▋        | 1120/6562 [00:01<00:07, 763.67it/s]
 18%|█▊        | 1198/6562 [00:01<00:07, 764.00it/s]
 19%|█▉        | 1275/6562 [00:01<00:06, 761.59it/s]
 21%|██        | 1352/6562 [00:01<00:06, 760.36it/s]
 22%|██▏       | 1429/6562 [00:01<00:06, 756.51it/s]
 23%|██▎       | 1506/6562 [00:02<00:06, 760.19it/s]
 24%|██▍       | 1583/6562 [00:02<00:06, 758.11it/s]
 25%|██▌       | 1659/6562 [00:02<00:06, 751.99it/s]
 26%|██▋       | 1738/6562 [00:02<00:06, 757.17it/s]
 28%|██▊       | 1814/6562 [00:02<00:06, 750.56it/s]
 29%|██▉       | 1890/6562 [00:02<00:06, 751.46it/s]
 30%|██▉       | 1966/6562 [00:02<00:06, 751.43it/s]
 31%|███       | 2042/6562 [00:02<00:06, 752.38it/s]
 32%|███▏      | 2118/6562 [00:02<00:05, 747.15it/s]
 33%|███▎      | 2194/6562 [00:02<00:05, 748.37it/s]
 35%|███▍      | 2270/6562 [00:03<00:05, 749.05it/s]
 36%|███▌      | 2345/6562 [00:03<00:05, 747.37it/s]
 37%|███▋      | 2420/6562 [00:03<00:05, 746.46it/s]
 38%|███▊      | 2495/6562 [00:03<00:05, 741.48it/s]
 39%|███▉      | 2570/6562 [00:03<00:05, 739.43it/s]
 40%|████      | 2644/6562 [00:03<00:05, 737.81it/s]
 41%|████▏     | 2718/6562 [00:03<00:05, 735.07it/s]
 43%|████▎     | 2792/6562 [00:03<00:05, 732.82it/s]
 44%|████▎     | 2870/6562 [00:03<00:04, 745.73it/s]
 45%|████▍     | 2945/6562 [00:03<00:04, 746.71it/s]
 46%|████▌     | 3020/6562 [00:04<00:04, 740.41it/s]
 47%|████▋     | 3095/6562 [00:04<00:04, 728.91it/s]
 48%|████▊     | 3168/6562 [00:04<00:04, 722.89it/s]
 49%|████▉     | 3241/6562 [00:04<00:04, 721.78it/s]
 51%|█████     | 3316/6562 [00:04<00:04, 724.49it/s]
 52%|█████▏    | 3389/6562 [00:04<00:04, 723.42it/s]
 53%|█████▎    | 3463/6562 [00:04<00:04, 727.67it/s]
 54%|█████▍    | 3537/6562 [00:04<00:04, 725.15it/s]
 55%|█████▌    | 3610/6562 [00:04<00:04, 724.56it/s]
 56%|█████▌    | 3684/6562 [00:04<00:03, 723.73it/s]
 57%|█████▋    | 3757/6562 [00:05<00:03, 723.06it/s]
 58%|█████▊    | 3830/6562 [00:05<00:03, 724.69it/s]
 59%|█████▉    | 3904/6562 [00:05<00:03, 724.17it/s]
 61%|██████    | 3977/6562 [00:05<00:03, 719.71it/s]
 62%|██████▏   | 4049/6562 [00:05<00:03, 714.64it/s]
 63%|██████▎   | 4122/6562 [00:05<00:03, 713.28it/s]
 64%|██████▍   | 4195/6562 [00:05<00:03, 713.08it/s]
 65%|██████▌   | 4268/6562 [00:05<00:03, 712.01it/s]
 66%|██████▌   | 4340/6562 [00:05<00:03, 714.20it/s]
 67%|██████▋   | 4412/6562 [00:06<00:03, 712.48it/s]
 68%|██████▊   | 4484/6562 [00:06<00:02, 709.06it/s]
 69%|██████▉   | 4557/6562 [00:06<00:02, 710.06it/s]
 71%|███████   | 4630/6562 [00:06<00:02, 710.34it/s]
 72%|███████▏  | 4702/6562 [00:06<00:02, 711.34it/s]
 73%|███████▎  | 4774/6562 [00:06<00:02, 712.07it/s]
 74%|███████▍  | 4846/6562 [00:06<00:02, 708.77it/s]
 75%|███████▍  | 4917/6562 [00:06<00:02, 703.03it/s]
 76%|███████▌  | 4988/6562 [00:06<00:02, 700.77it/s]
 77%|███████▋  | 5059/6562 [00:06<00:02, 702.28it/s]
 78%|███████▊  | 5130/6562 [00:07<00:02, 697.73it/s]
 79%|███████▉  | 5200/6562 [00:07<00:01, 695.21it/s]
 80%|████████  | 5270/6562 [00:07<00:01, 695.09it/s]
 81%|████████▏ | 5340/6562 [00:07<00:01, 689.71it/s]
 82%|████████▏ | 5410/6562 [00:07<00:01, 690.15it/s]
 84%|████████▎ | 5480/6562 [00:07<00:01, 692.62it/s]
 85%|████████▍ | 5551/6562 [00:07<00:01, 696.93it/s]
 86%|████████▌ | 5621/6562 [00:07<00:01, 696.77it/s]
 87%|████████▋ | 5691/6562 [00:07<00:01, 692.15it/s]
 88%|████████▊ | 5761/6562 [00:07<00:01, 682.50it/s]
 89%|████████▉ | 5831/6562 [00:08<00:01, 683.94it/s]
 90%|████████▉ | 5900/6562 [00:08<00:00, 682.21it/s]
 91%|█████████ | 5970/6562 [00:08<00:00, 682.72it/s]
 92%|█████████▏| 6039/6562 [00:08<00:00, 677.48it/s]
 93%|█████████▎| 6107/6562 [00:08<00:00, 676.35it/s]
 94%|█████████▍| 6176/6562 [00:08<00:00, 680.23it/s]
 95%|█████████▌| 6245/6562 [00:08<00:00, 673.91it/s]
 96%|█████████▌| 6315/6562 [00:08<00:00, 681.19it/s]
 97%|█████████▋| 6384/6562 [00:08<00:00, 680.85it/s]
 98%|█████████▊| 6453/6562 [00:08<00:00, 673.44it/s]
 99%|█████████▉| 6521/6562 [00:09<00:00, 665.61it/s]
100%|██████████| 6562/6562 [00:09<00:00, 718.49it/s]
2026-05-11 03:31:43.261671: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:32:14.955544: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:32:14.957499: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-11 03:32:15.001408: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:07:00.0 name: Tesla V100-SXM2-16GB computeCapability: 7.0
coreClock: 1.53GHz coreCount: 80 deviceMemorySize: 15.77GiB deviceMemoryBandwidth: 836.37GiB/s
2026-05-11 03:32:15.001596: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:32:15.008045: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:32:15.008143: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:32:15.011149: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:32:15.013088: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:32:15.022210: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:32:15.028670: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:32:15.030488: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:32:15.031432: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:32:15.032134: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-11 03:32:15.032364: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:32:15.032870: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:07:00.0 name: Tesla V100-SXM2-16GB computeCapability: 7.0
coreClock: 1.53GHz coreCount: 80 deviceMemorySize: 15.77GiB deviceMemoryBandwidth: 836.37GiB/s
2026-05-11 03:32:15.032956: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:32:15.033019: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:32:15.033077: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:32:15.033134: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:32:15.033190: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:32:15.033246: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:32:15.033302: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:32:15.033358: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:32:15.034116: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:32:15.034211: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:32:15.725725: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-11 03:32:15.725830: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-11 03:32:15.725853: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-11 03:32:15.726990: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 14751 MB memory) -> physical GPU (device: 0, name: Tesla V100-SXM2-16GB, pci bus id: 0000:07:00.0, compute capability: 7.0)
2026-05-11 03:32:15.803787: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:196] None of the MLIR optimization passes are enabled (registered 0 passes)
2026-05-11 03:32:15.829305: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2399920000 Hz
2026-05-11 03:32:25.120081: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:32:25.580298: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:32:25.586946: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:32:27.324296: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-11 03:32:27.447033: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
RuntimeError: module compiled against API version 0xe but this version of numpy is 0xd
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)