Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded: curl/8.4.0
(required by: htslib/1.16)
-------------------------------------------------------------------------------




The following have been reloaded with a version change:
  1) curl/8.4.0 => curl/8.17.0     2) openssl/3.0.7 => openssl/3.6.0

2026-05-11 02:50:31.779204: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 02:53:19.009460: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 02:53:19.050457: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-11 02:53:19.174339: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:07:00.0 name: Tesla V100-SXM2-16GB computeCapability: 7.0
coreClock: 1.53GHz coreCount: 80 deviceMemorySize: 15.77GiB deviceMemoryBandwidth: 836.37GiB/s
2026-05-11 02:53:19.174443: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 02:53:20.050536: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 02:53:20.050796: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 02:53:20.383912: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 02:53:21.076316: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 02:53:21.768776: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 02:53:22.097098: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 02:53:22.472020: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 02:53:22.473054: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 02:53:22.473731: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-11 02:53:22.473971: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 02:53:22.474637: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:07:00.0 name: Tesla V100-SXM2-16GB computeCapability: 7.0
coreClock: 1.53GHz coreCount: 80 deviceMemorySize: 15.77GiB deviceMemoryBandwidth: 836.37GiB/s
2026-05-11 02:53:22.474761: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 02:53:22.474824: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 02:53:22.474875: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 02:53:22.474922: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 02:53:22.474978: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 02:53:22.475024: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 02:53:22.475070: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 02:53:22.475151: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 02:53:22.476128: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 02:53:22.476235: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 02:53:26.414065: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-11 02:53:26.414179: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-11 02:53:26.414207: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-11 02:53:26.415336: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 14751 MB memory) -> physical GPU (device: 0, name: Tesla V100-SXM2-16GB, pci bus id: 0000:07:00.0, compute capability: 7.0)
2026-05-11 02:53:39.497342: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2026-05-11 02:53:39.498093: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2400015000 Hz
2026-05-11 02:53:53.975635: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 02:53:56.497437: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 02:53:56.526694: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 02:54:37.284378: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-11 02:54:37.434924: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'jitters', 'index', 'status', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
2026-05-11 03:33:37.067921: W tensorflow/python/util/util.cc:348] Sets are not currently considered sequences, but this may change in the future, so consider avoiding using them.
2026-05-11 03:33:53.660183: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:34:43.764908: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:34:43.774824: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-11 03:34:43.826047: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:07:00.0 name: Tesla V100-SXM2-16GB computeCapability: 7.0
coreClock: 1.53GHz coreCount: 80 deviceMemorySize: 15.77GiB deviceMemoryBandwidth: 836.37GiB/s
2026-05-11 03:34:43.826164: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:34:43.836278: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:34:43.836438: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:34:43.841452: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:34:43.845570: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:34:43.853140: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:34:43.857795: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:34:43.861401: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:34:43.862238: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:34:43.862630: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-11 03:34:43.862793: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:34:43.863181: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:07:00.0 name: Tesla V100-SXM2-16GB computeCapability: 7.0
coreClock: 1.53GHz coreCount: 80 deviceMemorySize: 15.77GiB deviceMemoryBandwidth: 836.37GiB/s
2026-05-11 03:34:43.863240: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:34:43.863281: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:34:43.863314: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:34:43.863347: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:34:43.863378: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:34:43.863410: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:34:43.863441: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:34:43.863473: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:34:43.864468: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:34:43.864549: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:34:44.605926: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-11 03:34:44.606029: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-11 03:34:44.606054: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-11 03:34:44.607216: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 14751 MB memory) -> physical GPU (device: 0, name: Tesla V100-SXM2-16GB, pci bus id: 0000:07:00.0, compute capability: 7.0)
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)

batch:   0%|          | 0/104 [00:00<?, ?it/s]2026-05-11 03:34:47.333325: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2026-05-11 03:34:47.334063: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2400015000 Hz
2026-05-11 03:34:48.172761: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:34:48.846767: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:34:48.849354: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:34:52.128237: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-11 03:34:52.373912: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'true_profiles', 'true_logcounts', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])

batch:   1%|          | 1/104 [00:52<1:30:06, 52.50s/it]
batch:   2%|▏         | 2/104 [00:52<37:14, 21.91s/it]  
batch:   3%|▎         | 3/104 [00:53<20:28, 12.16s/it]
batch:   4%|▍         | 4/104 [00:54<12:37,  7.58s/it]
batch:   5%|▍         | 5/104 [00:54<08:19,  5.05s/it]
batch:   6%|▌         | 6/104 [00:55<05:43,  3.51s/it]
batch:   7%|▋         | 7/104 [00:55<04:04,  2.52s/it]
batch:   8%|▊         | 8/104 [00:56<03:00,  1.88s/it]
batch:   9%|▊         | 9/104 [00:56<02:17,  1.44s/it]
batch:  10%|▉         | 10/104 [00:57<01:48,  1.15s/it]
batch:  11%|█         | 11/104 [00:57<01:29,  1.04it/s]
batch:  12%|█▏        | 12/104 [00:58<01:15,  1.22it/s]
batch:  12%|█▎        | 13/104 [00:58<01:05,  1.38it/s]
batch:  13%|█▎        | 14/104 [00:59<00:58,  1.54it/s]
batch:  14%|█▍        | 15/104 [00:59<00:53,  1.66it/s]
batch:  15%|█▌        | 16/104 [01:00<00:50,  1.75it/s]
batch:  16%|█▋        | 17/104 [01:00<00:47,  1.83it/s]
batch:  17%|█▋        | 18/104 [01:01<00:45,  1.88it/s]
batch:  18%|█▊        | 19/104 [01:01<00:45,  1.86it/s]
batch:  19%|█▉        | 20/104 [01:02<00:44,  1.89it/s]
batch:  20%|██        | 21/104 [01:02<00:42,  1.94it/s]
batch:  21%|██        | 22/104 [01:03<00:41,  1.96it/s]
batch:  22%|██▏       | 23/104 [01:03<00:41,  1.97it/s]
batch:  23%|██▎       | 24/104 [01:04<00:40,  1.98it/s]
batch:  24%|██▍       | 25/104 [01:04<00:41,  1.92it/s]
batch:  25%|██▌       | 26/104 [01:05<00:40,  1.95it/s]
batch:  26%|██▌       | 27/104 [01:05<00:39,  1.93it/s]
batch:  27%|██▋       | 28/104 [01:06<00:40,  1.89it/s]
batch:  28%|██▊       | 29/104 [01:06<00:40,  1.87it/s]
batch:  29%|██▉       | 30/104 [01:07<00:40,  1.85it/s]
batch:  30%|██▉       | 31/104 [01:07<00:39,  1.83it/s]
batch:  31%|███       | 32/104 [01:08<00:39,  1.81it/s]
batch:  32%|███▏      | 33/104 [01:09<00:38,  1.85it/s]
batch:  33%|███▎      | 34/104 [01:09<00:36,  1.91it/s]
batch:  34%|███▎      | 35/104 [01:10<00:36,  1.88it/s]
batch:  35%|███▍      | 36/104 [01:10<00:35,  1.90it/s]
batch:  36%|███▌      | 37/104 [01:11<00:36,  1.86it/s]
batch:  37%|███▋      | 38/104 [01:11<00:34,  1.89it/s]
batch:  38%|███▊      | 39/104 [01:12<00:34,  1.88it/s]
batch:  38%|███▊      | 40/104 [01:12<00:33,  1.91it/s]
batch:  39%|███▉      | 41/104 [01:13<00:32,  1.95it/s]
batch:  40%|████      | 42/104 [01:13<00:31,  1.96it/s]
batch:  41%|████▏     | 43/104 [01:14<00:31,  1.93it/s]
batch:  42%|████▏     | 44/104 [01:14<00:31,  1.88it/s]
batch:  43%|████▎     | 45/104 [01:15<00:31,  1.84it/s]
batch:  44%|████▍     | 46/104 [01:15<00:32,  1.81it/s]
batch:  45%|████▌     | 47/104 [01:16<00:31,  1.80it/s]
batch:  46%|████▌     | 48/104 [01:17<00:30,  1.85it/s]
batch:  47%|████▋     | 49/104 [01:17<00:29,  1.89it/s]
batch:  48%|████▊     | 50/104 [01:18<00:29,  1.86it/s]
batch:  49%|████▉     | 51/104 [01:18<00:28,  1.89it/s]
batch:  50%|█████     | 52/104 [01:19<00:26,  1.93it/s]
batch:  51%|█████     | 53/104 [01:19<00:26,  1.96it/s]
batch:  52%|█████▏    | 54/104 [01:20<00:26,  1.90it/s]
batch:  53%|█████▎    | 55/104 [01:20<00:25,  1.92it/s]
batch:  54%|█████▍    | 56/104 [01:21<00:25,  1.90it/s]
batch:  55%|█████▍    | 57/104 [01:21<00:24,  1.93it/s]
batch:  56%|█████▌    | 58/104 [01:22<00:23,  1.95it/s]
batch:  57%|█████▋    | 59/104 [01:22<00:23,  1.90it/s]
batch:  58%|█████▊    | 60/104 [01:23<00:22,  1.92it/s]
batch:  59%|█████▊    | 61/104 [01:23<00:22,  1.95it/s]
batch:  60%|█████▉    | 62/104 [01:24<00:21,  1.98it/s]
batch:  61%|██████    | 63/104 [01:24<00:21,  1.92it/s]
batch:  62%|██████▏   | 64/104 [01:25<00:21,  1.87it/s]
batch:  62%|██████▎   | 65/104 [01:25<00:20,  1.87it/s]
batch:  63%|██████▎   | 66/104 [01:26<00:22,  1.73it/s]
batch:  64%|██████▍   | 67/104 [01:27<00:21,  1.76it/s]
batch:  65%|██████▌   | 68/104 [01:27<00:19,  1.81it/s]
batch:  66%|██████▋   | 69/104 [01:28<00:19,  1.82it/s]
batch:  67%|██████▋   | 70/104 [01:28<00:18,  1.88it/s]
batch:  68%|██████▊   | 71/104 [01:29<00:17,  1.92it/s]
batch:  69%|██████▉   | 72/104 [01:29<00:16,  1.95it/s]
batch:  70%|███████   | 73/104 [01:30<00:15,  1.97it/s]
batch:  71%|███████   | 74/104 [01:30<00:15,  1.99it/s]
batch:  72%|███████▏  | 75/104 [01:31<00:14,  2.01it/s]
batch:  73%|███████▎  | 76/104 [01:31<00:14,  2.00it/s]
batch:  74%|███████▍  | 77/104 [01:32<00:13,  2.01it/s]
batch:  75%|███████▌  | 78/104 [01:32<00:12,  2.01it/s]
batch:  76%|███████▌  | 79/104 [01:33<00:12,  2.02it/s]
batch:  77%|███████▋  | 80/104 [01:33<00:11,  2.03it/s]
batch:  78%|███████▊  | 81/104 [01:34<00:11,  1.98it/s]
batch:  79%|███████▉  | 82/104 [01:34<00:10,  2.00it/s]
batch:  80%|███████▉  | 83/104 [01:35<00:10,  2.01it/s]
batch:  81%|████████  | 84/104 [01:35<00:10,  1.95it/s]
batch:  82%|████████▏ | 85/104 [01:36<00:09,  1.90it/s]
batch:  83%|████████▎ | 86/104 [01:36<00:09,  1.92it/s]
batch:  84%|████████▎ | 87/104 [01:37<00:08,  1.96it/s]
batch:  85%|████████▍ | 88/104 [01:37<00:08,  1.92it/s]
batch:  86%|████████▌ | 89/104 [01:38<00:07,  1.94it/s]
batch:  87%|████████▋ | 90/104 [01:38<00:07,  1.96it/s]
batch:  88%|████████▊ | 91/104 [01:39<00:06,  1.91it/s]
batch:  88%|████████▊ | 92/104 [01:39<00:06,  1.87it/s]
batch:  89%|████████▉ | 93/104 [01:40<00:05,  1.84it/s]
batch:  90%|█████████ | 94/104 [01:40<00:05,  1.87it/s]
batch:  91%|█████████▏| 95/104 [01:41<00:04,  1.92it/s]
batch:  92%|█████████▏| 96/104 [01:42<00:04,  1.89it/s]
batch:  93%|█████████▎| 97/104 [01:42<00:03,  1.88it/s]
batch:  94%|█████████▍| 98/104 [01:43<00:03,  1.91it/s]
batch:  95%|█████████▌| 99/104 [01:43<00:02,  1.88it/s]
batch:  96%|█████████▌| 100/104 [01:44<00:02,  1.92it/s]
batch:  97%|█████████▋| 101/104 [01:44<00:01,  2.15it/s]
batch:  98%|█████████▊| 102/104 [01:44<00:00,  2.11it/s]
batch:  99%|█████████▉| 103/104 [01:45<00:00,  2.09it/s]
batch: 100%|██████████| 104/104 [01:45<00:00,  1.01s/it]

  0%|          | 0/6562 [00:00<?, ?it/s]
  1%|          | 81/6562 [00:00<00:08, 787.88it/s]
  2%|▏         | 161/6562 [00:00<00:08, 784.66it/s]
  4%|▎         | 240/6562 [00:00<00:08, 780.51it/s]
  5%|▍         | 319/6562 [00:00<00:08, 767.23it/s]
  6%|▌         | 396/6562 [00:00<00:08, 765.47it/s]
  7%|▋         | 473/6562 [00:00<00:08, 760.08it/s]
  8%|▊         | 550/6562 [00:00<00:07, 758.85it/s]
 10%|▉         | 628/6562 [00:00<00:07, 759.18it/s]
 11%|█         | 704/6562 [00:00<00:07, 758.75it/s]
 12%|█▏        | 781/6562 [00:01<00:07, 758.74it/s]
 13%|█▎        | 858/6562 [00:01<00:07, 759.43it/s]
 14%|█▍        | 934/6562 [00:01<00:07, 757.40it/s]
 15%|█▌        | 1010/6562 [00:01<00:07, 740.92it/s]
 17%|█▋        | 1085/6562 [00:01<00:07, 740.82it/s]
 18%|█▊        | 1160/6562 [00:01<00:07, 741.22it/s]
 19%|█▉        | 1235/6562 [00:01<00:07, 733.99it/s]
 20%|█▉        | 1309/6562 [00:01<00:07, 733.13it/s]
 21%|██        | 1383/6562 [00:01<00:07, 735.12it/s]
 22%|██▏       | 1457/6562 [00:01<00:06, 734.82it/s]
 23%|██▎       | 1531/6562 [00:02<00:06, 730.47it/s]
 24%|██▍       | 1605/6562 [00:02<00:06, 732.82it/s]
 26%|██▌       | 1679/6562 [00:02<00:06, 729.66it/s]
 27%|██▋       | 1755/6562 [00:02<00:06, 737.93it/s]
 28%|██▊       | 1829/6562 [00:02<00:06, 728.38it/s]
 29%|██▉       | 1902/6562 [00:02<00:06, 724.91it/s]
 30%|███       | 1975/6562 [00:02<00:06, 725.62it/s]
 31%|███▏      | 2051/6562 [00:02<00:06, 731.40it/s]
 32%|███▏      | 2125/6562 [00:02<00:06, 729.40it/s]
 33%|███▎      | 2198/6562 [00:02<00:06, 726.79it/s]
 35%|███▍      | 2271/6562 [00:03<00:05, 727.14it/s]
 36%|███▌      | 2344/6562 [00:03<00:05, 723.77it/s]
 37%|███▋      | 2417/6562 [00:03<00:05, 723.45it/s]
 38%|███▊      | 2490/6562 [00:03<00:05, 723.07it/s]
 39%|███▉      | 2563/6562 [00:03<00:05, 719.95it/s]
 40%|████      | 2636/6562 [00:03<00:05, 719.67it/s]
 41%|████▏     | 2708/6562 [00:03<00:05, 712.11it/s]
 42%|████▏     | 2781/6562 [00:03<00:05, 711.54it/s]
 44%|████▎     | 2855/6562 [00:03<00:05, 718.06it/s]
 45%|████▍     | 2932/6562 [00:03<00:04, 729.03it/s]
 46%|████▌     | 3005/6562 [00:04<00:04, 714.82it/s]
 47%|████▋     | 3077/6562 [00:04<00:04, 707.35it/s]
 48%|████▊     | 3148/6562 [00:04<00:04, 702.98it/s]
 49%|████▉     | 3220/6562 [00:04<00:04, 701.97it/s]
 50%|█████     | 3291/6562 [00:04<00:04, 695.48it/s]
 51%|█████     | 3361/6562 [00:04<00:04, 696.22it/s]
 52%|█████▏    | 3433/6562 [00:04<00:04, 700.28it/s]
 53%|█████▎    | 3504/6562 [00:04<00:04, 701.92it/s]
 54%|█████▍    | 3575/6562 [00:04<00:04, 700.77it/s]
 56%|█████▌    | 3646/6562 [00:05<00:04, 693.80it/s]
 57%|█████▋    | 3718/6562 [00:05<00:04, 701.44it/s]
 58%|█████▊    | 3789/6562 [00:05<00:03, 703.13it/s]
 59%|█████▉    | 3860/6562 [00:05<00:03, 701.44it/s]
 60%|█████▉    | 3931/6562 [00:05<00:03, 698.40it/s]
 61%|██████    | 4001/6562 [00:05<00:03, 694.67it/s]
 62%|██████▏   | 4071/6562 [00:05<00:03, 694.03it/s]
 63%|██████▎   | 4141/6562 [00:05<00:03, 685.21it/s]
 64%|██████▍   | 4211/6562 [00:05<00:03, 689.39it/s]
 65%|██████▌   | 4282/6562 [00:05<00:03, 691.54it/s]
 66%|██████▋   | 4353/6562 [00:06<00:03, 695.66it/s]
 67%|██████▋   | 4423/6562 [00:06<00:03, 689.83it/s]
 68%|██████▊   | 4493/6562 [00:06<00:03, 685.58it/s]
 70%|██████▉   | 4565/6562 [00:06<00:02, 694.20it/s]
 71%|███████   | 4636/6562 [00:06<00:02, 695.27it/s]
 72%|███████▏  | 4706/6562 [00:06<00:02, 686.56it/s]
 73%|███████▎  | 4775/6562 [00:06<00:02, 684.89it/s]
 74%|███████▍  | 4847/6562 [00:06<00:02, 694.72it/s]
 75%|███████▍  | 4917/6562 [00:06<00:02, 688.32it/s]
 76%|███████▌  | 4986/6562 [00:06<00:02, 687.86it/s]
 77%|███████▋  | 5055/6562 [00:07<00:02, 680.28it/s]
 78%|███████▊  | 5126/6562 [00:07<00:02, 685.36it/s]
 79%|███████▉  | 5196/6562 [00:07<00:01, 683.29it/s]
 80%|████████  | 5265/6562 [00:07<00:01, 682.27it/s]
 81%|████████▏ | 5334/6562 [00:07<00:01, 668.67it/s]
 82%|████████▏ | 5405/6562 [00:07<00:01, 677.57it/s]
 83%|████████▎ | 5474/6562 [00:07<00:01, 676.71it/s]
 84%|████████▍ | 5542/6562 [00:07<00:01, 671.14it/s]
 85%|████████▌ | 5610/6562 [00:07<00:01, 667.31it/s]
 87%|████████▋ | 5678/6562 [00:07<00:01, 669.21it/s]
 88%|████████▊ | 5746/6562 [00:08<00:01, 667.28it/s]
 89%|████████▊ | 5814/6562 [00:08<00:01, 665.45it/s]
 90%|████████▉ | 5881/6562 [00:08<00:01, 661.58it/s]
 91%|█████████ | 5950/6562 [00:08<00:00, 664.49it/s]
 92%|█████████▏| 6017/6562 [00:08<00:00, 664.33it/s]
 93%|█████████▎| 6084/6562 [00:08<00:00, 655.68it/s]
 94%|█████████▎| 6150/6562 [00:08<00:00, 656.69it/s]
 95%|█████████▍| 6216/6562 [00:08<00:00, 656.58it/s]
 96%|█████████▌| 6282/6562 [00:08<00:00, 656.89it/s]
 97%|█████████▋| 6349/6562 [00:08<00:00, 658.18it/s]
 98%|█████████▊| 6415/6562 [00:09<00:00, 647.33it/s]
 99%|█████████▉| 6482/6562 [00:09<00:00, 649.50it/s]
100%|█████████▉| 6547/6562 [00:09<00:00, 648.60it/s]
100%|██████████| 6562/6562 [00:09<00:00, 703.60it/s]

  0%|          | 0/6562 [00:00<?, ?it/s]
  1%|          | 53/6562 [00:00<00:12, 515.80it/s]
  2%|▏         | 122/6562 [00:00<00:10, 609.84it/s]
  3%|▎         | 191/6562 [00:00<00:09, 638.79it/s]
  4%|▍         | 262/6562 [00:00<00:09, 658.96it/s]
  5%|▌         | 332/6562 [00:00<00:09, 669.15it/s]
  6%|▌         | 403/6562 [00:00<00:09, 678.71it/s]
  7%|▋         | 474/6562 [00:00<00:08, 687.34it/s]
  8%|▊         | 549/6562 [00:00<00:08, 703.56it/s]
 10%|▉         | 628/6562 [00:00<00:08, 725.21it/s]
 11%|█         | 707/6562 [00:01<00:07, 741.88it/s]
 12%|█▏        | 783/6562 [00:01<00:07, 746.52it/s]
 13%|█▎        | 858/6562 [00:01<00:07, 736.49it/s]
 14%|█▍        | 934/6562 [00:01<00:07, 743.31it/s]
 15%|█▌        | 1011/6562 [00:01<00:07, 750.50it/s]
 17%|█▋        | 1087/6562 [00:01<00:07, 737.34it/s]
 18%|█▊        | 1161/6562 [00:01<00:07, 732.25it/s]
 19%|█▉        | 1236/6562 [00:01<00:07, 732.23it/s]
 20%|█▉        | 1312/6562 [00:01<00:07, 737.88it/s]
 21%|██        | 1386/6562 [00:01<00:07, 733.76it/s]
 22%|██▏       | 1460/6562 [00:02<00:07, 726.25it/s]
 23%|██▎       | 1534/6562 [00:02<00:06, 724.13it/s]
 25%|██▍       | 1612/6562 [00:02<00:06, 737.78it/s]
 26%|██▌       | 1686/6562 [00:02<00:06, 730.27it/s]
 27%|██▋       | 1760/6562 [00:02<00:06, 727.06it/s]
 28%|██▊       | 1833/6562 [00:02<00:06, 719.09it/s]
 29%|██▉       | 1911/6562 [00:02<00:06, 730.52it/s]
 30%|███       | 1985/6562 [00:02<00:06, 730.43it/s]
 31%|███▏      | 2059/6562 [00:02<00:06, 727.99it/s]
 32%|███▏      | 2132/6562 [00:02<00:06, 725.89it/s]
 34%|███▎      | 2208/6562 [00:03<00:05, 731.61it/s]
 35%|███▍      | 2282/6562 [00:03<00:05, 728.46it/s]
 36%|███▌      | 2355/6562 [00:03<00:05, 725.06it/s]
 37%|███▋      | 2428/6562 [00:03<00:05, 716.93it/s]
 38%|███▊      | 2504/6562 [00:03<00:05, 728.56it/s]
 39%|███▉      | 2577/6562 [00:03<00:05, 717.64it/s]
 40%|████      | 2650/6562 [00:03<00:05, 715.27it/s]
 41%|████▏     | 2722/6562 [00:03<00:05, 712.30it/s]
 43%|████▎     | 2799/6562 [00:03<00:05, 725.09it/s]
 44%|████▍     | 2873/6562 [00:03<00:05, 729.29it/s]
 45%|████▍     | 2946/6562 [00:04<00:04, 728.05it/s]
 46%|████▌     | 3019/6562 [00:04<00:04, 712.22it/s]
 47%|████▋     | 3091/6562 [00:04<00:04, 713.37it/s]
 48%|████▊     | 3163/6562 [00:04<00:04, 699.10it/s]
 49%|████▉     | 3233/6562 [00:04<00:04, 694.24it/s]
 50%|█████     | 3303/6562 [00:04<00:04, 695.20it/s]
 51%|█████▏    | 3377/6562 [00:04<00:04, 705.69it/s]
 53%|█████▎    | 3450/6562 [00:04<00:04, 707.06it/s]
 54%|█████▎    | 3521/6562 [00:04<00:04, 705.72it/s]
 55%|█████▍    | 3592/6562 [00:05<00:04, 705.00it/s]
 56%|█████▌    | 3663/6562 [00:05<00:04, 705.77it/s]
 57%|█████▋    | 3735/6562 [00:05<00:03, 707.71it/s]
 58%|█████▊    | 3806/6562 [00:05<00:03, 697.90it/s]
 59%|█████▉    | 3878/6562 [00:05<00:03, 700.52it/s]
 60%|██████    | 3951/6562 [00:05<00:03, 704.56it/s]
 61%|██████▏   | 4022/6562 [00:05<00:03, 703.35it/s]
 62%|██████▏   | 4093/6562 [00:05<00:03, 697.16it/s]
 63%|██████▎   | 4163/6562 [00:05<00:03, 692.58it/s]
 65%|██████▍   | 4234/6562 [00:05<00:03, 694.23it/s]
 66%|██████▌   | 4304/6562 [00:06<00:03, 695.42it/s]
 67%|██████▋   | 4374/6562 [00:06<00:03, 690.45it/s]
 68%|██████▊   | 4444/6562 [00:06<00:03, 687.33it/s]
 69%|██████▉   | 4515/6562 [00:06<00:02, 693.25it/s]
 70%|██████▉   | 4585/6562 [00:06<00:02, 692.85it/s]
 71%|███████   | 4655/6562 [00:06<00:02, 689.08it/s]
 72%|███████▏  | 4724/6562 [00:06<00:02, 687.97it/s]
 73%|███████▎  | 4795/6562 [00:06<00:02, 689.98it/s]
 74%|███████▍  | 4866/6562 [00:06<00:02, 695.68it/s]
 75%|███████▌  | 4936/6562 [00:06<00:02, 690.52it/s]
 76%|███████▋  | 5006/6562 [00:07<00:02, 683.68it/s]
 77%|███████▋  | 5075/6562 [00:07<00:02, 678.65it/s]
 78%|███████▊  | 5145/6562 [00:07<00:02, 683.99it/s]
 79%|███████▉  | 5214/6562 [00:07<00:01, 676.86it/s]
 80%|████████  | 5282/6562 [00:07<00:01, 663.64it/s]
 82%|████████▏ | 5349/6562 [00:07<00:01, 664.98it/s]
 83%|████████▎ | 5422/6562 [00:07<00:01, 680.31it/s]
 84%|████████▎ | 5491/6562 [00:07<00:01, 675.35it/s]
 85%|████████▍ | 5559/6562 [00:07<00:01, 674.85it/s]
 86%|████████▌ | 5627/6562 [00:07<00:01, 675.26it/s]
 87%|████████▋ | 5697/6562 [00:08<00:01, 681.32it/s]
 88%|████████▊ | 5766/6562 [00:08<00:01, 673.60it/s]
 89%|████████▉ | 5834/6562 [00:08<00:01, 668.44it/s]
 90%|████████▉ | 5901/6562 [00:08<00:00, 663.07it/s]
 91%|█████████ | 5972/6562 [00:08<00:00, 676.61it/s]
 92%|█████████▏| 6040/6562 [00:08<00:00, 657.66it/s]
 93%|█████████▎| 6106/6562 [00:08<00:00, 650.44it/s]
 94%|█████████▍| 6172/6562 [00:08<00:00, 652.23it/s]
 95%|█████████▌| 6240/6562 [00:08<00:00, 658.01it/s]
 96%|█████████▌| 6306/6562 [00:09<00:00, 653.63it/s]
 97%|█████████▋| 6372/6562 [00:09<00:00, 650.98it/s]
 98%|█████████▊| 6438/6562 [00:09<00:00, 642.19it/s]
 99%|█████████▉| 6506/6562 [00:09<00:00, 647.57it/s]
100%|██████████| 6562/6562 [00:09<00:00, 696.89it/s]
2026-05-11 03:41:10.659892: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:46:19.174379: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:46:19.275746: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-11 03:46:19.655487: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:07:00.0 name: Tesla V100-SXM2-16GB computeCapability: 7.0
coreClock: 1.53GHz coreCount: 80 deviceMemorySize: 15.77GiB deviceMemoryBandwidth: 836.37GiB/s
2026-05-11 03:46:19.655687: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:46:20.180367: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:46:20.180583: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:46:20.482199: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:46:20.850727: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:46:21.285969: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:46:21.835767: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:46:22.662133: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:46:22.663184: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:46:22.663778: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-11 03:46:22.663987: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:46:22.664945: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:07:00.0 name: Tesla V100-SXM2-16GB computeCapability: 7.0
coreClock: 1.53GHz coreCount: 80 deviceMemorySize: 15.77GiB deviceMemoryBandwidth: 836.37GiB/s
2026-05-11 03:46:22.665090: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:46:22.665178: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:46:22.665254: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:46:22.665329: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:46:22.665404: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:46:22.665479: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:46:22.665553: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:46:22.665638: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:46:22.666696: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:46:22.666834: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:46:23.467814: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-11 03:46:23.467910: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-11 03:46:23.467936: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-11 03:46:23.469529: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 14751 MB memory) -> physical GPU (device: 0, name: Tesla V100-SXM2-16GB, pci bus id: 0000:07:00.0, compute capability: 7.0)
2026-05-11 03:46:23.563641: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:196] None of the MLIR optimization passes are enabled (registered 0 passes)
2026-05-11 03:46:25.101164: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2400015000 Hz
2026-05-11 03:46:34.645304: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:46:35.127950: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:46:35.134259: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:46:39.610848: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-11 03:46:39.728691: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
RuntimeError: module compiled against API version 0xe but this version of numpy is 0xd
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)