Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded: curl/8.4.0
(required by: htslib/1.16)
-------------------------------------------------------------------------------




The following have been reloaded with a version change:
  1) curl/8.4.0 => curl/8.17.0     2) openssl/3.0.7 => openssl/3.6.0

2025-12-29 21:17:07.449720: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-12-29 21:17:29.470698: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-12-29 21:17:29.472085: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2025-12-29 21:17:29.674215: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:07:00.0 name: NVIDIA A100-SXM4-80GB computeCapability: 8.0
coreClock: 1.41GHz coreCount: 108 deviceMemorySize: 79.14GiB deviceMemoryBandwidth: 1.85TiB/s
2025-12-29 21:17:29.674304: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-12-29 21:17:29.678578: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-12-29 21:17:29.678632: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-12-29 21:17:29.680272: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-12-29 21:17:29.681332: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-12-29 21:17:29.684117: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-12-29 21:17:29.685392: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-12-29 21:17:29.686304: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-12-29 21:17:29.691150: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-12-29 21:17:29.691742: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2025-12-29 21:17:29.694335: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-12-29 21:17:29.698113: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:07:00.0 name: NVIDIA A100-SXM4-80GB computeCapability: 8.0
coreClock: 1.41GHz coreCount: 108 deviceMemorySize: 79.14GiB deviceMemoryBandwidth: 1.85TiB/s
2025-12-29 21:17:29.698145: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-12-29 21:17:29.698165: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-12-29 21:17:29.698180: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-12-29 21:17:29.698194: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-12-29 21:17:29.698207: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-12-29 21:17:29.698220: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-12-29 21:17:29.698233: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-12-29 21:17:29.698262: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-12-29 21:17:29.702963: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-12-29 21:17:29.703001: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-12-29 21:17:30.223323: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2025-12-29 21:17:30.223409: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2025-12-29 21:17:30.223426: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2025-12-29 21:17:30.228138: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 75642 MB memory) -> physical GPU (device: 0, name: NVIDIA A100-SXM4-80GB, pci bus id: 0000:07:00.0, compute capability: 8.0)
2025-12-29 21:17:31.860228: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2025-12-29 21:17:31.860844: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2450135000 Hz
2025-12-29 21:17:33.552804: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-12-29 21:17:34.036103: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-12-29 21:17:34.046276: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-12-29 21:17:35.599089: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2025-12-29 21:17:35.804275: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
2025-12-29 21:18:13.787516: I tensorflow/stream_executor/cuda/cuda_blas.cc:1838] TensorFloat-32 will be used for the matrix multiplication. This will only be logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'jitters', 'index', 'status', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
2025-12-29 21:24:47.457421: W tensorflow/python/util/util.cc:348] Sets are not currently considered sequences, but this may change in the future, so consider avoiding using them.
2025-12-29 21:24:51.739364: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-12-29 21:24:56.794446: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-12-29 21:24:56.795458: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2025-12-29 21:24:57.028742: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:07:00.0 name: NVIDIA A100-SXM4-80GB computeCapability: 8.0
coreClock: 1.41GHz coreCount: 108 deviceMemorySize: 79.14GiB deviceMemoryBandwidth: 1.85TiB/s
2025-12-29 21:24:57.028837: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-12-29 21:24:57.033712: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-12-29 21:24:57.033783: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-12-29 21:24:57.035759: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-12-29 21:24:57.037078: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-12-29 21:24:57.041202: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-12-29 21:24:57.042799: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-12-29 21:24:57.044116: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-12-29 21:24:57.049545: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-12-29 21:24:57.050006: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2025-12-29 21:24:57.052315: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-12-29 21:24:57.056107: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:07:00.0 name: NVIDIA A100-SXM4-80GB computeCapability: 8.0
coreClock: 1.41GHz coreCount: 108 deviceMemorySize: 79.14GiB deviceMemoryBandwidth: 1.85TiB/s
2025-12-29 21:24:57.056141: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-12-29 21:24:57.056161: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-12-29 21:24:57.056178: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-12-29 21:24:57.056193: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-12-29 21:24:57.056208: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-12-29 21:24:57.056222: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-12-29 21:24:57.056236: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-12-29 21:24:57.056251: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-12-29 21:24:57.060373: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-12-29 21:24:57.060414: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-12-29 21:24:57.551203: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2025-12-29 21:24:57.551306: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2025-12-29 21:24:57.551322: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2025-12-29 21:24:57.555236: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 75642 MB memory) -> physical GPU (device: 0, name: NVIDIA A100-SXM4-80GB, pci bus id: 0000:07:00.0, compute capability: 8.0)
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)

batch:   0%|          | 0/56 [00:00<?, ?it/s]2025-12-29 21:24:59.589656: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2025-12-29 21:24:59.590428: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2450135000 Hz
2025-12-29 21:24:59.839640: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-12-29 21:25:00.308645: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-12-29 21:25:00.310684: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-12-29 21:25:01.884801: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2025-12-29 21:25:02.034753: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'true_profiles', 'true_logcounts', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])

batch:   2%|▏         | 1/56 [00:35<32:28, 35.42s/it]
batch:   4%|▎         | 2/56 [00:35<13:17, 14.77s/it]
batch:   5%|▌         | 3/56 [00:36<07:12,  8.17s/it]
batch:   7%|▋         | 4/56 [00:36<04:23,  5.07s/it]
batch:   9%|▉         | 5/56 [00:36<02:50,  3.35s/it]
batch:  11%|█         | 6/56 [00:36<01:55,  2.32s/it]
batch:  12%|█▎        | 7/56 [00:37<01:21,  1.66s/it]
batch:  14%|█▍        | 8/56 [00:37<00:59,  1.23s/it]
batch:  16%|█▌        | 9/56 [00:37<00:44,  1.06it/s]
batch:  18%|█▊        | 10/56 [00:38<00:34,  1.34it/s]
batch:  20%|█▉        | 11/56 [00:38<00:27,  1.63it/s]
batch:  21%|██▏       | 12/56 [00:38<00:22,  1.92it/s]
batch:  23%|██▎       | 13/56 [00:39<00:19,  2.20it/s]
batch:  25%|██▌       | 14/56 [00:39<00:17,  2.44it/s]
batch:  27%|██▋       | 15/56 [00:39<00:15,  2.64it/s]
batch:  29%|██▊       | 16/56 [00:40<00:14,  2.74it/s]
batch:  30%|███       | 17/56 [00:40<00:13,  2.88it/s]
batch:  32%|███▏      | 18/56 [00:40<00:12,  2.98it/s]
batch:  34%|███▍      | 19/56 [00:40<00:12,  3.06it/s]
batch:  36%|███▌      | 20/56 [00:41<00:11,  3.11it/s]
batch:  38%|███▊      | 21/56 [00:41<00:12,  2.90it/s]
batch:  39%|███▉      | 22/56 [00:42<00:11,  2.95it/s]
batch:  41%|████      | 23/56 [00:42<00:10,  3.04it/s]
batch:  43%|████▎     | 24/56 [00:43<00:20,  1.57it/s]
batch:  45%|████▍     | 25/56 [00:44<00:16,  1.85it/s]
batch:  46%|████▋     | 26/56 [00:44<00:14,  2.13it/s]
batch:  48%|████▊     | 27/56 [00:44<00:12,  2.38it/s]
batch:  50%|█████     | 28/56 [00:45<00:13,  2.02it/s]
batch:  52%|█████▏    | 29/56 [00:45<00:11,  2.27it/s]
batch:  54%|█████▎    | 30/56 [00:45<00:10,  2.50it/s]
batch:  55%|█████▌    | 31/56 [00:46<00:09,  2.66it/s]
batch:  57%|█████▋    | 32/56 [00:46<00:08,  2.79it/s]
batch:  59%|█████▉    | 33/56 [00:46<00:07,  2.90it/s]
batch:  61%|██████    | 34/56 [00:47<00:07,  2.98it/s]
batch:  62%|██████▎   | 35/56 [00:47<00:06,  3.04it/s]
batch:  64%|██████▍   | 36/56 [00:47<00:06,  3.08it/s]
batch:  66%|██████▌   | 37/56 [00:48<00:06,  3.11it/s]
batch:  68%|██████▊   | 38/56 [00:48<00:05,  3.14it/s]
batch:  70%|██████▉   | 39/56 [00:48<00:05,  3.16it/s]
batch:  71%|███████▏  | 40/56 [00:49<00:05,  3.18it/s]
batch:  73%|███████▎  | 41/56 [00:49<00:04,  3.18it/s]
batch:  75%|███████▌  | 42/56 [00:49<00:04,  3.17it/s]
batch:  77%|███████▋  | 43/56 [00:49<00:04,  3.18it/s]
batch:  79%|███████▊  | 44/56 [00:50<00:03,  3.16it/s]
batch:  80%|████████  | 45/56 [00:50<00:03,  3.17it/s]
batch:  82%|████████▏ | 46/56 [00:50<00:03,  3.18it/s]
batch:  84%|████████▍ | 47/56 [00:51<00:02,  3.20it/s]
batch:  86%|████████▌ | 48/56 [00:51<00:02,  3.19it/s]
batch:  88%|████████▊ | 49/56 [00:51<00:02,  3.20it/s]
batch:  89%|████████▉ | 50/56 [00:52<00:01,  3.20it/s]
batch:  91%|█████████ | 51/56 [00:52<00:01,  3.10it/s]
batch:  93%|█████████▎| 52/56 [00:52<00:01,  3.11it/s]
batch:  95%|█████████▍| 53/56 [00:53<00:00,  3.14it/s]
batch:  96%|█████████▋| 54/56 [00:53<00:00,  3.16it/s]
batch:  98%|█████████▊| 55/56 [00:53<00:00,  3.18it/s]
batch: 100%|██████████| 56/56 [00:54<00:00,  3.40it/s]
batch: 100%|██████████| 56/56 [00:54<00:00,  1.04it/s]

  0%|          | 0/3568 [00:00<?, ?it/s]
  3%|▎         | 100/3568 [00:00<00:03, 999.19it/s]
  6%|▌         | 200/3568 [00:00<00:03, 998.22it/s]
  8%|▊         | 300/3568 [00:00<00:03, 989.62it/s]
 11%|█         | 399/3568 [00:00<00:03, 986.91it/s]
 14%|█▍        | 498/3568 [00:00<00:03, 977.02it/s]
 17%|█▋        | 596/3568 [00:00<00:03, 973.51it/s]
 19%|█▉        | 694/3568 [00:00<00:02, 970.97it/s]
 22%|██▏       | 792/3568 [00:00<00:02, 966.40it/s]
 25%|██▍       | 890/3568 [00:00<00:02, 968.41it/s]
 28%|██▊       | 988/3568 [00:01<00:02, 967.46it/s]
 30%|███       | 1085/3568 [00:01<00:02, 967.82it/s]
 33%|███▎      | 1182/3568 [00:01<00:02, 962.36it/s]
 36%|███▌      | 1279/3568 [00:01<00:02, 955.31it/s]
 39%|███▊      | 1375/3568 [00:01<00:02, 954.86it/s]
 41%|████      | 1471/3568 [00:01<00:02, 952.60it/s]
 44%|████▍     | 1567/3568 [00:01<00:02, 947.62it/s]
 47%|████▋     | 1662/3568 [00:01<00:02, 944.17it/s]
 49%|████▉     | 1757/3568 [00:01<00:01, 945.39it/s]
 52%|█████▏    | 1852/3568 [00:01<00:01, 940.07it/s]
 55%|█████▍    | 1947/3568 [00:02<00:01, 936.73it/s]
 57%|█████▋    | 2041/3568 [00:02<00:01, 933.71it/s]
 60%|█████▉    | 2135/3568 [00:02<00:01, 931.43it/s]
 62%|██████▏   | 2229/3568 [00:02<00:01, 928.75it/s]
 65%|██████▌   | 2322/3568 [00:02<00:01, 924.65it/s]
 68%|██████▊   | 2415/3568 [00:02<00:01, 921.49it/s]
 70%|███████   | 2509/3568 [00:02<00:01, 921.11it/s]
 73%|███████▎  | 2602/3568 [00:02<00:01, 918.20it/s]
 76%|███████▌  | 2694/3568 [00:02<00:00, 915.44it/s]
 78%|███████▊  | 2786/3568 [00:02<00:00, 916.03it/s]
 81%|████████  | 2878/3568 [00:03<00:00, 909.91it/s]
 83%|████████▎ | 2969/3568 [00:03<00:00, 909.40it/s]
 86%|████████▌ | 3060/3568 [00:03<00:00, 905.30it/s]
 88%|████████▊ | 3151/3568 [00:03<00:00, 902.14it/s]
 91%|█████████ | 3242/3568 [00:03<00:00, 897.70it/s]
 93%|█████████▎| 3332/3568 [00:03<00:00, 890.60it/s]
 96%|█████████▌| 3422/3568 [00:03<00:00, 890.62it/s]
 98%|█████████▊| 3512/3568 [00:03<00:00, 891.96it/s]
100%|██████████| 3568/3568 [00:03<00:00, 933.51it/s]

  0%|          | 0/3568 [00:00<?, ?it/s]
  3%|▎         | 98/3568 [00:00<00:03, 977.21it/s]
  6%|▌         | 198/3568 [00:00<00:03, 978.26it/s]
  8%|▊         | 298/3568 [00:00<00:03, 987.33it/s]
 11%|█         | 397/3568 [00:00<00:03, 985.82it/s]
 14%|█▍        | 496/3568 [00:00<00:03, 986.70it/s]
 17%|█▋        | 595/3568 [00:00<00:03, 984.91it/s]
 19%|█▉        | 694/3568 [00:00<00:02, 977.75it/s]
 22%|██▏       | 792/3568 [00:00<00:02, 974.52it/s]
 25%|██▍       | 890/3568 [00:00<00:02, 976.05it/s]
 28%|██▊       | 988/3568 [00:01<00:02, 972.53it/s]
 30%|███       | 1086/3568 [00:01<00:02, 966.91it/s]
 33%|███▎      | 1183/3568 [00:01<00:02, 961.33it/s]
 36%|███▌      | 1280/3568 [00:01<00:02, 960.40it/s]
 39%|███▊      | 1377/3568 [00:01<00:02, 955.09it/s]
 41%|████▏     | 1473/3568 [00:01<00:02, 952.86it/s]
 44%|████▍     | 1569/3568 [00:01<00:02, 948.15it/s]
 47%|████▋     | 1665/3568 [00:01<00:02, 946.45it/s]
 49%|████▉     | 1761/3568 [00:01<00:01, 943.97it/s]
 52%|█████▏    | 1856/3568 [00:01<00:01, 940.94it/s]
 55%|█████▍    | 1951/3568 [00:02<00:01, 937.94it/s]
 57%|█████▋    | 2047/3568 [00:02<00:01, 938.57it/s]
 60%|██████    | 2141/3568 [00:02<00:01, 935.01it/s]
 63%|██████▎   | 2235/3568 [00:02<00:01, 931.38it/s]
 65%|██████▌   | 2329/3568 [00:02<00:01, 923.00it/s]
 68%|██████▊   | 2422/3568 [00:02<00:01, 920.19it/s]
 71%|███████   | 2516/3568 [00:02<00:01, 925.31it/s]
 73%|███████▎  | 2609/3568 [00:02<00:01, 920.96it/s]
 76%|███████▌  | 2702/3568 [00:02<00:00, 914.06it/s]
 78%|███████▊  | 2794/3568 [00:02<00:00, 914.95it/s]
 81%|████████  | 2886/3568 [00:03<00:00, 909.34it/s]
 83%|████████▎ | 2977/3568 [00:03<00:00, 908.36it/s]
 86%|████████▌ | 3068/3568 [00:03<00:00, 905.11it/s]
 89%|████████▊ | 3159/3568 [00:03<00:00, 902.60it/s]
 91%|█████████ | 3250/3568 [00:03<00:00, 900.05it/s]
 94%|█████████▎| 3341/3568 [00:03<00:00, 895.09it/s]
 96%|█████████▌| 3431/3568 [00:03<00:00, 893.36it/s]
 99%|█████████▊| 3521/3568 [00:03<00:00, 883.32it/s]
100%|██████████| 3568/3568 [00:03<00:00, 934.43it/s]
2025-12-29 21:26:13.613015: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-12-29 21:26:21.879033: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-12-29 21:26:21.880747: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2025-12-29 21:26:22.123469: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:07:00.0 name: NVIDIA A100-SXM4-80GB computeCapability: 8.0
coreClock: 1.41GHz coreCount: 108 deviceMemorySize: 79.14GiB deviceMemoryBandwidth: 1.85TiB/s
2025-12-29 21:26:22.123580: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-12-29 21:26:22.127791: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-12-29 21:26:22.127863: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-12-29 21:26:22.129894: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-12-29 21:26:22.131110: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-12-29 21:26:22.134276: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-12-29 21:26:22.135856: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-12-29 21:26:22.137018: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-12-29 21:26:22.143083: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-12-29 21:26:22.143852: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2025-12-29 21:26:22.146883: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-12-29 21:26:22.149904: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:07:00.0 name: NVIDIA A100-SXM4-80GB computeCapability: 8.0
coreClock: 1.41GHz coreCount: 108 deviceMemorySize: 79.14GiB deviceMemoryBandwidth: 1.85TiB/s
2025-12-29 21:26:22.150046: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-12-29 21:26:22.150107: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-12-29 21:26:22.150153: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-12-29 21:26:22.150195: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-12-29 21:26:22.150237: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-12-29 21:26:22.150278: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-12-29 21:26:22.150318: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-12-29 21:26:22.150359: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-12-29 21:26:22.155282: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-12-29 21:26:22.155383: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-12-29 21:26:22.651788: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2025-12-29 21:26:22.651870: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2025-12-29 21:26:22.651887: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2025-12-29 21:26:22.655983: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 75642 MB memory) -> physical GPU (device: 0, name: NVIDIA A100-SXM4-80GB, pci bus id: 0000:07:00.0, compute capability: 8.0)
2025-12-29 21:26:22.718784: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:196] None of the MLIR optimization passes are enabled (registered 0 passes)
2025-12-29 21:26:22.732773: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2450135000 Hz
2025-12-29 21:26:26.814816: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-12-29 21:26:27.306435: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-12-29 21:26:27.314397: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-12-29 21:26:28.871304: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2025-12-29 21:26:29.066095: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
2025-12-29 21:27:03.108013: I tensorflow/stream_executor/cuda/cuda_blas.cc:1838] TensorFloat-32 will be used for the matrix multiplication. This will only be logged once.
RuntimeError: module compiled against API version 0xe but this version of numpy is 0xd
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)