Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded: curl/8.4.0
(required by: htslib/1.16)
-------------------------------------------------------------------------------




The following have been reloaded with a version change:
  1) curl/8.4.0 => curl/8.17.0     2) openssl/3.0.7 => openssl/3.6.0

2026-05-11 03:50:22.650292: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 04:00:19.837077: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 04:00:19.859660: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-11 04:00:19.992820: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:82:00.0 name: Tesla P100-PCIE-16GB computeCapability: 6.0
coreClock: 1.3285GHz coreCount: 56 deviceMemorySize: 15.89GiB deviceMemoryBandwidth: 681.88GiB/s
2026-05-11 04:00:19.992990: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 04:00:20.102970: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 04:00:20.103139: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 04:00:20.155398: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 04:00:20.204215: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 04:00:20.258142: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 04:00:20.305724: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 04:00:20.351664: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 04:00:20.352718: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 04:00:20.353676: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-11 04:00:20.354088: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 04:00:20.354875: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:82:00.0 name: Tesla P100-PCIE-16GB computeCapability: 6.0
coreClock: 1.3285GHz coreCount: 56 deviceMemorySize: 15.89GiB deviceMemoryBandwidth: 681.88GiB/s
2026-05-11 04:00:20.355021: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 04:00:20.355111: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 04:00:20.355176: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 04:00:20.355237: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 04:00:20.355296: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 04:00:20.355356: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 04:00:20.355415: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 04:00:20.355514: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 04:00:20.356381: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 04:00:20.356487: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 04:00:21.035042: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-11 04:00:21.035174: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-11 04:00:21.035201: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-11 04:00:21.036182: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 14950 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-16GB, pci bus id: 0000:82:00.0, compute capability: 6.0)
2026-05-11 04:00:31.459667: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2026-05-11 04:00:31.460423: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2400130000 Hz
2026-05-11 04:00:42.149229: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 04:00:42.588291: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 04:00:42.596204: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 04:00:45.590858: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-11 04:00:45.769703: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'jitters', 'index', 'status', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
2026-05-11 04:21:30.023889: W tensorflow/python/util/util.cc:348] Sets are not currently considered sequences, but this may change in the future, so consider avoiding using them.
2026-05-11 04:22:29.024479: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 04:24:07.215159: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 04:24:07.223937: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-11 04:24:07.309333: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:82:00.0 name: Tesla P100-PCIE-16GB computeCapability: 6.0
coreClock: 1.3285GHz coreCount: 56 deviceMemorySize: 15.89GiB deviceMemoryBandwidth: 681.88GiB/s
2026-05-11 04:24:07.309487: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 04:24:07.413256: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 04:24:07.413419: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 04:24:07.467547: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 04:24:07.521124: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 04:24:07.583143: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 04:24:07.643022: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 04:24:07.705154: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 04:24:07.706222: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 04:24:07.706979: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-11 04:24:07.707369: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 04:24:07.708173: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:82:00.0 name: Tesla P100-PCIE-16GB computeCapability: 6.0
coreClock: 1.3285GHz coreCount: 56 deviceMemorySize: 15.89GiB deviceMemoryBandwidth: 681.88GiB/s
2026-05-11 04:24:07.708299: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 04:24:07.708382: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 04:24:07.708457: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 04:24:07.708527: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 04:24:07.708596: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 04:24:07.708665: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 04:24:07.708733: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 04:24:07.708802: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 04:24:07.709708: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 04:24:07.709823: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 04:24:08.397869: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-11 04:24:08.398053: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-11 04:24:08.398082: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-11 04:24:08.399343: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 14950 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-16GB, pci bus id: 0000:82:00.0, compute capability: 6.0)
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)

batch:   0%|          | 0/48 [00:00<?, ?it/s]2026-05-11 04:24:12.432480: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2026-05-11 04:24:12.433302: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2400130000 Hz
2026-05-11 04:24:12.920965: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 04:24:13.185055: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 04:24:13.186899: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 04:24:15.224180: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-11 04:24:15.399219: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'true_profiles', 'true_logcounts', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])

batch:   2%|▏         | 1/48 [00:31<24:30, 31.28s/it]
batch:   4%|▍         | 2/48 [00:31<10:07, 13.20s/it]
batch:   6%|▋         | 3/48 [00:32<05:33,  7.40s/it]
batch:   8%|▊         | 4/48 [00:32<03:25,  4.67s/it]
batch:  10%|█         | 5/48 [00:33<02:16,  3.18s/it]
batch:  12%|█▎        | 6/48 [00:33<01:34,  2.24s/it]
batch:  15%|█▍        | 7/48 [00:34<01:06,  1.63s/it]
batch:  17%|█▋        | 8/48 [00:34<00:49,  1.23s/it]
batch:  19%|█▉        | 9/48 [00:34<00:37,  1.04it/s]
batch:  21%|██        | 10/48 [00:35<00:29,  1.28it/s]
batch:  23%|██▎       | 11/48 [00:35<00:26,  1.41it/s]
batch:  25%|██▌       | 12/48 [00:36<00:23,  1.56it/s]
batch:  27%|██▋       | 13/48 [00:36<00:19,  1.77it/s]
batch:  29%|██▉       | 14/48 [00:37<00:17,  1.95it/s]
batch:  31%|███▏      | 15/48 [00:37<00:15,  2.09it/s]
batch:  33%|███▎      | 16/48 [00:37<00:14,  2.20it/s]
batch:  35%|███▌      | 17/48 [00:38<00:13,  2.26it/s]
batch:  38%|███▊      | 18/48 [00:38<00:12,  2.34it/s]
batch:  40%|███▉      | 19/48 [00:39<00:12,  2.40it/s]
batch:  42%|████▏     | 20/48 [00:39<00:11,  2.43it/s]
batch:  44%|████▍     | 21/48 [00:39<00:10,  2.45it/s]
batch:  46%|████▌     | 22/48 [00:40<00:11,  2.28it/s]
batch:  48%|████▊     | 23/48 [00:40<00:11,  2.19it/s]
batch:  50%|█████     | 24/48 [00:41<00:11,  2.08it/s]
batch:  52%|█████▏    | 25/48 [00:41<00:10,  2.10it/s]
batch:  54%|█████▍    | 26/48 [00:42<00:09,  2.22it/s]
batch:  56%|█████▋    | 27/48 [00:42<00:09,  2.29it/s]
batch:  58%|█████▊    | 28/48 [00:43<00:08,  2.34it/s]
batch:  60%|██████    | 29/48 [00:43<00:08,  2.36it/s]
batch:  62%|██████▎   | 30/48 [00:43<00:07,  2.40it/s]
batch:  65%|██████▍   | 31/48 [00:44<00:06,  2.44it/s]
batch:  67%|██████▋   | 32/48 [00:44<00:06,  2.46it/s]
batch:  69%|██████▉   | 33/48 [00:45<00:06,  2.30it/s]
batch:  71%|███████   | 34/48 [00:45<00:06,  2.21it/s]
batch:  73%|███████▎  | 35/48 [00:46<00:05,  2.33it/s]
batch:  75%|███████▌  | 36/48 [00:46<00:04,  2.41it/s]
batch:  77%|███████▋  | 37/48 [00:46<00:04,  2.47it/s]
batch:  79%|███████▉  | 38/48 [00:47<00:04,  2.26it/s]
batch:  81%|████████▏ | 39/48 [00:47<00:03,  2.33it/s]
batch:  83%|████████▎ | 40/48 [00:48<00:03,  2.42it/s]
batch:  85%|████████▌ | 41/48 [00:48<00:03,  2.23it/s]
batch:  88%|████████▊ | 42/48 [00:49<00:02,  2.19it/s]
batch:  90%|████████▉ | 43/48 [00:49<00:02,  2.28it/s]
batch:  92%|█████████▏| 44/48 [00:49<00:01,  2.35it/s]
batch:  94%|█████████▍| 45/48 [00:50<00:01,  2.40it/s]
batch:  96%|█████████▌| 46/48 [00:50<00:00,  2.25it/s]
batch:  98%|█████████▊| 47/48 [00:51<00:00,  2.31it/s]
batch: 100%|██████████| 48/48 [00:51<00:00,  1.07s/it]

  0%|          | 0/3007 [00:00<?, ?it/s]
  3%|▎         | 102/3007 [00:00<00:02, 1011.38it/s]
  7%|▋         | 204/3007 [00:00<00:02, 1010.96it/s]
 10%|█         | 311/3007 [00:00<00:02, 1031.90it/s]
 14%|█▍        | 415/3007 [00:00<00:02, 1019.56it/s]
 17%|█▋        | 517/3007 [00:00<00:02, 1013.03it/s]
 21%|██        | 619/3007 [00:00<00:02, 1001.76it/s]
 24%|██▍       | 721/3007 [00:00<00:02, 1006.84it/s]
 27%|██▋       | 823/3007 [00:00<00:02, 1009.19it/s]
 31%|███       | 927/3007 [00:00<00:02, 1017.27it/s]
 34%|███▍      | 1029/3007 [00:01<00:01, 998.25it/s]
 38%|███▊      | 1129/3007 [00:01<00:01, 990.16it/s]
 41%|████      | 1229/3007 [00:01<00:01, 986.46it/s]
 44%|████▍     | 1328/3007 [00:01<00:01, 965.87it/s]
 47%|████▋     | 1425/3007 [00:01<00:01, 961.78it/s]
 51%|█████     | 1523/3007 [00:01<00:01, 966.69it/s]
 54%|█████▍    | 1620/3007 [00:01<00:01, 954.19it/s]
 57%|█████▋    | 1716/3007 [00:01<00:01, 949.30it/s]
 60%|██████    | 1811/3007 [00:01<00:01, 948.45it/s]
 63%|██████▎   | 1906/3007 [00:01<00:01, 945.03it/s]
 67%|██████▋   | 2001/3007 [00:02<00:01, 945.97it/s]
 70%|██████▉   | 2096/3007 [00:02<00:00, 933.50it/s]
 73%|███████▎  | 2190/3007 [00:02<00:00, 925.86it/s]
 76%|███████▌  | 2286/3007 [00:02<00:00, 935.55it/s]
 79%|███████▉  | 2380/3007 [00:02<00:00, 934.60it/s]
 82%|████████▏ | 2474/3007 [00:02<00:00, 928.87it/s]
 86%|████████▌ | 2571/3007 [00:02<00:00, 937.95it/s]
 89%|████████▊ | 2665/3007 [00:02<00:00, 920.86it/s]
 92%|█████████▏| 2758/3007 [00:02<00:00, 915.42it/s]
 95%|█████████▍| 2850/3007 [00:02<00:00, 915.16it/s]
 98%|█████████▊| 2942/3007 [00:03<00:00, 905.77it/s]
100%|██████████| 3007/3007 [00:03<00:00, 956.23it/s]

  0%|          | 0/3007 [00:00<?, ?it/s]
  3%|▎         | 102/3007 [00:00<00:02, 1001.32it/s]
  7%|▋         | 203/3007 [00:00<00:02, 1005.68it/s]
 10%|█         | 311/3007 [00:00<00:02, 1030.44it/s]
 14%|█▍        | 415/3007 [00:00<00:02, 1019.63it/s]
 17%|█▋        | 517/3007 [00:00<00:02, 1013.63it/s]
 21%|██        | 619/3007 [00:00<00:02, 1002.80it/s]
 24%|██▍       | 720/3007 [00:00<00:02, 1003.16it/s]
 27%|██▋       | 821/3007 [00:00<00:02, 1004.81it/s]
 31%|███       | 925/3007 [00:00<00:02, 1014.95it/s]
 34%|███▍      | 1027/3007 [00:01<00:01, 997.60it/s]
 37%|███▋      | 1127/3007 [00:01<00:01, 982.68it/s]
 41%|████      | 1227/3007 [00:01<00:01, 984.82it/s]
 44%|████▍     | 1326/3007 [00:01<00:01, 963.98it/s]
 47%|████▋     | 1424/3007 [00:01<00:01, 963.08it/s]
 51%|█████     | 1523/3007 [00:01<00:01, 970.27it/s]
 54%|█████▍    | 1621/3007 [00:01<00:01, 959.27it/s]
 57%|█████▋    | 1717/3007 [00:01<00:01, 955.27it/s]
 60%|██████    | 1813/3007 [00:01<00:01, 949.82it/s]
 63%|██████▎   | 1909/3007 [00:01<00:01, 950.16it/s]
 67%|██████▋   | 2005/3007 [00:02<00:01, 947.54it/s]
 70%|██████▉   | 2100/3007 [00:02<00:00, 941.96it/s]
 73%|███████▎  | 2195/3007 [00:02<00:00, 936.71it/s]
 76%|███████▌  | 2291/3007 [00:02<00:00, 937.79it/s]
 79%|███████▉  | 2385/3007 [00:02<00:00, 937.25it/s]
 82%|████████▏ | 2479/3007 [00:02<00:00, 932.99it/s]
 86%|████████▌ | 2574/3007 [00:02<00:00, 937.62it/s]
 89%|████████▊ | 2668/3007 [00:02<00:00, 920.78it/s]
 92%|█████████▏| 2761/3007 [00:02<00:00, 914.23it/s]
 95%|█████████▍| 2854/3007 [00:02<00:00, 917.19it/s]
 98%|█████████▊| 2946/3007 [00:03<00:00, 900.63it/s]
100%|██████████| 3007/3007 [00:03<00:00, 957.08it/s]
2026-05-11 04:25:29.708086: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 04:25:52.477897: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 04:25:52.480050: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-11 04:25:52.502619: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:82:00.0 name: Tesla P100-PCIE-16GB computeCapability: 6.0
coreClock: 1.3285GHz coreCount: 56 deviceMemorySize: 15.89GiB deviceMemoryBandwidth: 681.88GiB/s
2026-05-11 04:25:52.502728: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 04:25:52.509209: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 04:25:52.509287: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 04:25:52.512618: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 04:25:52.514950: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 04:25:52.520055: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 04:25:52.522740: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 04:25:52.524672: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 04:25:52.525255: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 04:25:52.525735: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-11 04:25:52.525870: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 04:25:52.526431: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:82:00.0 name: Tesla P100-PCIE-16GB computeCapability: 6.0
coreClock: 1.3285GHz coreCount: 56 deviceMemorySize: 15.89GiB deviceMemoryBandwidth: 681.88GiB/s
2026-05-11 04:25:52.526492: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 04:25:52.526538: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 04:25:52.526581: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 04:25:52.526623: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 04:25:52.526665: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 04:25:52.526706: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 04:25:52.526747: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 04:25:52.526813: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 04:25:52.527312: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 04:25:52.527376: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 04:25:53.078739: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-11 04:25:53.078872: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-11 04:25:53.078899: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-11 04:25:53.079857: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 14950 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-16GB, pci bus id: 0000:82:00.0, compute capability: 6.0)
2026-05-11 04:25:53.145262: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:196] None of the MLIR optimization passes are enabled (registered 0 passes)
2026-05-11 04:25:53.163446: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2400130000 Hz
2026-05-11 04:25:57.349053: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 04:25:57.577940: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 04:25:57.583744: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 04:25:58.691073: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-11 04:25:58.784679: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
RuntimeError: module compiled against API version 0xe but this version of numpy is 0xd
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)