Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded: curl/8.4.0
(required by: htslib/1.16)
-------------------------------------------------------------------------------




The following have been reloaded with a version change:
  1) curl/8.4.0 => curl/8.17.0     2) openssl/3.0.7 => openssl/3.6.0

2026-05-11 03:00:07.938700: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:05:20.554357: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:05:20.712110: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-11 03:05:21.124623: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:04:00.0 name: NVIDIA TITAN Xp computeCapability: 6.1
coreClock: 1.911GHz coreCount: 30 deviceMemorySize: 11.90GiB deviceMemoryBandwidth: 510.07GiB/s
2026-05-11 03:05:21.124757: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:05:34.162100: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:05:34.162266: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:05:34.416850: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:05:35.157594: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:05:35.793427: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:05:36.114927: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:05:36.411343: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:05:36.414957: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:05:36.415766: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-11 03:05:36.416014: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:05:36.418093: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:04:00.0 name: NVIDIA TITAN Xp computeCapability: 6.1
coreClock: 1.911GHz coreCount: 30 deviceMemorySize: 11.90GiB deviceMemoryBandwidth: 510.07GiB/s
2026-05-11 03:05:36.418175: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:05:36.418229: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:05:36.418277: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:05:36.418322: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:05:36.418367: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:05:36.418410: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:05:36.418454: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:05:36.418531: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:05:36.421833: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:05:36.421953: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:05:39.324120: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-11 03:05:39.324254: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-11 03:05:39.324276: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-11 03:05:39.326192: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11209 MB memory) -> physical GPU (device: 0, name: NVIDIA TITAN Xp, pci bus id: 0000:04:00.0, compute capability: 6.1)
2026-05-11 03:05:45.761130: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2026-05-11 03:05:45.761983: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2400010000 Hz
2026-05-11 03:05:52.837891: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:05:53.391697: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:05:53.400011: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:06:17.870721: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-11 03:06:17.972187: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'jitters', 'index', 'status', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
2026-05-11 03:21:30.581883: W tensorflow/python/util/util.cc:348] Sets are not currently considered sequences, but this may change in the future, so consider avoiding using them.
2026-05-11 03:21:38.976840: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:23:43.941565: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:23:43.950057: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-11 03:23:44.008109: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:04:00.0 name: NVIDIA TITAN Xp computeCapability: 6.1
coreClock: 1.911GHz coreCount: 30 deviceMemorySize: 11.90GiB deviceMemoryBandwidth: 510.07GiB/s
2026-05-11 03:23:44.008188: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:23:44.038828: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:23:44.038993: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:23:44.054037: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:23:44.068160: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:23:44.085664: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:23:44.099798: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:23:44.114004: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:23:44.115516: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:23:44.115888: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-11 03:23:44.116055: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:23:44.117116: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:04:00.0 name: NVIDIA TITAN Xp computeCapability: 6.1
coreClock: 1.911GHz coreCount: 30 deviceMemorySize: 11.90GiB deviceMemoryBandwidth: 510.07GiB/s
2026-05-11 03:23:44.117191: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:23:44.117256: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:23:44.117300: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:23:44.117342: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:23:44.117383: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:23:44.117424: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:23:44.117464: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:23:44.117507: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:23:44.118987: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:23:44.119062: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:23:44.794320: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-11 03:23:44.794437: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-11 03:23:44.794457: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-11 03:23:44.799382: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11209 MB memory) -> physical GPU (device: 0, name: NVIDIA TITAN Xp, pci bus id: 0000:04:00.0, compute capability: 6.1)
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)

batch:   0%|          | 0/42 [00:00<?, ?it/s]2026-05-11 03:23:47.277406: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2026-05-11 03:23:47.278124: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2400010000 Hz
2026-05-11 03:23:48.048640: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:23:48.648862: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:23:48.674143: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:23:50.846884: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-11 03:23:51.024431: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'true_profiles', 'true_logcounts', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])

batch:   2%|▏         | 1/42 [00:35<24:16, 35.53s/it]
batch:   5%|▍         | 2/42 [00:35<09:55, 14.90s/it]
batch:   7%|▋         | 3/42 [00:36<05:23,  8.30s/it]
batch:  10%|▉         | 4/42 [00:36<03:17,  5.20s/it]
batch:  12%|█▏        | 5/42 [00:37<02:08,  3.47s/it]
batch:  14%|█▍        | 6/42 [00:37<01:27,  2.44s/it]
batch:  17%|█▋        | 7/42 [00:38<01:02,  1.78s/it]
batch:  19%|█▉        | 8/42 [00:38<00:45,  1.35s/it]
batch:  21%|██▏       | 9/42 [00:38<00:34,  1.06s/it]
batch:  24%|██▍       | 10/42 [00:39<00:27,  1.16it/s]
batch:  26%|██▌       | 11/42 [00:39<00:22,  1.36it/s]
batch:  29%|██▊       | 12/42 [00:40<00:19,  1.57it/s]
batch:  31%|███       | 13/42 [00:40<00:16,  1.75it/s]
batch:  33%|███▎      | 14/42 [00:41<00:14,  1.91it/s]
batch:  36%|███▌      | 15/42 [00:41<00:13,  1.99it/s]
batch:  38%|███▊      | 16/42 [00:41<00:12,  2.11it/s]
batch:  40%|████      | 17/42 [00:42<00:11,  2.13it/s]
batch:  43%|████▎     | 18/42 [00:42<00:11,  2.16it/s]
batch:  45%|████▌     | 19/42 [00:43<00:10,  2.24it/s]
batch:  48%|████▊     | 20/42 [00:43<00:09,  2.23it/s]
batch:  50%|█████     | 21/42 [00:44<00:09,  2.29it/s]
batch:  52%|█████▏    | 22/42 [00:44<00:08,  2.32it/s]
batch:  55%|█████▍    | 23/42 [00:44<00:08,  2.34it/s]
batch:  57%|█████▋    | 24/42 [00:45<00:07,  2.37it/s]
batch:  60%|█████▉    | 25/42 [00:45<00:07,  2.33it/s]
batch:  62%|██████▏   | 26/42 [00:46<00:06,  2.35it/s]
batch:  64%|██████▍   | 27/42 [00:46<00:06,  2.31it/s]
batch:  67%|██████▋   | 28/42 [00:47<00:06,  2.29it/s]
batch:  69%|██████▉   | 29/42 [00:47<00:05,  2.33it/s]
batch:  71%|███████▏  | 30/42 [00:47<00:05,  2.36it/s]
batch:  74%|███████▍  | 31/42 [00:48<00:04,  2.36it/s]
batch:  76%|███████▌  | 32/42 [00:48<00:04,  2.36it/s]
batch:  79%|███████▊  | 33/42 [00:49<00:03,  2.38it/s]
batch:  81%|████████  | 34/42 [00:49<00:03,  2.33it/s]
batch:  83%|████████▎ | 35/42 [00:50<00:02,  2.35it/s]
batch:  86%|████████▌ | 36/42 [00:50<00:02,  2.35it/s]
batch:  88%|████████▊ | 37/42 [00:50<00:02,  2.28it/s]
batch:  90%|█████████ | 38/42 [00:51<00:01,  2.27it/s]
batch:  93%|█████████▎| 39/42 [00:51<00:01,  2.26it/s]
batch:  95%|█████████▌| 40/42 [00:52<00:00,  2.24it/s]
batch:  98%|█████████▊| 41/42 [00:52<00:00,  2.49it/s]
batch: 100%|██████████| 42/42 [00:52<00:00,  1.26s/it]

  0%|          | 0/2601 [00:00<?, ?it/s]
  3%|▎         | 84/2601 [00:00<00:03, 837.36it/s]
  7%|▋         | 175/2601 [00:00<00:02, 870.34it/s]
 10%|█         | 272/2601 [00:00<00:02, 914.69it/s]
 14%|█▍        | 369/2601 [00:00<00:02, 928.01it/s]
 18%|█▊        | 464/2601 [00:00<00:02, 935.41it/s]
 21%|██▏       | 559/2601 [00:00<00:02, 933.67it/s]
 25%|██▌       | 653/2601 [00:00<00:02, 935.45it/s]
 29%|██▊       | 747/2601 [00:00<00:01, 931.85it/s]
 32%|███▏      | 841/2601 [00:00<00:01, 914.36it/s]
 36%|███▌      | 933/2601 [00:01<00:01, 909.25it/s]
 39%|███▉      | 1024/2601 [00:01<00:01, 906.78it/s]
 43%|████▎     | 1115/2601 [00:01<00:01, 888.88it/s]
 46%|████▋     | 1204/2601 [00:01<00:01, 885.52it/s]
 50%|████▉     | 1295/2601 [00:01<00:01, 889.36it/s]
 53%|█████▎    | 1384/2601 [00:01<00:01, 888.83it/s]
 57%|█████▋    | 1476/2601 [00:01<00:01, 893.48it/s]
 60%|██████    | 1571/2601 [00:01<00:01, 905.61it/s]
 64%|██████▍   | 1662/2601 [00:01<00:01, 902.78it/s]
 67%|██████▋   | 1753/2601 [00:01<00:00, 888.57it/s]
 71%|███████   | 1842/2601 [00:02<00:00, 875.49it/s]
 74%|███████▍  | 1931/2601 [00:02<00:00, 876.61it/s]
 78%|███████▊  | 2019/2601 [00:02<00:00, 871.34it/s]
 81%|████████  | 2109/2601 [00:02<00:00, 875.65it/s]
 84%|████████▍ | 2197/2601 [00:02<00:00, 873.17it/s]
 88%|████████▊ | 2285/2601 [00:02<00:00, 861.54it/s]
 91%|█████████ | 2372/2601 [00:02<00:00, 858.31it/s]
 95%|█████████▍| 2458/2601 [00:02<00:00, 850.72it/s]
 98%|█████████▊| 2547/2601 [00:02<00:00, 861.97it/s]
100%|██████████| 2601/2601 [00:02<00:00, 887.09it/s]

  0%|          | 0/2601 [00:00<?, ?it/s]
  4%|▎         | 95/2601 [00:00<00:02, 948.97it/s]
  7%|▋         | 190/2601 [00:00<00:02, 934.37it/s]
 11%|█         | 289/2601 [00:00<00:02, 950.64it/s]
 15%|█▍        | 385/2601 [00:00<00:02, 946.06it/s]
 19%|█▊        | 482/2601 [00:00<00:02, 952.69it/s]
 22%|██▏       | 578/2601 [00:00<00:02, 954.81it/s]
 26%|██▌       | 674/2601 [00:00<00:02, 948.30it/s]
 30%|██▉       | 769/2601 [00:00<00:01, 931.35it/s]
 33%|███▎      | 863/2601 [00:00<00:01, 916.48it/s]
 37%|███▋      | 955/2601 [00:01<00:01, 913.67it/s]
 40%|████      | 1047/2601 [00:01<00:01, 914.23it/s]
 44%|████▍     | 1139/2601 [00:01<00:01, 902.26it/s]
 47%|████▋     | 1230/2601 [00:01<00:01, 895.30it/s]
 51%|█████     | 1322/2601 [00:01<00:01, 901.07it/s]
 54%|█████▍    | 1413/2601 [00:01<00:01, 901.22it/s]
 58%|█████▊    | 1504/2601 [00:01<00:01, 901.48it/s]
 62%|██████▏   | 1600/2601 [00:01<00:01, 917.87it/s]
 65%|██████▌   | 1692/2601 [00:01<00:01, 906.62it/s]
 69%|██████▊   | 1783/2601 [00:01<00:00, 896.97it/s]
 72%|███████▏  | 1873/2601 [00:02<00:00, 886.38it/s]
 75%|███████▌  | 1962/2601 [00:02<00:00, 877.37it/s]
 79%|███████▉  | 2054/2601 [00:02<00:00, 886.77it/s]
 82%|████████▏ | 2143/2601 [00:02<00:00, 882.49it/s]
 86%|████████▌ | 2232/2601 [00:02<00:00, 875.17it/s]
 89%|████████▉ | 2320/2601 [00:02<00:00, 871.04it/s]
 93%|█████████▎| 2408/2601 [00:02<00:00, 861.95it/s]
 96%|█████████▌| 2495/2601 [00:02<00:00, 863.45it/s]
 99%|█████████▉| 2582/2601 [00:02<00:00, 857.70it/s]
100%|██████████| 2601/2601 [00:02<00:00, 898.65it/s]
2026-05-11 03:26:06.706856: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:27:12.933250: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:27:12.941113: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-11 03:27:12.997723: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:04:00.0 name: NVIDIA TITAN Xp computeCapability: 6.1
coreClock: 1.911GHz coreCount: 30 deviceMemorySize: 11.90GiB deviceMemoryBandwidth: 510.07GiB/s
2026-05-11 03:27:12.997860: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:27:13.014593: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:27:13.014778: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:27:13.021655: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:27:13.028218: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:27:13.038205: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:27:13.044702: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:27:13.051314: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:27:13.052925: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:27:13.053439: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-11 03:27:13.053618: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:27:13.054557: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:04:00.0 name: NVIDIA TITAN Xp computeCapability: 6.1
coreClock: 1.911GHz coreCount: 30 deviceMemorySize: 11.90GiB deviceMemoryBandwidth: 510.07GiB/s
2026-05-11 03:27:13.054664: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:27:13.054723: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:27:13.054772: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:27:13.054820: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:27:13.054867: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:27:13.054977: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:27:13.055026: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:27:13.055074: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:27:13.056551: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:27:13.056635: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:27:13.695406: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-11 03:27:13.695519: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-11 03:27:13.695540: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-11 03:27:13.697603: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11209 MB memory) -> physical GPU (device: 0, name: NVIDIA TITAN Xp, pci bus id: 0000:04:00.0, compute capability: 6.1)
2026-05-11 03:27:13.771518: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:196] None of the MLIR optimization passes are enabled (registered 0 passes)
2026-05-11 03:27:13.804370: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2400010000 Hz
2026-05-11 03:27:17.626946: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:27:17.906942: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:27:17.912882: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:27:18.946358: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-11 03:27:19.054253: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
RuntimeError: module compiled against API version 0xe but this version of numpy is 0xd
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)