Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded: curl/8.4.0
(required by: htslib/1.16)
-------------------------------------------------------------------------------




The following have been reloaded with a version change:
  1) curl/8.4.0 => curl/8.17.0     2) openssl/3.0.7 => openssl/3.6.0

2026-05-11 03:35:46.029343: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:39:07.065259: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:39:07.080484: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-11 03:39:07.105442: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:03:00.0 name: NVIDIA TITAN Xp computeCapability: 6.1
coreClock: 1.911GHz coreCount: 30 deviceMemorySize: 11.90GiB deviceMemoryBandwidth: 510.07GiB/s
2026-05-11 03:39:07.105537: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:39:07.116446: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:39:07.116563: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:39:07.119890: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:39:07.121917: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:39:07.128645: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:39:07.135772: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:39:07.140747: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:39:07.141433: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:39:07.141955: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-11 03:39:07.142107: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:39:07.142834: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:03:00.0 name: NVIDIA TITAN Xp computeCapability: 6.1
coreClock: 1.911GHz coreCount: 30 deviceMemorySize: 11.90GiB deviceMemoryBandwidth: 510.07GiB/s
2026-05-11 03:39:07.142924: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:39:07.142986: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:39:07.143041: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:39:07.143092: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:39:07.143143: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:39:07.143211: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:39:07.143262: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:39:07.143343: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:39:07.144204: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:39:07.144296: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:39:07.735169: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-11 03:39:07.735265: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-11 03:39:07.735288: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-11 03:39:07.736100: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11209 MB memory) -> physical GPU (device: 0, name: NVIDIA TITAN Xp, pci bus id: 0000:03:00.0, compute capability: 6.1)
2026-05-11 03:39:10.644790: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2026-05-11 03:39:10.645422: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2400000000 Hz
2026-05-11 03:39:17.770024: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:39:18.027673: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:39:18.035384: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:39:19.164627: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-11 03:39:19.246694: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'jitters', 'index', 'status', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
2026-05-11 03:53:20.701649: W tensorflow/python/util/util.cc:348] Sets are not currently considered sequences, but this may change in the future, so consider avoiding using them.
2026-05-11 03:55:13.689575: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:59:40.882497: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:59:40.929002: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-11 03:59:40.991508: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:03:00.0 name: NVIDIA TITAN Xp computeCapability: 6.1
coreClock: 1.911GHz coreCount: 30 deviceMemorySize: 11.90GiB deviceMemoryBandwidth: 510.07GiB/s
2026-05-11 03:59:40.991624: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:59:41.012826: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:59:41.012953: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:59:41.021683: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:59:41.029079: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:59:41.040422: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:59:41.048911: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:59:41.057514: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:59:41.058079: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:59:41.058426: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-11 03:59:41.058563: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 03:59:41.059299: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:03:00.0 name: NVIDIA TITAN Xp computeCapability: 6.1
coreClock: 1.911GHz coreCount: 30 deviceMemorySize: 11.90GiB deviceMemoryBandwidth: 510.07GiB/s
2026-05-11 03:59:41.059392: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:59:41.059463: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:59:41.059524: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:59:41.059576: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 03:59:41.059634: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 03:59:41.059685: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 03:59:41.059735: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 03:59:41.059786: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:59:41.060600: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 03:59:41.060696: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 03:59:41.657584: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-11 03:59:41.657680: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-11 03:59:41.657714: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-11 03:59:41.658878: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11209 MB memory) -> physical GPU (device: 0, name: NVIDIA TITAN Xp, pci bus id: 0000:03:00.0, compute capability: 6.1)
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)

batch:   0%|          | 0/42 [00:00<?, ?it/s]2026-05-11 03:59:44.099810: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2026-05-11 03:59:44.100408: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2400000000 Hz
2026-05-11 03:59:44.768702: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 03:59:45.031218: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 03:59:45.032926: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 03:59:46.874916: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-11 03:59:47.016370: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'true_profiles', 'true_logcounts', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])

batch:   2%|▏         | 1/42 [00:40<27:21, 40.03s/it]
batch:   5%|▍         | 2/42 [00:40<11:09, 16.74s/it]
batch:   7%|▋         | 3/42 [00:40<06:01,  9.28s/it]
batch:  10%|▉         | 4/42 [00:41<03:39,  5.78s/it]
batch:  12%|█▏        | 5/42 [00:41<02:22,  3.84s/it]
batch:  14%|█▍        | 6/42 [00:42<01:36,  2.67s/it]
batch:  17%|█▋        | 7/42 [00:42<01:07,  1.94s/it]
batch:  19%|█▉        | 8/42 [00:42<00:49,  1.45s/it]
batch:  21%|██▏       | 9/42 [00:43<00:37,  1.12s/it]
batch:  24%|██▍       | 10/42 [00:43<00:28,  1.11it/s]
batch:  26%|██▌       | 11/42 [00:44<00:23,  1.34it/s]
batch:  29%|██▊       | 12/42 [00:44<00:19,  1.54it/s]
batch:  31%|███       | 13/42 [00:44<00:16,  1.71it/s]
batch:  33%|███▎      | 14/42 [00:45<00:14,  1.87it/s]
batch:  36%|███▌      | 15/42 [00:45<00:13,  2.03it/s]
batch:  38%|███▊      | 16/42 [00:46<00:11,  2.17it/s]
batch:  40%|████      | 17/42 [00:46<00:11,  2.27it/s]
batch:  43%|████▎     | 18/42 [00:47<00:10,  2.28it/s]
batch:  45%|████▌     | 19/42 [00:47<00:10,  2.30it/s]
batch:  48%|████▊     | 20/42 [00:47<00:09,  2.36it/s]
batch:  50%|█████     | 21/42 [00:48<00:08,  2.40it/s]
batch:  52%|█████▏    | 22/42 [00:48<00:08,  2.37it/s]
batch:  55%|█████▍    | 23/42 [00:49<00:07,  2.42it/s]
batch:  57%|█████▋    | 24/42 [00:49<00:07,  2.45it/s]
batch:  60%|█████▉    | 25/42 [00:49<00:06,  2.47it/s]
batch:  62%|██████▏   | 26/42 [00:50<00:06,  2.43it/s]
batch:  64%|██████▍   | 27/42 [00:50<00:06,  2.45it/s]
batch:  67%|██████▋   | 28/42 [00:51<00:05,  2.48it/s]
batch:  69%|██████▉   | 29/42 [00:51<00:05,  2.44it/s]
batch:  71%|███████▏  | 30/42 [00:51<00:04,  2.42it/s]
batch:  74%|███████▍  | 31/42 [00:52<00:04,  2.45it/s]
batch:  76%|███████▌  | 32/42 [00:52<00:04,  2.47it/s]
batch:  79%|███████▊  | 33/42 [00:53<00:03,  2.49it/s]
batch:  81%|████████  | 34/42 [00:53<00:03,  2.43it/s]
batch:  83%|████████▎ | 35/42 [00:53<00:02,  2.47it/s]
batch:  86%|████████▌ | 36/42 [00:54<00:02,  2.43it/s]
batch:  88%|████████▊ | 37/42 [00:54<00:02,  2.46it/s]
batch:  90%|█████████ | 38/42 [00:55<00:01,  2.41it/s]
batch:  93%|█████████▎| 39/42 [00:55<00:01,  2.44it/s]
batch:  95%|█████████▌| 40/42 [00:56<00:00,  2.42it/s]
batch:  98%|█████████▊| 41/42 [00:56<00:00,  2.12it/s]
batch: 100%|██████████| 42/42 [00:56<00:00,  2.36it/s]
batch: 100%|██████████| 42/42 [00:56<00:00,  1.36s/it]

  0%|          | 0/2671 [00:00<?, ?it/s]
  3%|▎         | 93/2671 [00:00<00:02, 918.98it/s]
  7%|▋         | 187/2671 [00:00<00:02, 924.52it/s]
 11%|█         | 281/2671 [00:00<00:02, 930.24it/s]
 14%|█▍        | 376/2671 [00:00<00:02, 930.97it/s]
 18%|█▊        | 471/2671 [00:00<00:02, 933.00it/s]
 21%|██        | 565/2671 [00:00<00:02, 929.19it/s]
 25%|██▍       | 658/2671 [00:00<00:02, 923.32it/s]
 28%|██▊       | 751/2671 [00:00<00:02, 923.43it/s]
 32%|███▏      | 844/2671 [00:00<00:01, 915.38it/s]
 35%|███▌      | 936/2671 [00:01<00:01, 912.39it/s]
 38%|███▊      | 1028/2671 [00:01<00:01, 912.39it/s]
 42%|████▏     | 1120/2671 [00:01<00:01, 912.87it/s]
 45%|████▌     | 1212/2671 [00:01<00:01, 903.62it/s]
 49%|████▉     | 1303/2671 [00:01<00:01, 895.20it/s]
 52%|█████▏    | 1393/2671 [00:01<00:01, 893.14it/s]
 56%|█████▌    | 1483/2671 [00:01<00:01, 885.29it/s]
 59%|█████▉    | 1574/2671 [00:01<00:01, 886.73it/s]
 62%|██████▏   | 1663/2671 [00:01<00:01, 887.45it/s]
 66%|██████▌   | 1752/2671 [00:01<00:01, 885.45it/s]
 69%|██████▉   | 1841/2671 [00:02<00:00, 881.71it/s]
 72%|███████▏  | 1930/2671 [00:02<00:00, 877.96it/s]
 76%|███████▌  | 2018/2671 [00:02<00:00, 865.82it/s]
 79%|███████▉  | 2105/2671 [00:02<00:00, 862.77it/s]
 82%|████████▏ | 2192/2671 [00:02<00:00, 861.16it/s]
 85%|████████▌ | 2279/2671 [00:02<00:00, 856.22it/s]
 89%|████████▊ | 2365/2671 [00:02<00:00, 855.55it/s]
 92%|█████████▏| 2451/2671 [00:02<00:00, 839.90it/s]
 95%|█████████▍| 2536/2671 [00:02<00:00, 829.10it/s]
 98%|█████████▊| 2619/2671 [00:02<00:00, 820.01it/s]
100%|██████████| 2671/2671 [00:03<00:00, 881.61it/s]

  0%|          | 0/2671 [00:00<?, ?it/s]
  4%|▎         | 96/2671 [00:00<00:02, 945.18it/s]
  7%|▋         | 193/2671 [00:00<00:02, 953.70it/s]
 11%|█         | 289/2671 [00:00<00:02, 951.97it/s]
 14%|█▍        | 385/2671 [00:00<00:02, 938.48it/s]
 18%|█▊        | 480/2671 [00:00<00:02, 936.75it/s]
 21%|██▏       | 574/2671 [00:00<00:02, 934.12it/s]
 25%|██▌       | 668/2671 [00:00<00:02, 930.94it/s]
 29%|██▊       | 762/2671 [00:00<00:02, 928.59it/s]
 32%|███▏      | 855/2671 [00:00<00:01, 918.85it/s]
 35%|███▌      | 947/2671 [00:01<00:01, 913.94it/s]
 39%|███▉      | 1040/2671 [00:01<00:01, 917.92it/s]
 42%|████▏     | 1132/2671 [00:01<00:01, 911.16it/s]
 46%|████▌     | 1224/2671 [00:01<00:01, 907.80it/s]
 49%|████▉     | 1315/2671 [00:01<00:01, 901.69it/s]
 53%|█████▎    | 1406/2671 [00:01<00:01, 903.05it/s]
 56%|█████▌    | 1497/2671 [00:01<00:01, 904.80it/s]
 59%|█████▉    | 1589/2671 [00:01<00:01, 903.96it/s]
 63%|██████▎   | 1680/2671 [00:01<00:01, 898.23it/s]
 66%|██████▋   | 1770/2671 [00:01<00:01, 896.83it/s]
 70%|██████▉   | 1860/2671 [00:02<00:00, 890.62it/s]
 73%|███████▎  | 1950/2671 [00:02<00:00, 884.53it/s]
 76%|███████▋  | 2039/2671 [00:02<00:00, 868.68it/s]
 80%|███████▉  | 2126/2671 [00:02<00:00, 862.23it/s]
 83%|████████▎ | 2214/2671 [00:02<00:00, 867.26it/s]
 86%|████████▌ | 2301/2671 [00:02<00:00, 857.46it/s]
 89%|████████▉ | 2387/2671 [00:02<00:00, 856.05it/s]
 93%|█████████▎| 2473/2671 [00:02<00:00, 843.42it/s]
 96%|█████████▌| 2558/2671 [00:02<00:00, 835.17it/s]
 99%|█████████▉| 2642/2671 [00:02<00:00, 828.95it/s]
100%|██████████| 2671/2671 [00:03<00:00, 889.62it/s]
RuntimeError: module compiled against API version 0xe but this version of numpy is 0xd
Matplotlib is building the font cache; this may take a moment.
2026-05-11 04:04:52.803859: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 04:08:52.693562: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 04:08:52.768825: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2026-05-11 04:08:52.865124: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:03:00.0 name: NVIDIA TITAN Xp computeCapability: 6.1
coreClock: 1.911GHz coreCount: 30 deviceMemorySize: 11.90GiB deviceMemoryBandwidth: 510.07GiB/s
2026-05-11 04:08:52.865346: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 04:08:52.936816: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 04:08:52.936976: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 04:08:52.974292: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 04:08:53.008916: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 04:08:53.045201: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 04:08:53.076831: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 04:08:53.107184: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 04:08:53.108324: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 04:08:53.109010: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-05-11 04:08:53.109367: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2026-05-11 04:08:53.110050: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:03:00.0 name: NVIDIA TITAN Xp computeCapability: 6.1
coreClock: 1.911GHz coreCount: 30 deviceMemorySize: 11.90GiB deviceMemoryBandwidth: 510.07GiB/s
2026-05-11 04:08:53.110231: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 04:08:53.110319: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 04:08:53.110390: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 04:08:53.110458: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2026-05-11 04:08:53.110526: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2026-05-11 04:08:53.110593: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2026-05-11 04:08:53.110660: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2026-05-11 04:08:53.110727: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 04:08:53.111596: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2026-05-11 04:08:53.111710: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2026-05-11 04:08:53.690993: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2026-05-11 04:08:53.691091: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2026-05-11 04:08:53.691112: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2026-05-11 04:08:53.692003: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11209 MB memory) -> physical GPU (device: 0, name: NVIDIA TITAN Xp, pci bus id: 0000:03:00.0, compute capability: 6.1)
2026-05-11 04:08:53.754591: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:196] None of the MLIR optimization passes are enabled (registered 0 passes)
2026-05-11 04:08:53.772897: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2400000000 Hz
2026-05-11 04:08:57.899127: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2026-05-11 04:08:58.187743: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2026-05-11 04:08:58.193364: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2026-05-11 04:09:00.069071: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2026-05-11 04:09:00.155119: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)