Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded: curl/8.4.0
(required by: htslib/1.16)
-------------------------------------------------------------------------------




The following have been reloaded with a version change:
  1) curl/8.4.0 => curl/8.17.0     2) openssl/3.0.7 => openssl/3.6.0

2025-11-17 16:45:52.760056: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:46:15.088344: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-11-17 16:46:15.089882: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2025-11-17 16:46:15.121020: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:8a:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5
coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.75GiB deviceMemoryBandwidth: 573.69GiB/s
2025-11-17 16:46:15.121130: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:46:15.126702: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:46:15.126777: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:46:15.129216: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-11-17 16:46:15.130891: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-11-17 16:46:15.134766: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-11-17 16:46:15.136922: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-11-17 16:46:15.138548: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:46:15.139545: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-11-17 16:46:15.140030: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2025-11-17 16:46:15.142986: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-11-17 16:46:15.143541: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:8a:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5
coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.75GiB deviceMemoryBandwidth: 573.69GiB/s
2025-11-17 16:46:15.143583: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:46:15.143609: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:46:15.143631: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:46:15.143652: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-11-17 16:46:15.143677: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-11-17 16:46:15.143702: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-11-17 16:46:15.143727: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-11-17 16:46:15.143774: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:46:15.144641: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-11-17 16:46:15.144690: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:46:15.609086: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2025-11-17 16:46:15.609183: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2025-11-17 16:46:15.609198: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2025-11-17 16:46:15.610510: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10064 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:8a:00.0, compute capability: 7.5)
2025-11-17 16:46:30.065329: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2025-11-17 16:46:30.065991: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2500090000 Hz
2025-11-17 16:46:31.450093: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:46:31.800309: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:46:31.810373: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:46:33.077917: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2025-11-17 16:46:33.141023: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'jitters', 'index', 'status', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
2025-11-17 16:52:46.525175: W tensorflow/python/util/util.cc:348] Sets are not currently considered sequences, but this may change in the future, so consider avoiding using them.
2025-11-17 16:52:51.292574: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:53:00.314548: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-11-17 16:53:00.315617: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2025-11-17 16:53:00.346141: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:8a:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5
coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.75GiB deviceMemoryBandwidth: 573.69GiB/s
2025-11-17 16:53:00.346277: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:53:00.352031: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:53:00.352108: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:53:00.355175: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-11-17 16:53:00.357508: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-11-17 16:53:00.361788: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-11-17 16:53:00.364594: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-11-17 16:53:00.366465: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:53:00.367483: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-11-17 16:53:00.367887: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2025-11-17 16:53:00.370703: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-11-17 16:53:00.371957: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:8a:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5
coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.75GiB deviceMemoryBandwidth: 573.69GiB/s
2025-11-17 16:53:00.372045: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:53:00.372096: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:53:00.372130: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:53:00.372164: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-11-17 16:53:00.372197: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-11-17 16:53:00.372229: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-11-17 16:53:00.372261: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-11-17 16:53:00.372294: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:53:00.373369: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-11-17 16:53:00.373445: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:53:00.841308: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2025-11-17 16:53:00.841463: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2025-11-17 16:53:00.841477: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2025-11-17 16:53:00.842958: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10064 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:8a:00.0, compute capability: 7.5)
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)

batch:   0%|          | 0/58 [00:00<?, ?it/s]2025-11-17 16:53:02.358701: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2025-11-17 16:53:02.359212: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2500090000 Hz
2025-11-17 16:53:02.613070: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:53:02.976037: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:53:02.978313: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:53:04.275746: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2025-11-17 16:53:04.340991: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'true_profiles', 'true_logcounts', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])

batch:   2%|▏         | 1/58 [00:18<17:25, 18.35s/it]
batch:   3%|▎         | 2/58 [00:18<07:13,  7.74s/it]
batch:   5%|▌         | 3/58 [00:18<03:59,  4.35s/it]
batch:   7%|▋         | 4/58 [00:19<02:28,  2.75s/it]
batch:   9%|▊         | 5/58 [00:19<01:39,  1.87s/it]
batch:  10%|█         | 6/58 [00:19<01:09,  1.34s/it]
batch:  12%|█▏        | 7/58 [00:20<00:51,  1.00s/it]
batch:  14%|█▍        | 8/58 [00:20<00:39,  1.28it/s]
batch:  16%|█▌        | 9/58 [00:20<00:31,  1.57it/s]
batch:  17%|█▋        | 10/58 [00:21<00:25,  1.88it/s]
batch:  19%|█▉        | 11/58 [00:21<00:21,  2.15it/s]
batch:  21%|██        | 12/58 [00:21<00:19,  2.40it/s]
batch:  22%|██▏       | 13/58 [00:22<00:17,  2.60it/s]
batch:  24%|██▍       | 14/58 [00:22<00:15,  2.76it/s]
batch:  26%|██▌       | 15/58 [00:22<00:14,  2.87it/s]
batch:  28%|██▊       | 16/58 [00:23<00:14,  2.97it/s]
batch:  29%|██▉       | 17/58 [00:23<00:13,  3.03it/s]
batch:  31%|███       | 18/58 [00:23<00:12,  3.10it/s]
batch:  33%|███▎      | 19/58 [00:23<00:12,  3.13it/s]
batch:  34%|███▍      | 20/58 [00:24<00:12,  3.15it/s]
batch:  36%|███▌      | 21/58 [00:24<00:11,  3.18it/s]
batch:  38%|███▊      | 22/58 [00:24<00:11,  3.19it/s]
batch:  40%|███▉      | 23/58 [00:25<00:10,  3.21it/s]
batch:  41%|████▏     | 24/58 [00:25<00:10,  3.21it/s]
batch:  43%|████▎     | 25/58 [00:25<00:10,  3.22it/s]
batch:  45%|████▍     | 26/58 [00:26<00:09,  3.21it/s]
batch:  47%|████▋     | 27/58 [00:26<00:09,  3.22it/s]
batch:  48%|████▊     | 28/58 [00:26<00:09,  3.24it/s]
batch:  50%|█████     | 29/58 [00:27<00:08,  3.25it/s]
batch:  52%|█████▏    | 30/58 [00:27<00:08,  3.24it/s]
batch:  53%|█████▎    | 31/58 [00:27<00:08,  3.25it/s]
batch:  55%|█████▌    | 32/58 [00:27<00:08,  3.23it/s]
batch:  57%|█████▋    | 33/58 [00:28<00:07,  3.24it/s]
batch:  59%|█████▊    | 34/58 [00:28<00:07,  3.22it/s]
batch:  60%|██████    | 35/58 [00:28<00:07,  3.23it/s]
batch:  62%|██████▏   | 36/58 [00:29<00:06,  3.23it/s]
batch:  64%|██████▍   | 37/58 [00:29<00:06,  3.23it/s]
batch:  66%|██████▌   | 38/58 [00:29<00:06,  3.22it/s]
batch:  67%|██████▋   | 39/58 [00:30<00:05,  3.22it/s]
batch:  69%|██████▉   | 40/58 [00:30<00:05,  3.21it/s]
batch:  71%|███████   | 41/58 [00:30<00:05,  3.22it/s]
batch:  72%|███████▏  | 42/58 [00:31<00:04,  3.22it/s]
batch:  74%|███████▍  | 43/58 [00:31<00:04,  3.23it/s]
batch:  76%|███████▌  | 44/58 [00:31<00:04,  3.23it/s]
batch:  78%|███████▊  | 45/58 [00:31<00:04,  3.22it/s]
batch:  79%|███████▉  | 46/58 [00:32<00:03,  3.21it/s]
batch:  81%|████████  | 47/58 [00:32<00:03,  3.22it/s]
batch:  83%|████████▎ | 48/58 [00:32<00:03,  3.22it/s]
batch:  84%|████████▍ | 49/58 [00:33<00:02,  3.23it/s]
batch:  86%|████████▌ | 50/58 [00:33<00:02,  3.24it/s]
batch:  88%|████████▊ | 51/58 [00:33<00:02,  3.24it/s]
batch:  90%|████████▉ | 52/58 [00:34<00:01,  3.24it/s]
batch:  91%|█████████▏| 53/58 [00:34<00:01,  3.24it/s]
batch:  93%|█████████▎| 54/58 [00:34<00:01,  3.23it/s]
batch:  95%|█████████▍| 55/58 [00:35<00:00,  3.23it/s]
batch:  97%|█████████▋| 56/58 [00:35<00:00,  3.23it/s]
batch:  98%|█████████▊| 57/58 [00:35<00:00,  3.23it/s]
batch: 100%|██████████| 58/58 [00:35<00:00,  1.62it/s]

  0%|          | 0/3656 [00:00<?, ?it/s]
  3%|▎         | 98/3656 [00:00<00:03, 976.95it/s]
  5%|▌         | 199/3656 [00:00<00:03, 995.14it/s]
  8%|▊         | 301/3656 [00:00<00:03, 1001.08it/s]
 11%|█         | 403/3656 [00:00<00:03, 1007.61it/s]
 14%|█▍        | 504/3656 [00:00<00:03, 1005.19it/s]
 17%|█▋        | 605/3656 [00:00<00:03, 997.19it/s] 
 19%|█▉        | 705/3656 [00:00<00:02, 991.73it/s]
 22%|██▏       | 805/3656 [00:00<00:02, 992.02it/s]
 25%|██▍       | 905/3656 [00:00<00:02, 988.20it/s]
 27%|██▋       | 1004/3656 [00:01<00:02, 988.05it/s]
 30%|███       | 1103/3656 [00:01<00:02, 984.30it/s]
 33%|███▎      | 1202/3656 [00:01<00:02, 980.62it/s]
 36%|███▌      | 1301/3656 [00:01<00:02, 974.81it/s]
 38%|███▊      | 1399/3656 [00:01<00:02, 970.61it/s]
 41%|████      | 1497/3656 [00:01<00:02, 964.35it/s]
 44%|████▎     | 1594/3656 [00:01<00:02, 962.76it/s]
 46%|████▋     | 1691/3656 [00:01<00:02, 959.54it/s]
 49%|████▉     | 1787/3656 [00:01<00:01, 954.19it/s]
 52%|█████▏    | 1883/3656 [00:01<00:01, 951.69it/s]
 54%|█████▍    | 1979/3656 [00:02<00:01, 953.76it/s]
 57%|█████▋    | 2075/3656 [00:02<00:01, 945.50it/s]
 59%|█████▉    | 2171/3656 [00:02<00:01, 945.18it/s]
 62%|██████▏   | 2266/3656 [00:02<00:01, 938.82it/s]
 65%|██████▍   | 2360/3656 [00:02<00:01, 928.89it/s]
 67%|██████▋   | 2453/3656 [00:02<00:01, 922.93it/s]
 70%|██████▉   | 2546/3656 [00:02<00:01, 921.10it/s]
 72%|███████▏  | 2639/3656 [00:02<00:01, 922.66it/s]
 75%|███████▍  | 2732/3656 [00:02<00:00, 924.64it/s]
 77%|███████▋  | 2825/3656 [00:02<00:00, 923.31it/s]
 80%|███████▉  | 2918/3656 [00:03<00:00, 920.46it/s]
 82%|████████▏ | 3011/3656 [00:03<00:00, 910.83it/s]
 85%|████████▍ | 3103/3656 [00:03<00:00, 903.41it/s]
 87%|████████▋ | 3194/3656 [00:03<00:00, 897.01it/s]
 90%|████████▉ | 3284/3656 [00:03<00:00, 890.67it/s]
 92%|█████████▏| 3374/3656 [00:03<00:00, 885.18it/s]
 95%|█████████▍| 3463/3656 [00:03<00:00, 886.03it/s]
 97%|█████████▋| 3552/3656 [00:03<00:00, 879.89it/s]
100%|█████████▉| 3640/3656 [00:03<00:00, 877.67it/s]
100%|██████████| 3656/3656 [00:03<00:00, 940.40it/s]

  0%|          | 0/3656 [00:00<?, ?it/s]
  3%|▎         | 100/3656 [00:00<00:03, 979.70it/s]
  6%|▌         | 202/3656 [00:00<00:03, 999.67it/s]
  8%|▊         | 304/3656 [00:00<00:03, 1003.43it/s]
 11%|█         | 406/3656 [00:00<00:03, 1001.48it/s]
 14%|█▍        | 508/3656 [00:00<00:03, 1002.96it/s]
 17%|█▋        | 609/3656 [00:00<00:03, 1002.15it/s]
 19%|█▉        | 710/3656 [00:00<00:02, 996.53it/s] 
 22%|██▏       | 810/3656 [00:00<00:02, 988.86it/s]
 25%|██▍       | 910/3656 [00:00<00:02, 986.06it/s]
 28%|██▊       | 1009/3656 [00:01<00:02, 985.59it/s]
 30%|███       | 1108/3656 [00:01<00:02, 982.22it/s]
 33%|███▎      | 1207/3656 [00:01<00:02, 979.08it/s]
 36%|███▌      | 1305/3656 [00:01<00:02, 971.63it/s]
 38%|███▊      | 1403/3656 [00:01<00:02, 967.99it/s]
 41%|████      | 1500/3656 [00:01<00:02, 965.72it/s]
 44%|████▎     | 1597/3656 [00:01<00:02, 958.25it/s]
 46%|████▋     | 1694/3656 [00:01<00:02, 961.25it/s]
 49%|████▉     | 1791/3656 [00:01<00:01, 958.72it/s]
 52%|█████▏    | 1887/3656 [00:01<00:01, 954.95it/s]
 54%|█████▍    | 1983/3656 [00:02<00:01, 948.53it/s]
 57%|█████▋    | 2079/3656 [00:02<00:01, 947.37it/s]
 60%|█████▉    | 2176/3656 [00:02<00:01, 953.21it/s]
 62%|██████▏   | 2272/3656 [00:02<00:01, 943.65it/s]
 65%|██████▍   | 2367/3656 [00:02<00:01, 939.74it/s]
 67%|██████▋   | 2461/3656 [00:02<00:01, 938.87it/s]
 70%|██████▉   | 2555/3656 [00:02<00:01, 933.87it/s]
 72%|███████▏  | 2649/3656 [00:02<00:01, 933.93it/s]
 75%|███████▌  | 2743/3656 [00:02<00:00, 929.48it/s]
 78%|███████▊  | 2836/3656 [00:02<00:00, 926.54it/s]
 80%|████████  | 2929/3656 [00:03<00:00, 922.58it/s]
 83%|████████▎ | 3022/3656 [00:03<00:00, 912.38it/s]
 85%|████████▌ | 3114/3656 [00:03<00:00, 903.58it/s]
 88%|████████▊ | 3205/3656 [00:03<00:00, 897.73it/s]
 90%|█████████ | 3295/3656 [00:03<00:00, 891.78it/s]
 93%|█████████▎| 3385/3656 [00:03<00:00, 885.92it/s]
 95%|█████████▌| 3474/3656 [00:03<00:00, 886.32it/s]
 97%|█████████▋| 3563/3656 [00:03<00:00, 880.49it/s]
100%|█████████▉| 3652/3656 [00:03<00:00, 879.94it/s]
100%|██████████| 3656/3656 [00:03<00:00, 942.65it/s]
2025-11-17 16:53:58.518024: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:54:10.739427: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-11-17 16:54:10.740333: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2025-11-17 16:54:10.768517: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:8a:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5
coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.75GiB deviceMemoryBandwidth: 573.69GiB/s
2025-11-17 16:54:10.768717: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:54:10.773543: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:54:10.773604: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:54:10.775870: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-11-17 16:54:10.777363: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-11-17 16:54:10.781184: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-11-17 16:54:10.783270: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-11-17 16:54:10.785203: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:54:10.786256: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-11-17 16:54:10.786743: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2025-11-17 16:54:10.789675: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-11-17 16:54:10.790251: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:8a:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5
coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.75GiB deviceMemoryBandwidth: 573.69GiB/s
2025-11-17 16:54:10.790310: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:54:10.790346: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:54:10.790379: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:54:10.790411: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-11-17 16:54:10.790442: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-11-17 16:54:10.790473: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-11-17 16:54:10.790504: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-11-17 16:54:10.790546: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:54:10.791438: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-11-17 16:54:10.791500: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:54:11.263760: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2025-11-17 16:54:11.263857: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2025-11-17 16:54:11.263870: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2025-11-17 16:54:11.265251: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10064 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:8a:00.0, compute capability: 7.5)
2025-11-17 16:54:11.315014: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:196] None of the MLIR optimization passes are enabled (registered 0 passes)
2025-11-17 16:54:11.330931: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2500090000 Hz
2025-11-17 16:54:15.087912: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:54:15.440156: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:54:15.445961: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:54:16.703040: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2025-11-17 16:54:16.773581: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
RuntimeError: module compiled against API version 0xe but this version of numpy is 0xd
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)