Lmod Warning:
-------------------------------------------------------------------------------
The following dependent module(s) are not currently loaded: curl/8.4.0
(required by: htslib/1.16)
-------------------------------------------------------------------------------




The following have been reloaded with a version change:
  1) curl/8.4.0 => curl/8.17.0     2) openssl/3.0.7 => openssl/3.6.0

2025-11-17 16:26:57.408377: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:28:18.925444: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-11-17 16:28:18.942265: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2025-11-17 16:28:18.985625: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:8a:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5
coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.75GiB deviceMemoryBandwidth: 573.69GiB/s
2025-11-17 16:28:18.985759: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:28:19.577936: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:28:19.578095: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:28:19.938500: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-11-17 16:28:20.520316: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-11-17 16:28:21.086387: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-11-17 16:28:21.303789: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-11-17 16:28:21.447343: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:28:21.448636: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-11-17 16:28:21.449272: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2025-11-17 16:28:21.451896: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-11-17 16:28:21.452562: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:8a:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5
coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.75GiB deviceMemoryBandwidth: 573.69GiB/s
2025-11-17 16:28:21.452622: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:28:21.452660: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:28:21.452691: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:28:21.452721: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-11-17 16:28:21.452750: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-11-17 16:28:21.452780: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-11-17 16:28:21.452808: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-11-17 16:28:21.452863: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:28:21.453929: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-11-17 16:28:21.453998: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:28:23.928650: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2025-11-17 16:28:23.928746: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2025-11-17 16:28:23.928761: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2025-11-17 16:28:23.930073: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10064 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:8a:00.0, compute capability: 7.5)
2025-11-17 16:28:50.134202: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2025-11-17 16:28:50.268648: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2500090000 Hz
2025-11-17 16:28:51.668137: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:28:53.305967: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:28:53.313118: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:29:06.515269: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2025-11-17 16:29:06.570850: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'jitters', 'index', 'status', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])
2025-11-17 16:35:36.932967: W tensorflow/python/util/util.cc:348] Sets are not currently considered sequences, but this may change in the future, so consider avoiding using them.
2025-11-17 16:35:41.561415: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:35:50.491055: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-11-17 16:35:50.492117: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2025-11-17 16:35:50.520952: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:8a:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5
coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.75GiB deviceMemoryBandwidth: 573.69GiB/s
2025-11-17 16:35:50.521049: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:35:50.525650: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:35:50.525704: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:35:50.528045: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-11-17 16:35:50.529814: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-11-17 16:35:50.533812: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-11-17 16:35:50.535907: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-11-17 16:35:50.537503: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:35:50.538508: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-11-17 16:35:50.538911: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2025-11-17 16:35:50.541482: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-11-17 16:35:50.542048: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:8a:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5
coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.75GiB deviceMemoryBandwidth: 573.69GiB/s
2025-11-17 16:35:50.542094: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:35:50.542125: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:35:50.542152: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:35:50.542175: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-11-17 16:35:50.542198: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-11-17 16:35:50.542221: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-11-17 16:35:50.542244: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-11-17 16:35:50.542267: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:35:50.543139: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-11-17 16:35:50.543202: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:35:51.007178: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2025-11-17 16:35:51.007272: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2025-11-17 16:35:51.007286: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2025-11-17 16:35:51.008623: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10064 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:8a:00.0, compute capability: 7.5)
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)

batch:   0%|          | 0/52 [00:00<?, ?it/s]2025-11-17 16:35:52.527614: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2025-11-17 16:35:52.528121: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2500090000 Hz
2025-11-17 16:35:52.772021: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:35:53.135101: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:35:53.137221: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:35:54.377649: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2025-11-17 16:35:54.442627: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/functional.py:595: UserWarning: Input dict contained keys ['coordinates', 'true_profiles', 'true_logcounts', 'rev_comp'] which did not match any model input. They will be ignored by the model.
  [n for n in tensors.keys() if n not in ref_input_names])

batch:   2%|▏         | 1/52 [00:17<14:42, 17.31s/it]
batch:   4%|▍         | 2/52 [00:17<06:05,  7.31s/it]
batch:   6%|▌         | 3/52 [00:17<03:21,  4.12s/it]
batch:   8%|▊         | 4/52 [00:18<02:05,  2.62s/it]
batch:  10%|▉         | 5/52 [00:18<01:23,  1.79s/it]
batch:  12%|█▏        | 6/52 [00:18<00:59,  1.28s/it]
batch:  13%|█▎        | 7/52 [00:19<00:43,  1.04it/s]
batch:  15%|█▌        | 8/52 [00:19<00:33,  1.32it/s]
batch:  17%|█▋        | 9/52 [00:19<00:26,  1.61it/s]
batch:  19%|█▉        | 10/52 [00:20<00:22,  1.90it/s]
batch:  21%|██        | 11/52 [00:20<00:18,  2.18it/s]
batch:  23%|██▎       | 12/52 [00:20<00:16,  2.40it/s]
batch:  25%|██▌       | 13/52 [00:21<00:14,  2.60it/s]
batch:  27%|██▋       | 14/52 [00:21<00:13,  2.77it/s]
batch:  29%|██▉       | 15/52 [00:21<00:12,  2.88it/s]
batch:  31%|███       | 16/52 [00:22<00:12,  2.98it/s]
batch:  33%|███▎      | 17/52 [00:22<00:11,  3.03it/s]
batch:  35%|███▍      | 18/52 [00:22<00:11,  3.08it/s]
batch:  37%|███▋      | 19/52 [00:22<00:10,  3.12it/s]
batch:  38%|███▊      | 20/52 [00:23<00:10,  3.15it/s]
batch:  40%|████      | 21/52 [00:23<00:09,  3.16it/s]
batch:  42%|████▏     | 22/52 [00:23<00:09,  3.16it/s]
batch:  44%|████▍     | 23/52 [00:24<00:09,  3.18it/s]
batch:  46%|████▌     | 24/52 [00:24<00:08,  3.19it/s]
batch:  48%|████▊     | 25/52 [00:24<00:08,  3.21it/s]
batch:  50%|█████     | 26/52 [00:25<00:08,  3.21it/s]
batch:  52%|█████▏    | 27/52 [00:25<00:07,  3.23it/s]
batch:  54%|█████▍    | 28/52 [00:25<00:07,  3.24it/s]
batch:  56%|█████▌    | 29/52 [00:26<00:07,  3.24it/s]
batch:  58%|█████▊    | 30/52 [00:26<00:06,  3.23it/s]
batch:  60%|█████▉    | 31/52 [00:26<00:06,  3.23it/s]
batch:  62%|██████▏   | 32/52 [00:26<00:06,  3.21it/s]
batch:  63%|██████▎   | 33/52 [00:27<00:05,  3.19it/s]
batch:  65%|██████▌   | 34/52 [00:27<00:05,  3.20it/s]
batch:  67%|██████▋   | 35/52 [00:27<00:05,  3.21it/s]
batch:  69%|██████▉   | 36/52 [00:28<00:04,  3.20it/s]
batch:  71%|███████   | 37/52 [00:28<00:04,  3.20it/s]
batch:  73%|███████▎  | 38/52 [00:28<00:04,  3.21it/s]
batch:  75%|███████▌  | 39/52 [00:29<00:04,  3.22it/s]
batch:  77%|███████▋  | 40/52 [00:29<00:03,  3.23it/s]
batch:  79%|███████▉  | 41/52 [00:29<00:03,  3.23it/s]
batch:  81%|████████  | 42/52 [00:30<00:03,  3.21it/s]
batch:  83%|████████▎ | 43/52 [00:30<00:02,  3.22it/s]
batch:  85%|████████▍ | 44/52 [00:30<00:02,  3.21it/s]
batch:  87%|████████▋ | 45/52 [00:31<00:02,  3.23it/s]
batch:  88%|████████▊ | 46/52 [00:31<00:01,  3.24it/s]
batch:  90%|█████████ | 47/52 [00:31<00:01,  3.25it/s]
batch:  92%|█████████▏| 48/52 [00:31<00:01,  3.24it/s]
batch:  94%|█████████▍| 49/52 [00:32<00:00,  3.21it/s]
batch:  96%|█████████▌| 50/52 [00:32<00:00,  3.21it/s]
batch:  98%|█████████▊| 51/52 [00:32<00:00,  3.68it/s]
batch: 100%|██████████| 52/52 [00:32<00:00,  1.58it/s]

  0%|          | 0/3229 [00:00<?, ?it/s]
  3%|▎         | 96/3229 [00:00<00:03, 957.59it/s]
  6%|▌         | 197/3229 [00:00<00:03, 976.55it/s]
  9%|▉         | 299/3229 [00:00<00:02, 992.02it/s]
 12%|█▏        | 399/3229 [00:00<00:02, 992.43it/s]
 15%|█▌        | 499/3229 [00:00<00:02, 988.66it/s]
 19%|█▊        | 598/3229 [00:00<00:02, 986.00it/s]
 22%|██▏       | 697/3229 [00:00<00:02, 981.61it/s]
 25%|██▍       | 796/3229 [00:00<00:02, 977.65it/s]
 28%|██▊       | 894/3229 [00:00<00:02, 972.92it/s]
 31%|███       | 992/3229 [00:01<00:02, 968.19it/s]
 34%|███▎      | 1089/3229 [00:01<00:02, 956.69it/s]
 37%|███▋      | 1185/3229 [00:01<00:02, 957.57it/s]
 40%|███▉      | 1281/3229 [00:01<00:02, 955.83it/s]
 43%|████▎     | 1377/3229 [00:01<00:01, 953.31it/s]
 46%|████▌     | 1474/3229 [00:01<00:01, 951.98it/s]
 49%|████▊     | 1570/3229 [00:01<00:01, 951.15it/s]
 52%|█████▏    | 1666/3229 [00:01<00:01, 947.76it/s]
 55%|█████▍    | 1761/3229 [00:01<00:01, 944.11it/s]
 57%|█████▋    | 1856/3229 [00:01<00:01, 942.74it/s]
 60%|██████    | 1951/3229 [00:02<00:01, 936.87it/s]
 63%|██████▎   | 2045/3229 [00:02<00:01, 934.72it/s]
 66%|██████▌   | 2139/3229 [00:02<00:01, 927.37it/s]
 69%|██████▉   | 2232/3229 [00:02<00:01, 926.06it/s]
 72%|███████▏  | 2325/3229 [00:02<00:00, 923.69it/s]
 75%|███████▍  | 2418/3229 [00:02<00:00, 923.48it/s]
 78%|███████▊  | 2511/3229 [00:02<00:00, 918.07it/s]
 81%|████████  | 2603/3229 [00:02<00:00, 904.94it/s]
 83%|████████▎ | 2694/3229 [00:02<00:00, 901.49it/s]
 86%|████████▌ | 2785/3229 [00:02<00:00, 886.95it/s]
 89%|████████▉ | 2874/3229 [00:03<00:00, 886.96it/s]
 92%|█████████▏| 2963/3229 [00:03<00:00, 882.53it/s]
 95%|█████████▍| 3052/3229 [00:03<00:00, 871.88it/s]
 97%|█████████▋| 3140/3229 [00:03<00:00, 873.81it/s]
100%|█████████▉| 3228/3229 [00:03<00:00, 872.64it/s]
100%|██████████| 3229/3229 [00:03<00:00, 931.39it/s]

  0%|          | 0/3229 [00:00<?, ?it/s]
  3%|▎         | 99/3229 [00:00<00:03, 970.92it/s]
  6%|▌         | 200/3229 [00:00<00:03, 990.32it/s]
  9%|▉         | 302/3229 [00:00<00:02, 998.27it/s]
 12%|█▏        | 402/3229 [00:00<00:02, 997.45it/s]
 16%|█▌        | 502/3229 [00:00<00:02, 998.25it/s]
 19%|█▊        | 602/3229 [00:00<00:02, 992.43it/s]
 22%|██▏       | 702/3229 [00:00<00:02, 965.94it/s]
 25%|██▍       | 799/3229 [00:00<00:02, 966.06it/s]
 28%|██▊       | 898/3229 [00:00<00:02, 968.07it/s]
 31%|███       | 996/3229 [00:01<00:02, 969.44it/s]
 34%|███▍      | 1093/3229 [00:01<00:02, 955.00it/s]
 37%|███▋      | 1189/3229 [00:01<00:02, 956.45it/s]
 40%|███▉      | 1285/3229 [00:01<00:02, 957.26it/s]
 43%|████▎     | 1381/3229 [00:01<00:01, 957.42it/s]
 46%|████▌     | 1477/3229 [00:01<00:01, 954.45it/s]
 49%|████▊     | 1573/3229 [00:01<00:01, 953.91it/s]
 52%|█████▏    | 1669/3229 [00:01<00:01, 946.81it/s]
 55%|█████▍    | 1764/3229 [00:01<00:01, 944.86it/s]
 58%|█████▊    | 1859/3229 [00:01<00:01, 944.45it/s]
 61%|██████    | 1954/3229 [00:02<00:01, 943.86it/s]
 63%|██████▎   | 2049/3229 [00:02<00:01, 927.49it/s]
 66%|██████▋   | 2142/3229 [00:02<00:01, 925.57it/s]
 69%|██████▉   | 2237/3229 [00:02<00:01, 926.79it/s]
 72%|███████▏  | 2330/3229 [00:02<00:00, 924.91it/s]
 75%|███████▌  | 2423/3229 [00:02<00:00, 924.93it/s]
 78%|███████▊  | 2516/3229 [00:02<00:00, 920.94it/s]
 81%|████████  | 2609/3229 [00:02<00:00, 911.44it/s]
 84%|████████▎ | 2701/3229 [00:02<00:00, 900.47it/s]
 86%|████████▋ | 2792/3229 [00:02<00:00, 895.36it/s]
 89%|████████▉ | 2882/3229 [00:03<00:00, 890.41it/s]
 92%|█████████▏| 2972/3229 [00:03<00:00, 886.52it/s]
 95%|█████████▍| 3061/3229 [00:03<00:00, 886.82it/s]
 98%|█████████▊| 3150/3229 [00:03<00:00, 880.08it/s]
100%|██████████| 3229/3229 [00:03<00:00, 933.88it/s]
2025-11-17 16:36:48.844595: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:36:59.336272: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-11-17 16:36:59.337214: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2025-11-17 16:36:59.370027: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:8a:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5
coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.75GiB deviceMemoryBandwidth: 573.69GiB/s
2025-11-17 16:36:59.370143: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:36:59.377646: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:36:59.377705: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:36:59.381333: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-11-17 16:36:59.384280: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-11-17 16:36:59.390631: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-11-17 16:36:59.394648: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-11-17 16:36:59.397391: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:36:59.398691: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-11-17 16:36:59.399253: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2025-11-17 16:36:59.402171: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2025-11-17 16:36:59.402750: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:8a:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5
coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.75GiB deviceMemoryBandwidth: 573.69GiB/s
2025-11-17 16:36:59.402810: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:36:59.402846: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:36:59.402900: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:36:59.402933: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2025-11-17 16:36:59.402964: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2025-11-17 16:36:59.402995: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2025-11-17 16:36:59.403026: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2025-11-17 16:36:59.403057: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:36:59.403963: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2025-11-17 16:36:59.404026: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2025-11-17 16:36:59.870969: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2025-11-17 16:36:59.871062: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2025-11-17 16:36:59.871075: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2025-11-17 16:36:59.872449: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10064 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:8a:00.0, compute capability: 7.5)
2025-11-17 16:36:59.921442: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:196] None of the MLIR optimization passes are enabled (registered 0 passes)
2025-11-17 16:36:59.938630: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2500090000 Hz
2025-11-17 16:37:03.217135: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2025-11-17 16:37:03.570790: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2025-11-17 16:37:03.576310: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2025-11-17 16:37:04.828604: W tensorflow/stream_executor/gpu/asm_compiler.cc:63] Running ptxas --version returned 256
2025-11-17 16:37:04.894534: W tensorflow/stream_executor/gpu/redzone_allocator.cc:314] Internal: ptxas exited with non-zero error code 256, output: 
Relying on driver to perform ptx compilation. 
Modify $PATH to customize ptxas location.
This message will be only logged once.
RuntimeError: module compiled against API version 0xe but this version of numpy is 0xd
/home/users/shouvikm/miniconda3/envs/bpnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/core.py:1059: UserWarning: bpnet.model.arch is not loaded, but a Lambda layer uses it. It may cause errors.
  , UserWarning)