added checkpoint

cms/v2.4.1/pyg-cms_20250510_121014_108409/README.md

@@ -0,0 +1,121 @@
+# Model Card for mlpf-cms-v2.4.0
+
+This model reconstructs particles in a detector, based on the tracks and calorimeter clusters recorded by the detector.
+The primary difference with respect to v2.4.0 is that the model is fine-tuned on ~40k ttbar+PU events generated with a more recent `CMSSW_15_0_5`
+
+## Model Details
+
+The performance is measured with respect to generator-level jets and MET computed from Pythia particles, i.e. the truth-level jets and MET.
+
+### Model Description
+
+- **Developed by:** CMS MLPF Team 
+- **Model type:** transformer
+- **License:** Apache License
+
+### Model Sources
+
+- **Repository:** https://github.com/jpata/particleflow
+
+## Uses
+### Direct Use
+
+This model may be used to study the physics and computational performance on ML-based reconstruction in simulation within the CMS collaboration.
+
+### Out-of-Scope Use
+
+This model is not intended for physics measurements on real data or for use outside the CMS collaboration.
+
+## Bias, Risks, and Limitations
+
+The model has only been trained on simulation data and has not been validated against real data.
+The model has not been peer reviewed or published in a peer-reviewed journal.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+```
+#get the code
+git clone https://github.com/jpata/particleflow
+cd particleflow
+git checkout 88c458
+
+#get the models
+git clone https://huggingface.co/jpata/particleflow models
+```
+
+## Training Details
+Trained on 1x A100 for 5 epochs for ~1 day.
+
+### Training Data
+The following datasets were used, corresponding to 2.6.0 but with less statistics:
+```
+5.9G    /scratch/persistent/joosep/tensorflow_datasets/cms_pf_ttbar/1
+5.9G    /scratch/persistent/joosep/tensorflow_datasets/cms_pf_ttbar/2
+5.9G    /scratch/persistent/joosep/tensorflow_datasets/cms_pf_ttbar/3
+5.9G    /scratch/persistent/joosep/tensorflow_datasets/cms_pf_ttbar/4
+5.9G    /scratch/persistent/joosep/tensorflow_datasets/cms_pf_ttbar/5
+5.9G    /scratch/persistent/joosep/tensorflow_datasets/cms_pf_ttbar/6
+5.9G    /scratch/persistent/joosep/tensorflow_datasets/cms_pf_ttbar/7
+5.9G    /scratch/persistent/joosep/tensorflow_datasets/cms_pf_ttbar/8
+5.9G    /scratch/persistent/joosep/tensorflow_datasets/cms_pf_ttbar/9
+6.1G    /scratch/persistent/joosep/tensorflow_datasets/cms_pf_ttbar/10
+```
+
+## Training Procedure 
+
+```bash
+#!/bin/bash
+#SBATCH --partition gpu
+#SBATCH --gres gpu:a100:1
+#SBATCH --mem-per-gpu 300G
+#SBATCH -o logs/slurm-%x-%j-%N.out
+
+IMG=/home/software/singularity/pytorch.simg:2024-12-03
+cd ~/particleflow
+
+ulimit -n 100000
+singularity exec -B /scratch/persistent --nv \
+    --env PYTHONPATH=`pwd` \
+    --env KERAS_BACKEND=torch \
+    $IMG python3 mlpf/pipeline.py --gpus 1 \
+    --data-dir /scratch/persistent/joosep/tensorflow_datasets --config parameters/pytorch/pyg-cms.yaml \
+    --train --conv-type attention \
+    --gpu-batch-multiplier 5 --checkpoint-freq 1 --num-workers 8 --prefetch-factor 50 --comet --ntest 1000 --test-datasets cms_pf_ttbar --load experiments/pyg-cms_20250410_144744_012331/checkpoints/checkpoint-10-3.539432.pth
+```
+
+## Evaluation
+```bash
+#!/bin/bash
+#SBATCH --partition gpu
+#SBATCH --gres gpu:mig:1
+#SBATCH --mem-per-gpu 100G
+#SBATCH -o logs/slurm-%x-%j-%N.out
+
+IMG=/home/software/singularity/pytorch.simg:2024-12-03
+cd ~/particleflow
+
+WEIGHTS=experiments/pyg-cms_20250510_121014_108409/checkpoints/checkpoint-20-3.352647.pth
+EXPDIR=experiments/pyg-cms_20250510_121014_108409/
+DATASET=cms_pf_ttbar
+env
+singularity exec -B /local -B /scratch/persistent --nv \
+     --env PYTHONPATH=`pwd` \
+     --env KERAS_BACKEND=torch \
+     $IMG python mlpf/pipeline.py --gpus 1 \
+     --data-dir /scratch/persistent/joosep/tensorflow_datasets --config parameters/pytorch/pyg-cms.yaml \
+     --test --make-plots --gpu-batch-multiplier 2 --load $WEIGHTS --ntest 10000 --dtype bfloat16 --num-workers 1 --prefetch-factor 10 --test-datasets $DATASET --experiment-dir $EXPDIR
+```
+## Citation
+
+## Glossary
+
+- PF: particle flow reconstruction
+- MLPF: machine learning for particle flow
+- CMS: Compact Muon Solenoid
+
+## Model Card Contact
+
+Joosep Pata, [email protected]
+

cms/v2.4.1/pyg-cms_20250510_121014_108409/checkpoints/checkpoint-20-3.352647.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:45d5f03f35a4e633e146ef1b756bf4dc51549ca7ab5424c76e56d24cc0f2ba6d
+size 61985990

cms/v2.4.1/pyg-cms_20250510_121014_108409/checkpoints/mlpf_5M_attn2x3x256_bm5_relu_checkpoint20_pudisc_1xa100_fp32_fused_20250510.onnx

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c20909c7af6d1ef67cabb5fefa592330b8980a6cee9d7eca0c2b2cfc973555c8
+size 20620703

cms/v2.4.1/pyg-cms_20250510_121014_108409/history/epoch_11.json

@@ -0,0 +1 @@
+{"train": {"Regression_pt": 0.22371547649902673, "Regression_eta": 0.001362744294555912, "Regression_sin_phi": 0.0005860466204871175, "Regression_cos_phi": 0.000586519325271844, "Regression_energy": 0.26906227519888287, "Classification_binary": 2.7051093326844957, "Classification": 0.05155682625121657, "ispu": 0.1441323602530467, "MET": 27.813445751523357, "Sliced_Wasserstein_Loss": 216.94416046039268, "Total": 3.3961207261340554}, "valid": {"Regression_pt": 0.22334537040896532, "Regression_eta": 0.0013604601708854117, "Regression_sin_phi": 0.0005864681994042746, "Regression_cos_phi": 0.0005858668103450682, "Regression_energy": 0.2686971524866616, "Classification_binary": 2.7010551638719513, "Classification": 0.05153967229331412, "ispu": 0.1383209228515625, "MET": 27.700443025914634, "Sliced_Wasserstein_Loss": 216.2302782012195, "Total": 3.385498642339939}, "epoch_train_time": 3711.8426790237427, "epoch_valid_time": 169.85347294807434, "epoch_total_time": 3881.6961526870728}

cms/v2.4.1/pyg-cms_20250510_121014_108409/history/epoch_12.json

@@ -0,0 +1 @@
+{"train": {"Regression_pt": 0.2232037233676794, "Regression_eta": 0.001361596786096117, "Regression_sin_phi": 0.0005857050539919389, "Regression_cos_phi": 0.0005861522542841142, "Regression_energy": 0.2685629853059411, "Classification_binary": 2.6988236289776575, "Classification": 0.051505398863299766, "ispu": 0.13732385344818465, "MET": 27.681647765741367, "Sliced_Wasserstein_Loss": 216.63469871360866, "Total": 3.381932866452268}, "valid": {"Regression_pt": 0.22292231117806782, "Regression_eta": 0.0013592398748165223, "Regression_sin_phi": 0.000586121075037049, "Regression_cos_phi": 0.0005854383111000061, "Regression_energy": 0.2685687739674638, "Classification_binary": 2.6981808546112807, "Classification": 0.051506600728849085, "ispu": 0.1354562247671732, "MET": 27.555192454268294, "Sliced_Wasserstein_Loss": 216.50306783536584, "Total": 3.3791646817835366}, "epoch_train_time": 3768.726182937622, "epoch_valid_time": 175.5684609413147, "epoch_total_time": 3944.2946486473083}

cms/v2.4.1/pyg-cms_20250510_121014_108409/history/epoch_13.json

@@ -0,0 +1 @@
+{"train": {"Regression_pt": 0.2228153133198629, "Regression_eta": 0.00136069489558484, "Regression_sin_phi": 0.0005854217281354466, "Regression_cos_phi": 0.0005858687992909508, "Regression_energy": 0.26819341888117804, "Classification_binary": 2.693576770903859, "Classification": 0.051471492738923916, "ispu": 0.13561076149394888, "MET": 27.46982481381178, "Sliced_Wasserstein_Loss": 216.38862559241707, "Total": 3.374194683056872}, "valid": {"Regression_pt": 0.222694545838891, "Regression_eta": 0.0013591238638249838, "Regression_sin_phi": 0.0005860504580707085, "Regression_cos_phi": 0.0005854118524528131, "Regression_energy": 0.26817807453434644, "Classification_binary": 2.6950850323932927, "Classification": 0.05148238670535204, "ispu": 0.13411354437106993, "MET": 27.249699885670733, "Sliced_Wasserstein_Loss": 216.14287347560975, "Total": 3.3740808998666156}, "epoch_train_time": 3774.5764842033386, "epoch_valid_time": 174.27281308174133, "epoch_total_time": 3948.8493015766144}

cms/v2.4.1/pyg-cms_20250510_121014_108409/history/epoch_14.json

@@ -0,0 +1 @@
+{"train": {"Regression_pt": 0.22246857412618484, "Regression_eta": 0.0013599790910166828, "Regression_sin_phi": 0.0005851897986740701, "Regression_cos_phi": 0.0005856087180352647, "Regression_energy": 0.2678574569175271, "Classification_binary": 2.688777663761002, "Classification": 0.05144417775024331, "ispu": 0.13443988652833022, "MET": 27.306601218686527, "Sliced_Wasserstein_Loss": 216.0994922139472, "Total": 3.3675035439234935}, "valid": {"Regression_pt": 0.22243775158393675, "Regression_eta": 0.0013583120776385796, "Regression_sin_phi": 0.0005857554514233659, "Regression_cos_phi": 0.0005851355994619974, "Regression_energy": 0.2677400356385766, "Classification_binary": 2.689856552496189, "Classification": 0.05145591177591463, "ispu": 0.13320167355421114, "MET": 27.443183117378048, "Sliced_Wasserstein_Loss": 216.94420731707316, "Total": 3.367222930163872}, "epoch_train_time": 3734.8194119930267, "epoch_valid_time": 173.33541750907898, "epoch_total_time": 3908.1548347473145}

cms/v2.4.1/pyg-cms_20250510_121014_108409/history/epoch_15.json

@@ -0,0 +1 @@
+{"train": {"Regression_pt": 0.2221559187489421, "Regression_eta": 0.0013593278547840983, "Regression_sin_phi": 0.0005849548990692572, "Regression_cos_phi": 0.0005854086207633254, "Regression_energy": 0.26755300016926203, "Classification_binary": 2.6843379739336495, "Classification": 0.05141973476112898, "ispu": 0.13353669018703454, "MET": 27.179658937034528, "Sliced_Wasserstein_Loss": 215.95280974949222, "Total": 3.3615367933310765}, "valid": {"Regression_pt": 0.22233183325790778, "Regression_eta": 0.001357695096876563, "Regression_sin_phi": 0.0005855791452454357, "Regression_cos_phi": 0.0005849431927611188, "Regression_energy": 0.26788510578434643, "Classification_binary": 2.6862185594512193, "Classification": 0.051439350407298016, "ispu": 0.13303980013219321, "MET": 26.994745617378047, "Sliced_Wasserstein_Loss": 215.43584222560975, "Total": 3.3634458960556404}, "epoch_train_time": 3734.6557698249817, "epoch_valid_time": 170.86180424690247, "epoch_total_time": 3905.517580509186}

cms/v2.4.1/pyg-cms_20250510_121014_108409/history/epoch_16.json

@@ -0,0 +1 @@
+{"train": {"Regression_pt": 0.22188564499407584, "Regression_eta": 0.0013588382976637875, "Regression_sin_phi": 0.0005847883127634801, "Regression_cos_phi": 0.0005852363524440179, "Regression_energy": 0.26729682607269806, "Classification_binary": 2.6803883505416386, "Classification": 0.05139942827786476, "ispu": 0.13279940037607904, "MET": 27.090991029113066, "Sliced_Wasserstein_Loss": 215.78710223425864, "Total": 3.356299720717671}, "valid": {"Regression_pt": 0.22212109449433118, "Regression_eta": 0.0013575087233287531, "Regression_sin_phi": 0.0005854883935393357, "Regression_cos_phi": 0.0005848749381739919, "Regression_energy": 0.2675445556640625, "Classification_binary": 2.684670350609756, "Classification": 0.05141710886141149, "ispu": 0.1346156794850419, "MET": 27.275485899390244, "Sliced_Wasserstein_Loss": 214.5648056402439, "Total": 3.362892411394817}, "epoch_train_time": 3710.088007211685, "epoch_valid_time": 171.8539843559265, "epoch_total_time": 3881.941995859146}

cms/v2.4.1/pyg-cms_20250510_121014_108409/history/epoch_17.json

@@ -0,0 +1 @@
+{"train": {"Regression_pt": 0.2216434713788507, "Regression_eta": 0.0013583979416151829, "Regression_sin_phi": 0.0005846514278920663, "Regression_cos_phi": 0.0005850741567850598, "Regression_energy": 0.26706058654578535, "Classification_binary": 2.677069492637102, "Classification": 0.0513802086088249, "ispu": 0.13230953229466402, "MET": 26.955016503046718, "Sliced_Wasserstein_Loss": 215.62403520649966, "Total": 3.3520115732904534}, "valid": {"Regression_pt": 0.22200976115901297, "Regression_eta": 0.0013569070071708866, "Regression_sin_phi": 0.0005853062722741103, "Regression_cos_phi": 0.0005846876923630877, "Regression_energy": 0.2674354925388243, "Classification_binary": 2.681381002286585, "Classification": 0.05140756281410776, "ispu": 0.13232198575647866, "MET": 27.195841272865852, "Sliced_Wasserstein_Loss": 214.25969893292682, "Total": 3.357078887195122}, "epoch_train_time": 3612.2064142227173, "epoch_valid_time": 169.3780815601349, "epoch_total_time": 3781.5844988822937}

cms/v2.4.1/pyg-cms_20250510_121014_108409/history/epoch_18.json

@@ -0,0 +1 @@
+{"train": {"Regression_pt": 0.22143695188198206, "Regression_eta": 0.0013580761330306893, "Regression_sin_phi": 0.0005845230014726126, "Regression_cos_phi": 0.0005849656819812978, "Regression_energy": 0.26685886060214964, "Classification_binary": 2.6744171039268787, "Classification": 0.051366162671377794, "ispu": 0.1318459130495726, "MET": 26.85781567366283, "Sliced_Wasserstein_Loss": 215.4932125930941, "Total": 3.3484449052132703}, "valid": {"Regression_pt": 0.2219132027974943, "Regression_eta": 0.0013568520545959473, "Regression_sin_phi": 0.0005852861375343508, "Regression_cos_phi": 0.0005846478953594115, "Regression_energy": 0.2673022572587176, "Classification_binary": 2.6800504358803354, "Classification": 0.05140126856361948, "ispu": 0.13216478301257623, "MET": 26.82896103277439, "Sliced_Wasserstein_Loss": 214.83126905487805, "Total": 3.355360077648628}, "epoch_train_time": 3599.985470056534, "epoch_valid_time": 168.18090534210205, "epoch_total_time": 3768.166383743286}

cms/v2.4.1/pyg-cms_20250510_121014_108409/history/epoch_19.json

@@ -0,0 +1 @@
+{"train": {"Regression_pt": 0.22128188869964455, "Regression_eta": 0.0013578458823460377, "Regression_sin_phi": 0.0005844378358379924, "Regression_cos_phi": 0.0005848593379326099, "Regression_energy": 0.26671143404599695, "Classification_binary": 2.67226985655044, "Classification": 0.051355637516132785, "ispu": 0.13152996003829553, "MET": 26.794879823967502, "Sliced_Wasserstein_Loss": 215.42955314827353, "Total": 3.345685405382532}, "valid": {"Regression_pt": 0.22184829711914061, "Regression_eta": 0.0013568389706495332, "Regression_sin_phi": 0.0005852244612647266, "Regression_cos_phi": 0.000584604354893289, "Regression_energy": 0.2672228743390339, "Classification_binary": 2.6786769959984755, "Classification": 0.051393243743152156, "ispu": 0.13134647462426163, "MET": 27.152231802591462, "Sliced_Wasserstein_Loss": 215.02884908536586, "Total": 3.3530175185785063}, "epoch_train_time": 3607.8799850940704, "epoch_valid_time": 169.6019389629364, "epoch_total_time": 3777.481926679611}

cms/v2.4.1/pyg-cms_20250510_121014_108409/history/epoch_20.json

@@ -0,0 +1 @@
+{"train": {"Regression_pt": 0.2211735048080992, "Regression_eta": 0.0013576297075585408, "Regression_sin_phi": 0.0005843729446607421, "Regression_cos_phi": 0.0005847947050287018, "Regression_energy": 0.2666056618144888, "Classification_binary": 2.6709800270819226, "Classification": 0.051349426558797394, "ispu": 0.13132475463619245, "MET": 26.746087931618145, "Sliced_Wasserstein_Loss": 215.3008124576845, "Total": 3.3439549657244414}, "valid": {"Regression_pt": 0.2218103734458365, "Regression_eta": 0.0013566415484358625, "Regression_sin_phi": 0.0005851280761928093, "Regression_cos_phi": 0.0005845176737482954, "Regression_energy": 0.2673031504561261, "Classification_binary": 2.677985065739329, "Classification": 0.05139267153856231, "ispu": 0.13162977637314216, "MET": 26.674580792682928, "Sliced_Wasserstein_Loss": 215.54580792682927, "Total": 3.3526474371189026}, "epoch_train_time": 3677.243456363678, "epoch_valid_time": 173.51898455619812, "epoch_total_time": 3850.762444496155}

cms/v2.4.1/pyg-cms_20250510_121014_108409/hyperparameters.json

@@ -0,0 +1 @@
+{"num_mlpf_params": 5133603, "train": true, "test": null, "make_plots": null, "comet": true, "save_attention": false, "dataset": "cms", "sort_data": true, "data_dir": "/scratch/persistent/joosep/tensorflow_datasets", "gpus": 1, "gpu_batch_multiplier": 5, "load": "experiments/pyg-cms_20250410_144744_012331/checkpoints/checkpoint-10-3.539432.pth", "finetune": null, "num_epochs": 20, "patience": 20, "lr": 0.0001, "lr_schedule": "cosinedecay", "conv_type": "attention", "ntrain": null, "ntest": 1000, "nvalid": null, "num_workers": 8, "prefetch_factor": 50, "checkpoint_freq": 1, "comet_name": "particleflow-pt", "comet_offline": false, "comet_step_freq": 10, "dtype": "bfloat16", "val_freq": null, "model": {"trainable": "all", "learned_representation_mode": "last", "input_encoding": "split", "pt_mode": "direct-elemtype-split", "eta_mode": "linear", "sin_phi_mode": "linear", "cos_phi_mode": "linear", "energy_mode": "direct-elemtype-split", "gnn_lsh": {"conv_type": "gnn_lsh", "embedding_dim": 512, "width": 512, "num_convs": 8, "dropout_ff": 0.0, "activation": "elu", "bin_size": 320, "max_num_bins": 200, "distance_dim": 128, "layernorm": true, "num_node_messages": 2, "ffn_dist_hidden_dim": 128, "ffn_dist_num_layers": 2}, "attention": {"conv_type": "attention", "num_convs": 3, "dropout_ff": 0.0, "dropout_conv_id_mha": 0.0, "dropout_conv_id_ff": 0.0, "dropout_conv_reg_mha": 0.0, "dropout_conv_reg_ff": 0.0, "activation": "relu", "head_dim": 16, "num_heads": 16, "attention_type": "flash", "use_pre_layernorm": true}, "mamba": {"conv_type": "mamba", "embedding_dim": 1024, "width": 1024, "num_convs": 4, "dropout_ff": 0.0, "activation": "elu", "d_state": 32, "d_conv": 4, "expand": 2}}, "lr_schedule_config": {"onecycle": {"pct_start": 0.3}}, "raytune": {"local_dir": null, "sched": "asha", "search_alg": "hyperopt", "default_metric": "val_loss", "default_mode": "min", "asha": {"max_t": 200, "reduction_factor": 4, "brackets": 1, "grace_period": 10}, "hyperband": {"max_t": 200, "reduction_factor": 4}, "hyperopt": {"n_random_steps": 10}, "nevergrad": {"n_random_steps": 10}}, "train_dataset": {"cms": {"physical_pu": {"batch_size": 1, "samples": {"cms_pf_ttbar": {"version": "2.6.0", "splits": [1, 2, 3, 4, 5, 6, 7, 8, 9, 10]}}}}}, "valid_dataset": {"cms": {"physical_pu": {"batch_size": 1, "samples": {"cms_pf_ttbar": {"version": "2.6.0", "splits": [1, 2, 3, 4, 5, 6, 7, 8, 9, 10]}}}}}, "test_dataset": {"cms_pf_ttbar": {"version": "2.6.0", "splits": [1, 2, 3, 4, 5, 6, 7, 8, 9, 10]}}, "enabled_test_datasets": ["cms_pf_ttbar"], "start_epoch": null}

cms/v2.4.1/pyg-cms_20250510_121014_108409/model_kwargs.pkl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6e67fcae0627f6e53393e8e0fa2949bc8a5b1c1c58dfe79969dffa548562f600
+size 565

cms/v2.4.1/pyg-cms_20250510_121014_108409/overridden_config.yaml

@@ -0,0 +1,148 @@
+checkpoint_freq: 1
+comet: true
+comet_name: particleflow-pt
+comet_offline: false
+comet_step_freq: 10
+conv_type: attention
+data_dir: /scratch/persistent/joosep/tensorflow_datasets
+dataset: cms
+dtype: bfloat16
+enabled_test_datasets:
+- cms_pf_ttbar
+finetune: null
+gpu_batch_multiplier: 5
+gpus: 1
+load: experiments/pyg-cms_20250410_144744_012331/checkpoints/checkpoint-10-3.539432.pth
+lr: 0.0001
+lr_schedule: cosinedecay
+lr_schedule_config:
+  onecycle:
+    pct_start: 0.3
+make_plots: null
+model:
+  attention:
+    activation: relu
+    attention_type: flash
+    conv_type: attention
+    dropout_conv_id_ff: 0.0
+    dropout_conv_id_mha: 0.0
+    dropout_conv_reg_ff: 0.0
+    dropout_conv_reg_mha: 0.0
+    dropout_ff: 0.0
+    head_dim: 16
+    num_convs: 3
+    num_heads: 16
+    use_pre_layernorm: true
+  cos_phi_mode: linear
+  energy_mode: direct-elemtype-split
+  eta_mode: linear
+  gnn_lsh:
+    activation: elu
+    bin_size: 320
+    conv_type: gnn_lsh
+    distance_dim: 128
+    dropout_ff: 0.0
+    embedding_dim: 512
+    ffn_dist_hidden_dim: 128
+    ffn_dist_num_layers: 2
+    layernorm: true
+    max_num_bins: 200
+    num_convs: 8
+    num_node_messages: 2
+    width: 512
+  input_encoding: split
+  learned_representation_mode: last
+  mamba:
+    activation: elu
+    conv_type: mamba
+    d_conv: 4
+    d_state: 32
+    dropout_ff: 0.0
+    embedding_dim: 1024
+    expand: 2
+    num_convs: 4
+    width: 1024
+  pt_mode: direct-elemtype-split
+  sin_phi_mode: linear
+  trainable: all
+ntest: 1000
+ntrain: null
+num_epochs: 20
+num_workers: 8
+nvalid: null
+patience: 20
+prefetch_factor: 50
+raytune:
+  asha:
+    brackets: 1
+    grace_period: 10
+    max_t: 200
+    reduction_factor: 4
+  default_metric: val_loss
+  default_mode: min
+  hyperband:
+    max_t: 200
+    reduction_factor: 4
+  hyperopt:
+    n_random_steps: 10
+  local_dir: null
+  nevergrad:
+    n_random_steps: 10
+  sched: asha
+  search_alg: hyperopt
+save_attention: false
+sort_data: true
+start_epoch: null
+test: null
+test_dataset:
+  cms_pf_ttbar:
+    splits:
+    - 1
+    - 2
+    - 3
+    - 4
+    - 5
+    - 6
+    - 7
+    - 8
+    - 9
+    - 10
+    version: 2.6.0
+train: true
+train_dataset:
+  cms:
+    physical_pu:
+      batch_size: 1
+      samples:
+        cms_pf_ttbar:
+          splits:
+          - 1
+          - 2
+          - 3
+          - 4
+          - 5
+          - 6
+          - 7
+          - 8
+          - 9
+          - 10
+          version: 2.6.0
+val_freq: null
+valid_dataset:
+  cms:
+    physical_pu:
+      batch_size: 1
+      samples:
+        cms_pf_ttbar:
+          splits:
+          - 1
+          - 2
+          - 3
+          - 4
+          - 5
+          - 6
+          - 7
+          - 8
+          - 9
+          - 10
+          version: 2.6.0

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_0.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c7821c2145136f297cfc178239936c21e4c408c0043babd8499848638b7e1c1e
+size 1760766

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_100.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:47ae2db6668e44576d8115a165b19b92a2af6076658be747339deb4ba59db13c
+size 1884514

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1000.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ad56408fbee22605fc217320a61ee7fb833de29a9255c3db5fa8d33d9242b166
+size 1680764

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1001.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cd44fbbdeba2d25cdf49927839a1a9c8c17901dd8a9639c0f74f9bb80cddf23e
+size 1818924

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1002.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e004dda0471400ffd8599cfa9347d25f853e7492e172cea3024236859dba01a2
+size 1610615

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1003.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f0973aa6d77d76aa3cad23a1610774e07cce791b307c2b714db927c278d7b8e6
+size 1873110

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1004.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b859e68a951d0c9174410b02026de6778a33ba6e4d471467469ca9ad61bebcb
+size 2171764

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1005.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0af94ddcd96637647c51eeccbec91e8f7d65266617a5984088f2d37292bed2da
+size 2109933

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1006.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b6e54306ba7c91b9943908a12fe024b17aa88f996b2ef641567467c8a62aabe6
+size 2020841

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1007.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:98f1e770e000aabcad15f848c139f5d100b7e385cee6911b247519909111831a
+size 2041210

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1008.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b23c9d34444b4a99c8cff718fa44e4f57f1e36d26f901796f109d6c2b490d951
+size 1973191

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1009.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:670686e3884b782a464e2bf711d3e5eb8c1e41aaccf01ea618e432e0de495e37
+size 1830108

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_101.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c186ee9eaac9f02a637a84cd554b40e0c992c078a2317b256bf7ba217f4db67a
+size 1629827

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1010.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c73595424dcfff8bed8d6871c3a5745c84ea386f7906602a976abccb8dcd7767
+size 1691240

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1011.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:93acda067048422894438e51e514b2c88aef0dd55f4c1765a0e737d24cfcce81
+size 1808309

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1012.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5db4e3bbbb0e36790d06df0ff0fcda36f4b50ec916cc1ae51ad67464159915aa
+size 1971353

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1013.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:738c9ce2485c75396f623250d2aa4d2013e075c05f52fe74f4aa0152f9c9c6be
+size 2221723

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1014.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d765823bd7a0dd828ddd145fc5ca61c518485fc667ff202f5533b757117e50b5
+size 1753568

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1015.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:33fd9b0f2b4234374901431a0ec0ee06730da47bb941f4be0721219321fafa73
+size 1666584

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1016.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9fcaf0c29fbb30e2f1dff440f8994f1a48bc7cd9b1e957bd6a63986ce04e57a3
+size 1613373

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1017.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5c92184c34dbe3cbeca13cc82f27670da71b5d723369358d7a992aeec36b772e
+size 1647688

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1018.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:908e47676e4383549fcaf23aa9472f1dd372d2112fcce1432d014f85026fe326
+size 1634957

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1019.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d8c4c69a56c42adea1a3b4950859219d2f7bf92a607afec9aea69ad2a5e96e6e
+size 2150641

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_102.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8b023148c870c11b47c8ce189f8b1b322b919a5dd3042e6a604ea2cb1a382c85
+size 1481199

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1020.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9f3f264307e9910c500c14870f7112386934405d232d75b9931bb3369514989a
+size 1899685

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1021.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ed4c0745218de900eeefd5263eae713c5d73d89fe7bcbcbc069578b1f45934f7
+size 2156768

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1022.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dd6d78a0ef2bca6d66685680d432fd48f3df46c321caf345ce6f28782146342c
+size 2052799

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1023.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2ef8f977a55cc8c0db580f18fc61c3f7d08eba49acd9799b72726c09e089ff6b
+size 1856046

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1024.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ef893ebdde3327a887beed870ffb4634e47303e22f651efd47432ee5a922d984
+size 2042666

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1025.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d20d1dea3030b306f24e45b3f7d265de2614abbe669fde7e13a349f910877e30
+size 2013720

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1026.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:72ca17985c827d6d07fd498a074e1a510ed3959b0b8fa662dbc9f9735fc09492
+size 1834980

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1027.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e460f84a5a6e505ee6e46cc69929a154af296133e5fe9f853de4a0239e874bd
+size 1633770

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1028.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:766c0ec8b91393393529fc9a774cfca02732da385bbb03c424764353808538cc
+size 2000414

cms/v2.4.1/pyg-cms_20250510_121014_108409/preds_checkpoint-20-3.352647/cms_pf_ttbar/pred_0_1029.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5f95f517150ad57f5f095c00932cd79bbd21b98c2cbe95ac5c2fc2ef92f2b2f7
+size 1846171