File size: 23,403 Bytes
92cd212 e6971fb 92cd212 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 |
[2025-03-16 18:00:19,576][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,577][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,577][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,577][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,578][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,578][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,578][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,578][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,578][__main__][INFO] -
Initializing training for seed 42
[2025-03-16 18:00:19,584][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,584][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,584][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,584][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,585][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,585][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,585][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,585][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:32,402][robosuite_logs][WARNING] - No private macro file found!
[2025-03-16 18:00:32,403][robosuite_logs][WARNING] - It is recommended to use a private macro file
[2025-03-16 18:00:32,403][robosuite_logs][WARNING] - To setup, run: python /home/hk-project-robolear/ft4740/miniconda3/envs/flower_cal/lib/python3.9/site-packages/robosuite/scripts/setup_macros.py
[2025-03-16 18:00:32,403][robosuite_logs][WARNING] - No private macro file found!
[2025-03-16 18:00:32,403][robosuite_logs][WARNING] - No private macro file found!
[2025-03-16 18:00:32,403][robosuite_logs][WARNING] - It is recommended to use a private macro file
[2025-03-16 18:00:32,403][robosuite_logs][WARNING] - It is recommended to use a private macro file
[2025-03-16 18:00:32,403][robosuite_logs][WARNING] - To setup, run: python /home/hk-project-robolear/ft4740/miniconda3/envs/flower_cal/lib/python3.9/site-packages/robosuite/scripts/setup_macros.py
[2025-03-16 18:00:32,403][robosuite_logs][WARNING] - To setup, run: python /home/hk-project-robolear/ft4740/miniconda3/envs/flower_cal/lib/python3.9/site-packages/robosuite/scripts/setup_macros.py
[2025-03-16 18:00:32,634][OpenGL.acceleratesupport][INFO] - No OpenGL_accelerate module loaded: No module named 'OpenGL_accelerate'
[2025-03-16 18:00:32,634][OpenGL.acceleratesupport][INFO] - No OpenGL_accelerate module loaded: No module named 'OpenGL_accelerate'
[2025-03-16 18:00:32,634][OpenGL.acceleratesupport][INFO] - No OpenGL_accelerate module loaded: No module named 'OpenGL_accelerate'
[2025-03-16 18:00:39,347][robosuite_logs][WARNING] - No private macro file found!
[2025-03-16 18:00:39,348][robosuite_logs][WARNING] - It is recommended to use a private macro file
[2025-03-16 18:00:39,348][robosuite_logs][WARNING] - To setup, run: python /home/hk-project-robolear/ft4740/miniconda3/envs/flower_cal/lib/python3.9/site-packages/robosuite/scripts/setup_macros.py
[2025-03-16 18:00:39,489][OpenGL.acceleratesupport][INFO] - No OpenGL_accelerate module loaded: No module named 'OpenGL_accelerate'
[2025-03-16 18:00:46,857][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:46,858][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:46,858][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:46,858][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:46,866][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:46,866][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:46,866][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:46,866][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:46,885][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:46,885][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:46,885][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:46,886][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:49,078][__main__][INFO] - Training config for seed 42:
{'callbacks': {'ema': {'_target_': 'flower.callbacks.ema.EMA', 'decay': 0.999, 'start_step': 0, 'save_ema_weights_in_callback_state': True, 'evaluate_ema_weights_instead': True, 'power': 0.6666666666666666, 'inv_gamma': 1.0, 'min_value': 0.0, 'max_value': 0.9999}, 'rollout_lh': {'_target_': 'flower.rollout.libero_rollout.RolloutLibero', '_recursive_': False, 'env_cfg': {'_target_': 'flower.wrappers.hulc_wrapper.HulcWrapper'}, 'skip_epochs': '${rollout_lh_skip_epochs}', 'benchmark_name': '${libero_benchmark}', 'rollout_freq': 10, 'num_videos': 0, 'num_sequences': 50, 'max_steps': 520, 'empty_cache': False, 'debug': False, 'n_eval': 50, 'num_procs': 10, 'use_mp': False, 'task_embedding_format': 'clip', 'device': '${device}'}, 'checkpoint': {'_target_': 'pytorch_lightning.callbacks.ModelCheckpoint', 'save_top_k': 1, 'verbose': True, 'monitor': 'eval_lh/avg_seq_len', 'mode': 'max', 'dirpath': 'saved_models', 'filename': '{epoch:02d}_{eval_lh/avg_seq_len:.2f}', 'every_n_epochs': '${callbacks.rollout_lh.rollout_freq}'}}, 'datamodule': {'transforms': {'train': {'rgb_static': [{'_target_': 'torchvision.transforms.Resize', 'size': 112, 'antialias': True}, {'_target_': 'flower.utils.transforms.RandomShiftsAug', 'pad': 10}, {'_target_': 'flower.utils.transforms.ScaleImageTensor'}, {'_target_': 'torchvision.transforms.Normalize', 'mean': [0.48145466, 0.4578275, 0.40821073], 'std': [0.26862954, 0.26130258, 0.27577711]}], 'rgb_gripper': [{'_target_': 'torchvision.transforms.Resize', 'size': 112, 'antialias': True}, {'_target_': 'flower.utils.transforms.RandomShiftsAug', 'pad': 4}, {'_target_': 'flower.utils.transforms.ScaleImageTensor'}, {'_target_': 'torchvision.transforms.Normalize', 'mean': [0.48145466, 0.4578275, 0.40821073], 'std': [0.26862954, 0.26130258, 0.27577711]}]}, 'val': {'rgb_static': [{'_target_': 'torchvision.transforms.Resize', 'size': 112, 'antialias': True}, {'_target_': 'flower.utils.transforms.ScaleImageTensor'}, {'_target_': 'torchvision.transforms.Normalize', 'mean': [0.48145466, 0.4578275, 0.40821073], 'std': [0.26862954, 0.26130258, 0.27577711]}], 'rgb_gripper': [{'_target_': 'torchvision.transforms.Resize', 'size': 112, 'antialias': True}, {'_target_': 'flower.utils.transforms.ScaleImageTensor'}, {'_target_': 'torchvision.transforms.Normalize', 'mean': [0.48145466, 0.4578275, 0.40821073], 'std': [0.26862954, 0.26130258, 0.27577711]}]}}, '_target_': 'flower.datasets.libero_data_module.LiberoDataModule', '_recursive_': False, 'root_data_dir': '${root_data_dir}', 'action_space': 7, 'shuffle_val': False, 'benchmark_name': '${libero_benchmark}', 'observation_space': {'rgb_obs': ['agentview_rgb', 'eye_in_hand_rgb'], 'depth_obs': [], 'state_obs': ['gripper_states', 'joint_states'], 'actions': ['rel_actions'], 'language': ['language']}, 'proprioception_dims': 'None', 'datasets': {'lang_dataset': {'_target_': 'flower.datasets.libero_dataset.LiberoMultitaskDataset', 'key': 'lang', 'benchmark_name': '${libero_benchmark}', 'batch_size': '${batch_size}', 'proprio_state': '${datamodule.proprioception_dims}', 'obs_space': '${datamodule.observation_space}', 'num_workers': '${num_workers}', 'action_seq_len': '${act_seq_len}', 'obs_seq_len': '${obs_seq_len}', 'split_ratio': 0.0}}}, 'model': {'_target_': 'flower.models.flower.FLOWERVLA', '_recursive_': False, 'vlm_path': 'microsoft/Florence-2-large', 'freeze_florence': False, 'freeze_vision_tower': False, 'vlm_prompt_style': 'default', 'token_dropout': 0.1, 'multistep': '${multistep}', 'num_sampling_steps': 4, 'lowdim_obs_dim': 7, 'action_dim': 7, 'act_window_size': 10, 'load_pretrained': True, 'pretrained_model_path': '/home/hk-project-sustainebot/ft4740/code/flower_vla_policy/logs/runs/2025-02-05/10-17-02/360000_model_weights.pt', 'use_second_view': True, 'second_view_key': 'image_wrist', 'action_type_adaln': True, 'use_causal_attention': True, 'use_cross_attn': True, 'use_adaln_cond': False, 'use_readout_token': False, 'use_proprio': False, 'return_act_chunk': False, 'sampling_type': 'uniform', 'dit_dim': 1024, 'n_heads': 16, 'n_layers': 18, 'attn_pdrop': 0.1, 'resid_pdrop': 0.1, 'mlp_pdrop': 0.1, 'use_rope': True, 'use_nope': False, 'query_seq_len': 100, 'rope_theta': 32.0, 'optimizer_type': 'adamw', 'optimizer': {'_target_': 'torch.optim.AdamW', 'transformer_weight_decay': 0.05, 'learning_rate': 2e-05, 'betas': [0.9, 0.99]}, 'lr_scheduler': {'lr_scheduler': {'init_lr': 2e-05, 'init_lr_scale': 0.1, 'final_lr_scale': 0.5, 'total_steps': 50000, 'phase_ratio': '(0.05, 0.1, 0.85)', 'lr': 2e-05}}}, 'root_data_dir': '/home/yagmurlu/code/MoDE_Calvin/dataset/task_ABC_D', 'lang_folder': 'lang_clip_resnet50', 'log_dir': './logs', 'slurm': False, 'seed': 42, 'device': 'cuda', 'batch_size': 8, 'devices': 4, 'goal_window_size': 1, 'act_dim': 7, 'proprio_dims': 9, 'obs_dim': 512, 'goal_dim': 512, 'obs_seq_len': 1, 'act_seq_len': 10, 'multistep': '${act_seq_len}', 'p_last_state': 0, 'max_epochs': 30, 'rollout_lh_skip_epochs': 9, 'num_workers': 1, 'benchmark_name': '${libero_benchmark}', 'libero_benchmark': 'libero_spatial', 'trainer': {'devices': '${devices}', 'precision': 'bf16-mixed', 'max_epochs': '${max_epochs}', 'sync_batchnorm': True, 'accelerator': 'gpu', 'strategy': 'ddp', 'limit_train_batches': 1000, 'limit_val_batches': 4}, 'logger': {'_target_': 'pytorch_lightning.loggers.WandbLogger', 'save_dir': '.', 'name': '2025-03-16/18-00-19', 'group': '2025-03-16', 'log_model': False, 'project': '${libero_benchmark}', 'entity': 'bennoq', 'id': '2025-03-16_18-00-19'}}
[2025-03-16 18:00:49,261][__main__][INFO] - Git commit: cd15964f487ea13d3176eaf3b9a6b7202fbbfa5a
[2025-03-16 18:00:49,431][__main__][INFO] - * CUDA:
- GPU:
- NVIDIA A100-SXM4-40GB
- NVIDIA A100-SXM4-40GB
- NVIDIA A100-SXM4-40GB
- NVIDIA A100-SXM4-40GB
- available: True
- version: 12.1
* Packages:
- numpy: 1.26.4
- pyTorch_debug: False
- pyTorch_version: 2.2.2+cu121
- pytorch-lightning: 2.0.8
- tqdm: 4.67.1
[2025-03-16 18:00:49,582][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:49,585][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:49,585][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:49,586][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:01:17,215][root][INFO] - Creating EMA weights copy.
[2025-03-16 18:01:17,215][root][INFO] - Creating EMA weights copy.
[2025-03-16 18:01:17,215][root][INFO] - Creating EMA weights copy.
[2025-03-16 18:01:17,215][root][INFO] - Creating EMA weights copy.
[2025-03-16 19:01:24,821][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_between_the_plate_and_the_ramekin_and_place_it_on_the_plate
[2025-03-16 19:02:31,877][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_ramekin_and_place_it_on_the_plate
[2025-03-16 19:03:53,441][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_from_table_center_and_place_it_on_the_plate
[2025-03-16 19:05:04,205][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_cookie_box_and_place_it_on_the_plate
[2025-03-16 19:06:08,553][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_in_the_top_drawer_of_the_wooden_cabinet_and_place_it_on_the_plate
[2025-03-16 19:07:34,019][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_ramekin_and_place_it_on_the_plate
[2025-03-16 19:09:34,928][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_cookie_box_and_place_it_on_the_plate
[2025-03-16 19:10:44,781][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_stove_and_place_it_on_the_plate
[2025-03-16 19:12:09,260][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_plate_and_place_it_on_the_plate
[2025-03-16 19:13:21,878][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_wooden_cabinet_and_place_it_on_the_plate
[2025-03-16 19:15:07,520][flower.rollout.libero_rollout][INFO] - eval_lh/avg_seq_len success rate 0.9677884578704834
[2025-03-16 19:15:07,522][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_between_the_plate_and_the_ramekin_and_place_it_on_the_plate with success 1.0
[2025-03-16 19:15:07,523][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_ramekin_and_place_it_on_the_plate with success 1.0
[2025-03-16 19:15:07,524][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_from_table_center_and_place_it_on_the_plate with success 1.0
[2025-03-16 19:15:07,525][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_cookie_box_and_place_it_on_the_plate with success 1.0
[2025-03-16 19:15:07,526][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_in_the_top_drawer_of_the_wooden_cabinet_and_place_it_on_the_plate with success 0.9791666666666666
[2025-03-16 19:15:07,527][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_ramekin_and_place_it_on_the_plate with success 0.8012820512820513
[2025-03-16 19:15:07,528][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_cookie_box_and_place_it_on_the_plate with success 1.0
[2025-03-16 19:15:07,529][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_stove_and_place_it_on_the_plate with success 1.0
[2025-03-16 19:15:07,530][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_plate_and_place_it_on_the_plate with success 0.9391025641025641
[2025-03-16 19:15:07,531][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_wooden_cabinet_and_place_it_on_the_plate with success 0.9583333333333333
[2025-03-16 20:18:12,142][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_between_the_plate_and_the_ramekin_and_place_it_on_the_plate
[2025-03-16 20:19:17,547][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_ramekin_and_place_it_on_the_plate
[2025-03-16 20:20:54,413][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_from_table_center_and_place_it_on_the_plate
[2025-03-16 20:22:18,783][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_cookie_box_and_place_it_on_the_plate
[2025-03-16 20:23:22,687][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_in_the_top_drawer_of_the_wooden_cabinet_and_place_it_on_the_plate
[2025-03-16 20:24:48,570][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_ramekin_and_place_it_on_the_plate
[2025-03-16 20:26:37,754][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_cookie_box_and_place_it_on_the_plate
[2025-03-16 20:27:49,825][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_stove_and_place_it_on_the_plate
[2025-03-16 20:29:19,428][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_plate_and_place_it_on_the_plate
[2025-03-16 20:30:46,963][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_wooden_cabinet_and_place_it_on_the_plate
[2025-03-16 20:32:39,478][flower.rollout.libero_rollout][INFO] - eval_lh/avg_seq_len success rate 0.9681089520454407
[2025-03-16 20:32:39,479][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_between_the_plate_and_the_ramekin_and_place_it_on_the_plate with success 0.9791666666666666
[2025-03-16 20:32:39,480][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_ramekin_and_place_it_on_the_plate with success 0.9807692307692308
[2025-03-16 20:32:39,480][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_from_table_center_and_place_it_on_the_plate with success 0.9807692307692308
[2025-03-16 20:32:39,480][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_cookie_box_and_place_it_on_the_plate with success 1.0
[2025-03-16 20:32:39,481][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_in_the_top_drawer_of_the_wooden_cabinet_and_place_it_on_the_plate with success 1.0
[2025-03-16 20:32:39,481][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_ramekin_and_place_it_on_the_plate with success 0.8621794871794872
[2025-03-16 20:32:39,482][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_cookie_box_and_place_it_on_the_plate with success 1.0
[2025-03-16 20:32:39,482][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_stove_and_place_it_on_the_plate with success 1.0
[2025-03-16 20:32:39,482][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_plate_and_place_it_on_the_plate with success 0.9166666666666666
[2025-03-16 20:32:39,483][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_wooden_cabinet_and_place_it_on_the_plate with success 0.9615384615384616
[2025-03-16 21:35:50,296][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_between_the_plate_and_the_ramekin_and_place_it_on_the_plate
[2025-03-16 21:36:48,605][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_ramekin_and_place_it_on_the_plate
[2025-03-16 21:38:29,731][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_from_table_center_and_place_it_on_the_plate
[2025-03-16 21:39:56,846][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_cookie_box_and_place_it_on_the_plate
[2025-03-16 21:41:05,224][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_in_the_top_drawer_of_the_wooden_cabinet_and_place_it_on_the_plate
[2025-03-16 21:42:36,174][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_ramekin_and_place_it_on_the_plate
[2025-03-16 21:44:19,068][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_cookie_box_and_place_it_on_the_plate
[2025-03-16 21:45:30,562][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_stove_and_place_it_on_the_plate
[2025-03-16 21:47:03,502][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_plate_and_place_it_on_the_plate
[2025-03-16 21:48:28,224][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_wooden_cabinet_and_place_it_on_the_plate
[2025-03-16 21:50:15,455][flower.rollout.libero_rollout][INFO] - eval_lh/avg_seq_len success rate 0.9621794819831848
[2025-03-16 21:50:15,456][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_between_the_plate_and_the_ramekin_and_place_it_on_the_plate with success 0.9807692307692308
[2025-03-16 21:50:15,457][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_ramekin_and_place_it_on_the_plate with success 0.9599358974358975
[2025-03-16 21:50:15,458][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_from_table_center_and_place_it_on_the_plate with success 0.9615384615384616
[2025-03-16 21:50:15,458][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_cookie_box_and_place_it_on_the_plate with success 1.0
[2025-03-16 21:50:15,459][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_in_the_top_drawer_of_the_wooden_cabinet_and_place_it_on_the_plate with success 0.8990384615384616
[2025-03-16 21:50:15,459][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_ramekin_and_place_it_on_the_plate with success 0.8798076923076923
[2025-03-16 21:50:15,459][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_cookie_box_and_place_it_on_the_plate with success 1.0
[2025-03-16 21:50:15,460][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_stove_and_place_it_on_the_plate with success 1.0
[2025-03-16 21:50:15,460][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_plate_and_place_it_on_the_plate with success 0.9791666666666666
[2025-03-16 21:50:15,460][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_wooden_cabinet_and_place_it_on_the_plate with success 0.9615384615384616
[2025-03-16 21:50:20,024][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 21:50:20,025][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 21:50:20,025][__main__][INFO] - GPU 2 Memory: Allocated: 3.73GB, Reserved: 3.83GB
[2025-03-16 21:50:20,025][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 21:50:20,037][__main__][INFO] - GPU 0 Memory: Allocated: 3.73GB, Reserved: 3.79GB
[2025-03-16 21:50:20,037][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 21:50:20,038][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 21:50:20,038][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 21:50:20,048][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 21:50:20,049][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 21:50:20,049][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 21:50:20,049][__main__][INFO] - GPU 3 Memory: Allocated: 3.73GB, Reserved: 3.83GB
[2025-03-16 21:50:20,100][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 21:50:20,101][__main__][INFO] - GPU 1 Memory: Allocated: 3.73GB, Reserved: 3.79GB
[2025-03-16 21:50:20,101][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 21:50:20,101][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
|