File size: 23,403 Bytes
92cd212
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
e6971fb
 
 
 
 
 
 
 
 
 
92cd212
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
[2025-03-16 18:00:19,576][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,577][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,577][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,577][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,578][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,578][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,578][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,578][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,578][__main__][INFO] - 
Initializing training for seed 42
[2025-03-16 18:00:19,584][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,584][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,584][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,584][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,585][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,585][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,585][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:19,585][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:32,402][robosuite_logs][WARNING] - No private macro file found!
[2025-03-16 18:00:32,403][robosuite_logs][WARNING] - It is recommended to use a private macro file
[2025-03-16 18:00:32,403][robosuite_logs][WARNING] - To setup, run: python /home/hk-project-robolear/ft4740/miniconda3/envs/flower_cal/lib/python3.9/site-packages/robosuite/scripts/setup_macros.py
[2025-03-16 18:00:32,403][robosuite_logs][WARNING] - No private macro file found!
[2025-03-16 18:00:32,403][robosuite_logs][WARNING] - No private macro file found!
[2025-03-16 18:00:32,403][robosuite_logs][WARNING] - It is recommended to use a private macro file
[2025-03-16 18:00:32,403][robosuite_logs][WARNING] - It is recommended to use a private macro file
[2025-03-16 18:00:32,403][robosuite_logs][WARNING] - To setup, run: python /home/hk-project-robolear/ft4740/miniconda3/envs/flower_cal/lib/python3.9/site-packages/robosuite/scripts/setup_macros.py
[2025-03-16 18:00:32,403][robosuite_logs][WARNING] - To setup, run: python /home/hk-project-robolear/ft4740/miniconda3/envs/flower_cal/lib/python3.9/site-packages/robosuite/scripts/setup_macros.py
[2025-03-16 18:00:32,634][OpenGL.acceleratesupport][INFO] - No OpenGL_accelerate module loaded: No module named 'OpenGL_accelerate'
[2025-03-16 18:00:32,634][OpenGL.acceleratesupport][INFO] - No OpenGL_accelerate module loaded: No module named 'OpenGL_accelerate'
[2025-03-16 18:00:32,634][OpenGL.acceleratesupport][INFO] - No OpenGL_accelerate module loaded: No module named 'OpenGL_accelerate'
[2025-03-16 18:00:39,347][robosuite_logs][WARNING] - No private macro file found!
[2025-03-16 18:00:39,348][robosuite_logs][WARNING] - It is recommended to use a private macro file
[2025-03-16 18:00:39,348][robosuite_logs][WARNING] - To setup, run: python /home/hk-project-robolear/ft4740/miniconda3/envs/flower_cal/lib/python3.9/site-packages/robosuite/scripts/setup_macros.py
[2025-03-16 18:00:39,489][OpenGL.acceleratesupport][INFO] - No OpenGL_accelerate module loaded: No module named 'OpenGL_accelerate'
[2025-03-16 18:00:46,857][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:46,858][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:46,858][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:46,858][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:46,866][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:46,866][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:46,866][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:46,866][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:46,885][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:46,885][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:46,885][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:46,886][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:49,078][__main__][INFO] - Training config for seed 42:
{'callbacks': {'ema': {'_target_': 'flower.callbacks.ema.EMA', 'decay': 0.999, 'start_step': 0, 'save_ema_weights_in_callback_state': True, 'evaluate_ema_weights_instead': True, 'power': 0.6666666666666666, 'inv_gamma': 1.0, 'min_value': 0.0, 'max_value': 0.9999}, 'rollout_lh': {'_target_': 'flower.rollout.libero_rollout.RolloutLibero', '_recursive_': False, 'env_cfg': {'_target_': 'flower.wrappers.hulc_wrapper.HulcWrapper'}, 'skip_epochs': '${rollout_lh_skip_epochs}', 'benchmark_name': '${libero_benchmark}', 'rollout_freq': 10, 'num_videos': 0, 'num_sequences': 50, 'max_steps': 520, 'empty_cache': False, 'debug': False, 'n_eval': 50, 'num_procs': 10, 'use_mp': False, 'task_embedding_format': 'clip', 'device': '${device}'}, 'checkpoint': {'_target_': 'pytorch_lightning.callbacks.ModelCheckpoint', 'save_top_k': 1, 'verbose': True, 'monitor': 'eval_lh/avg_seq_len', 'mode': 'max', 'dirpath': 'saved_models', 'filename': '{epoch:02d}_{eval_lh/avg_seq_len:.2f}', 'every_n_epochs': '${callbacks.rollout_lh.rollout_freq}'}}, 'datamodule': {'transforms': {'train': {'rgb_static': [{'_target_': 'torchvision.transforms.Resize', 'size': 112, 'antialias': True}, {'_target_': 'flower.utils.transforms.RandomShiftsAug', 'pad': 10}, {'_target_': 'flower.utils.transforms.ScaleImageTensor'}, {'_target_': 'torchvision.transforms.Normalize', 'mean': [0.48145466, 0.4578275, 0.40821073], 'std': [0.26862954, 0.26130258, 0.27577711]}], 'rgb_gripper': [{'_target_': 'torchvision.transforms.Resize', 'size': 112, 'antialias': True}, {'_target_': 'flower.utils.transforms.RandomShiftsAug', 'pad': 4}, {'_target_': 'flower.utils.transforms.ScaleImageTensor'}, {'_target_': 'torchvision.transforms.Normalize', 'mean': [0.48145466, 0.4578275, 0.40821073], 'std': [0.26862954, 0.26130258, 0.27577711]}]}, 'val': {'rgb_static': [{'_target_': 'torchvision.transforms.Resize', 'size': 112, 'antialias': True}, {'_target_': 'flower.utils.transforms.ScaleImageTensor'}, {'_target_': 'torchvision.transforms.Normalize', 'mean': [0.48145466, 0.4578275, 0.40821073], 'std': [0.26862954, 0.26130258, 0.27577711]}], 'rgb_gripper': [{'_target_': 'torchvision.transforms.Resize', 'size': 112, 'antialias': True}, {'_target_': 'flower.utils.transforms.ScaleImageTensor'}, {'_target_': 'torchvision.transforms.Normalize', 'mean': [0.48145466, 0.4578275, 0.40821073], 'std': [0.26862954, 0.26130258, 0.27577711]}]}}, '_target_': 'flower.datasets.libero_data_module.LiberoDataModule', '_recursive_': False, 'root_data_dir': '${root_data_dir}', 'action_space': 7, 'shuffle_val': False, 'benchmark_name': '${libero_benchmark}', 'observation_space': {'rgb_obs': ['agentview_rgb', 'eye_in_hand_rgb'], 'depth_obs': [], 'state_obs': ['gripper_states', 'joint_states'], 'actions': ['rel_actions'], 'language': ['language']}, 'proprioception_dims': 'None', 'datasets': {'lang_dataset': {'_target_': 'flower.datasets.libero_dataset.LiberoMultitaskDataset', 'key': 'lang', 'benchmark_name': '${libero_benchmark}', 'batch_size': '${batch_size}', 'proprio_state': '${datamodule.proprioception_dims}', 'obs_space': '${datamodule.observation_space}', 'num_workers': '${num_workers}', 'action_seq_len': '${act_seq_len}', 'obs_seq_len': '${obs_seq_len}', 'split_ratio': 0.0}}}, 'model': {'_target_': 'flower.models.flower.FLOWERVLA', '_recursive_': False, 'vlm_path': 'microsoft/Florence-2-large', 'freeze_florence': False, 'freeze_vision_tower': False, 'vlm_prompt_style': 'default', 'token_dropout': 0.1, 'multistep': '${multistep}', 'num_sampling_steps': 4, 'lowdim_obs_dim': 7, 'action_dim': 7, 'act_window_size': 10, 'load_pretrained': True, 'pretrained_model_path': '/home/hk-project-sustainebot/ft4740/code/flower_vla_policy/logs/runs/2025-02-05/10-17-02/360000_model_weights.pt', 'use_second_view': True, 'second_view_key': 'image_wrist', 'action_type_adaln': True, 'use_causal_attention': True, 'use_cross_attn': True, 'use_adaln_cond': False, 'use_readout_token': False, 'use_proprio': False, 'return_act_chunk': False, 'sampling_type': 'uniform', 'dit_dim': 1024, 'n_heads': 16, 'n_layers': 18, 'attn_pdrop': 0.1, 'resid_pdrop': 0.1, 'mlp_pdrop': 0.1, 'use_rope': True, 'use_nope': False, 'query_seq_len': 100, 'rope_theta': 32.0, 'optimizer_type': 'adamw', 'optimizer': {'_target_': 'torch.optim.AdamW', 'transformer_weight_decay': 0.05, 'learning_rate': 2e-05, 'betas': [0.9, 0.99]}, 'lr_scheduler': {'lr_scheduler': {'init_lr': 2e-05, 'init_lr_scale': 0.1, 'final_lr_scale': 0.5, 'total_steps': 50000, 'phase_ratio': '(0.05, 0.1, 0.85)', 'lr': 2e-05}}}, 'root_data_dir': '/home/yagmurlu/code/MoDE_Calvin/dataset/task_ABC_D', 'lang_folder': 'lang_clip_resnet50', 'log_dir': './logs', 'slurm': False, 'seed': 42, 'device': 'cuda', 'batch_size': 8, 'devices': 4, 'goal_window_size': 1, 'act_dim': 7, 'proprio_dims': 9, 'obs_dim': 512, 'goal_dim': 512, 'obs_seq_len': 1, 'act_seq_len': 10, 'multistep': '${act_seq_len}', 'p_last_state': 0, 'max_epochs': 30, 'rollout_lh_skip_epochs': 9, 'num_workers': 1, 'benchmark_name': '${libero_benchmark}', 'libero_benchmark': 'libero_spatial', 'trainer': {'devices': '${devices}', 'precision': 'bf16-mixed', 'max_epochs': '${max_epochs}', 'sync_batchnorm': True, 'accelerator': 'gpu', 'strategy': 'ddp', 'limit_train_batches': 1000, 'limit_val_batches': 4}, 'logger': {'_target_': 'pytorch_lightning.loggers.WandbLogger', 'save_dir': '.', 'name': '2025-03-16/18-00-19', 'group': '2025-03-16', 'log_model': False, 'project': '${libero_benchmark}', 'entity': 'bennoq', 'id': '2025-03-16_18-00-19'}}
[2025-03-16 18:00:49,261][__main__][INFO] - Git commit: cd15964f487ea13d3176eaf3b9a6b7202fbbfa5a
[2025-03-16 18:00:49,431][__main__][INFO] - * CUDA:
	- GPU:
		- NVIDIA A100-SXM4-40GB
		- NVIDIA A100-SXM4-40GB
		- NVIDIA A100-SXM4-40GB
		- NVIDIA A100-SXM4-40GB
	- available:         True
	- version:           12.1
* Packages:
	- numpy:             1.26.4
	- pyTorch_debug:     False
	- pyTorch_version:   2.2.2+cu121
	- pytorch-lightning: 2.0.8
	- tqdm:              4.67.1
[2025-03-16 18:00:49,582][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:49,585][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:49,585][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:00:49,586][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 18:01:17,215][root][INFO] - Creating EMA weights copy.
[2025-03-16 18:01:17,215][root][INFO] - Creating EMA weights copy.
[2025-03-16 18:01:17,215][root][INFO] - Creating EMA weights copy.
[2025-03-16 18:01:17,215][root][INFO] - Creating EMA weights copy.
[2025-03-16 19:01:24,821][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_between_the_plate_and_the_ramekin_and_place_it_on_the_plate
[2025-03-16 19:02:31,877][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_ramekin_and_place_it_on_the_plate
[2025-03-16 19:03:53,441][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_from_table_center_and_place_it_on_the_plate
[2025-03-16 19:05:04,205][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_cookie_box_and_place_it_on_the_plate
[2025-03-16 19:06:08,553][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_in_the_top_drawer_of_the_wooden_cabinet_and_place_it_on_the_plate
[2025-03-16 19:07:34,019][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_ramekin_and_place_it_on_the_plate
[2025-03-16 19:09:34,928][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_cookie_box_and_place_it_on_the_plate
[2025-03-16 19:10:44,781][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_stove_and_place_it_on_the_plate
[2025-03-16 19:12:09,260][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_plate_and_place_it_on_the_plate
[2025-03-16 19:13:21,878][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_wooden_cabinet_and_place_it_on_the_plate
[2025-03-16 19:15:07,520][flower.rollout.libero_rollout][INFO] - eval_lh/avg_seq_len success rate 0.9677884578704834
[2025-03-16 19:15:07,522][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_between_the_plate_and_the_ramekin_and_place_it_on_the_plate with success 1.0
[2025-03-16 19:15:07,523][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_ramekin_and_place_it_on_the_plate with success 1.0
[2025-03-16 19:15:07,524][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_from_table_center_and_place_it_on_the_plate with success 1.0
[2025-03-16 19:15:07,525][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_cookie_box_and_place_it_on_the_plate with success 1.0
[2025-03-16 19:15:07,526][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_in_the_top_drawer_of_the_wooden_cabinet_and_place_it_on_the_plate with success 0.9791666666666666
[2025-03-16 19:15:07,527][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_ramekin_and_place_it_on_the_plate with success 0.8012820512820513
[2025-03-16 19:15:07,528][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_cookie_box_and_place_it_on_the_plate with success 1.0
[2025-03-16 19:15:07,529][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_stove_and_place_it_on_the_plate with success 1.0
[2025-03-16 19:15:07,530][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_plate_and_place_it_on_the_plate with success 0.9391025641025641
[2025-03-16 19:15:07,531][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_wooden_cabinet_and_place_it_on_the_plate with success 0.9583333333333333
[2025-03-16 20:18:12,142][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_between_the_plate_and_the_ramekin_and_place_it_on_the_plate
[2025-03-16 20:19:17,547][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_ramekin_and_place_it_on_the_plate
[2025-03-16 20:20:54,413][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_from_table_center_and_place_it_on_the_plate
[2025-03-16 20:22:18,783][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_cookie_box_and_place_it_on_the_plate
[2025-03-16 20:23:22,687][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_in_the_top_drawer_of_the_wooden_cabinet_and_place_it_on_the_plate
[2025-03-16 20:24:48,570][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_ramekin_and_place_it_on_the_plate
[2025-03-16 20:26:37,754][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_cookie_box_and_place_it_on_the_plate
[2025-03-16 20:27:49,825][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_stove_and_place_it_on_the_plate
[2025-03-16 20:29:19,428][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_plate_and_place_it_on_the_plate
[2025-03-16 20:30:46,963][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_wooden_cabinet_and_place_it_on_the_plate
[2025-03-16 20:32:39,478][flower.rollout.libero_rollout][INFO] - eval_lh/avg_seq_len success rate 0.9681089520454407
[2025-03-16 20:32:39,479][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_between_the_plate_and_the_ramekin_and_place_it_on_the_plate with success 0.9791666666666666
[2025-03-16 20:32:39,480][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_ramekin_and_place_it_on_the_plate with success 0.9807692307692308
[2025-03-16 20:32:39,480][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_from_table_center_and_place_it_on_the_plate with success 0.9807692307692308
[2025-03-16 20:32:39,480][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_cookie_box_and_place_it_on_the_plate with success 1.0
[2025-03-16 20:32:39,481][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_in_the_top_drawer_of_the_wooden_cabinet_and_place_it_on_the_plate with success 1.0
[2025-03-16 20:32:39,481][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_ramekin_and_place_it_on_the_plate with success 0.8621794871794872
[2025-03-16 20:32:39,482][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_cookie_box_and_place_it_on_the_plate with success 1.0
[2025-03-16 20:32:39,482][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_stove_and_place_it_on_the_plate with success 1.0
[2025-03-16 20:32:39,482][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_plate_and_place_it_on_the_plate with success 0.9166666666666666
[2025-03-16 20:32:39,483][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_wooden_cabinet_and_place_it_on_the_plate with success 0.9615384615384616
[2025-03-16 21:35:50,296][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_between_the_plate_and_the_ramekin_and_place_it_on_the_plate
[2025-03-16 21:36:48,605][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_ramekin_and_place_it_on_the_plate
[2025-03-16 21:38:29,731][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_from_table_center_and_place_it_on_the_plate
[2025-03-16 21:39:56,846][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_cookie_box_and_place_it_on_the_plate
[2025-03-16 21:41:05,224][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_in_the_top_drawer_of_the_wooden_cabinet_and_place_it_on_the_plate
[2025-03-16 21:42:36,174][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_ramekin_and_place_it_on_the_plate
[2025-03-16 21:44:19,068][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_cookie_box_and_place_it_on_the_plate
[2025-03-16 21:45:30,562][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_stove_and_place_it_on_the_plate
[2025-03-16 21:47:03,502][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_plate_and_place_it_on_the_plate
[2025-03-16 21:48:28,224][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_wooden_cabinet_and_place_it_on_the_plate
[2025-03-16 21:50:15,455][flower.rollout.libero_rollout][INFO] - eval_lh/avg_seq_len success rate 0.9621794819831848
[2025-03-16 21:50:15,456][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_between_the_plate_and_the_ramekin_and_place_it_on_the_plate with success 0.9807692307692308
[2025-03-16 21:50:15,457][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_ramekin_and_place_it_on_the_plate with success 0.9599358974358975
[2025-03-16 21:50:15,458][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_from_table_center_and_place_it_on_the_plate with success 0.9615384615384616
[2025-03-16 21:50:15,458][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_cookie_box_and_place_it_on_the_plate with success 1.0
[2025-03-16 21:50:15,459][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_in_the_top_drawer_of_the_wooden_cabinet_and_place_it_on_the_plate with success 0.8990384615384616
[2025-03-16 21:50:15,459][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_ramekin_and_place_it_on_the_plate with success 0.8798076923076923
[2025-03-16 21:50:15,459][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_cookie_box_and_place_it_on_the_plate with success 1.0
[2025-03-16 21:50:15,460][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_stove_and_place_it_on_the_plate with success 1.0
[2025-03-16 21:50:15,460][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_plate_and_place_it_on_the_plate with success 0.9791666666666666
[2025-03-16 21:50:15,460][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_wooden_cabinet_and_place_it_on_the_plate with success 0.9615384615384616
[2025-03-16 21:50:20,024][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 21:50:20,025][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 21:50:20,025][__main__][INFO] - GPU 2 Memory: Allocated: 3.73GB, Reserved: 3.83GB
[2025-03-16 21:50:20,025][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 21:50:20,037][__main__][INFO] - GPU 0 Memory: Allocated: 3.73GB, Reserved: 3.79GB
[2025-03-16 21:50:20,037][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 21:50:20,038][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 21:50:20,038][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 21:50:20,048][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 21:50:20,049][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 21:50:20,049][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 21:50:20,049][__main__][INFO] - GPU 3 Memory: Allocated: 3.73GB, Reserved: 3.83GB
[2025-03-16 21:50:20,100][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 21:50:20,101][__main__][INFO] - GPU 1 Memory: Allocated: 3.73GB, Reserved: 3.79GB
[2025-03-16 21:50:20,101][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
[2025-03-16 21:50:20,101][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB