Missing file and a question regarding DPO training

Hi **Missing File** I am trying to run the **Step 2.3** i.e **Sampling pseudo-labels from DPO model using the command** ``` ARGS='+data.split="train" eval.mode="sampling" eval.sampling.max_seed=3' torchrun --nproc_per_node 2 greedy_decode.py --config-name=dpo-1 $ARGS python3 eval_sampling.py --config-name=dpo-1 $ARGS python3 utils/make_rft_data.py --config-name=dpo-1 ``` But the file `greedy_decode.py` seems missing. can you please provide the file? **Regarding DPO training** In the paper, it is mentioned that the training was done on a single NVIDIA A40 GPU. I am currently working on a remote server that has two NVIDIA A40 GPUs with 48 GB of Cuda memory each. But when I ran the commands given in **Step 2.2: Train SFT model with DPO objective**, then I received the out-of-memory error. When I made changes to the following variables in **dpo-1.yaml**, then only I was able to train: ``` per_device_train_batch_size: 3 per_device_eval_batch_size: 2 eval: per_device_eval_batch_size: 48 ``` However, I want to clarify that the version of the `trl` and `transformers` library mentioned in the requirements file was not working somehow. For me, these versions worked: ``` trl==0.13.0 transformers==4.46.0 ```