Is it not possible to set the rollout engine to multiple gpus? #470
Description
When I set the 'tensor_parallel_size'>1 in the engine args the code crashes. I understand that the training itself with Unsloth only supports one gpu for now (though they have announced this is changing), but is it not possible to still perform the rollouts with the vllm engine across multiple gpus?