# DeepSpeed and RayTune

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdeepspeed-and-raytune%2F10319%3E%5C
**Category:** Intermediate\
**Created:** [September 26, 2021, 3:29pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdeepspeed-and-raytune%2F10319 "2021-09-26T15:29:33Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Raimondo](https://avatars.discourse-cdn.com/v4/letter/r/7cd45c/32.png) [@Raimondo](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FRaimondo)%5C
**Post date:** [September 26, 2021, 3:29pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdeepspeed-and-raytune%2F10319%2F1 "2021-09-26T15:29:33Z")

</div>

Hello,  
I was able to make DeepSpeed and Ray (for hyperparameter search) work on my machine separately. I was wondering if it would be possibile to make them work together at the same time. I need them to work at the same time otherwise I am not able to fine tune my model (GPT2). I tried to pass the argument --deepspeed in the config.json and then using trainer.hyperparameter.search() but with no success. I do not think it is possibile. Am I wrong? thanks