DQN : Improve performance of obtain_evaluation_episodes

[aruhela]

Hi Garage Developers,

The DQN algo uses 1 worker for running _num_eval_episodes, which seems to be a bottleneck in its performance. Has anyone tried leveraging all the compute cores to make this step faster? Any reason why it hasn't been done before?

File : garage/torch/algos/dqn.py
Line : 173-180

Thanks
Amit Ruhela

[aruhela]

Are there any active developers in the Garage team who would like to comment on my question? Is that too trivial to reply?