Hi, thank you for writing this awesome package. I am using hardware instances where the CPU:Memory ratio is not high, and am running into spillage/OoM complaints from Ray. I can set the nprocesses on Ray, but since swifter goes through many possible engines when deciding parallelization, I'd like to set that on swifter instead. Any tips?
Hi, thank you for writing this awesome package. I am using hardware instances where the CPU:Memory ratio is not high, and am running into spillage/OoM complaints from Ray. I can set the nprocesses on Ray, but since swifter goes through many possible engines when deciding parallelization, I'd like to set that on swifter instead. Any tips?