[FIX] Project.write_json() update outputs instead of overriding them#431
[FIX] Project.write_json() update outputs instead of overriding them#431Gautzilla wants to merge 6 commits into
Conversation
mathieudpnt
left a comment
There was a problem hiding this comment.
This worked for me as i successfully launched 13 Transforms simultenaously 🥇
Also, would be nice to have the transforms of a
Projectinstance in alphanumerical order 👼
It would be nice to sort alphanumericaly the Transform names though
For some reason you've put your finger on something fishy. The unbearable truth about default transform namesWe had let the default transform name to The default WE should then rework the default transform name, with or without keeping the "legacy" default names of the outputs. Here are some thoughts about it: 1: make the name mandatoryThe more straightforward way to address the issue: we don't have to imagine what most people would want to name their transforms by default, they just have to name them themselves. 2: keep the "legacy" default namesWe keep the idea of the legacy default names by parsing the transform specs in its name by default. IMO it has several downsides:
3: pick an incremented ID numberOne other simple way to do it is to just name the first transform So?Anyways, I think I'd go for option 3 or 1, but if anyone has something better in mind I'm all open (@mathieudpnt @cazaudo @MaelleTtrt)
|
I would vote for option 1 and make |
|
@cazaudo @MaelleTtrt If you're OK with Mathieu I'll just make the |

If a project's JSON was modified by another process while the script was running (e.g. if two transforms are run simultaneously in different jobs), the latter overwrote the former
This PR should fix it by parsing the outputs in the project's JSON and joining them with the outputs of the project in the current shell.
The only remaining thing that could be messy if if someones runs simultaneously 2 transform that have the same name: the latter might still overwrite the former, but I'm not sure what's the best way of avoiding that (other than the user not doing that mistake!)
This PR resolves #405