This appears to be an environmental issue that can’t be reproduced

on etesting-snapshot rancher it was found that env doesn’t have platform-minimal application installed that means that order of core modules can be different to compare with bugfest

Additionally I tried to rerun migrations on already running env (re-enable mod-lists module) and migration was completed successfully, at the same time “Missing items” list was skipped as system user had no roles assigned and potentially it explains why during migration it wasn’t possible to get list of entities with cross-tenant queries

Potentially it’s just a rancher env issue

cc @Kriti Jain @Kathleen Moore

@Kriti Jain please look at logs, I’m not fully sure that it’s connected to modules enabling order, usually permissions module is installed at the beginning as it’s part of platform minimal and platform itself can’t work without it

in logs you can see that request to mod-roles-keycloak is sent without userId that’s why sidecar responded with 404 error

so it seems like there is issue with migrations on Eureka envs (at least newly created)

cc @Matt Weaver @Viktor Gema

@Kathleen Moore I don't think as they are in the optional section of MD

Open

@Kriti Jain are we able to set the dependency or otherwise ensure they’re installed in the correct order?