Settings bundle not showing up in iPhone settings

I am trying to add a Settings bundle in my iPad app, but it randomly shows up in the iPad settings menu.

When I run in Debug mode (Device or Simulator) it doesn't show up. When I build in Distribution mode and then deploy the app on the iPad A it shows up but doesn't on iPad B (I have several iPads to test).

I am sure the Root.plist is correct as it works sometimes and sometimes not. I also tried with the default plist created when you add a Settings bundle.

Is there something I forgot to do apart from adding the Settings.bundle in the project?

Thanks in advance.