CMS Jenkins service not responding

[smuzaffar]

There is some infrastructure issues and our CMS Jenkins instance is not working properly since 12:35 Geneva time. I have asked IT service to look in to the issue. Meanwhile PR tests or IB jobs are not working

[smuzaffar]

ping cms-bot

[cmsbuild]

cms-bot internal usage

[cmsbuild]

A new Issue was created by @smuzaffar.

@Dr15Jones, @antoniovilela, @makortel, @mandrenguyen, @rappoccio, @sextonkennedy, @smuzaffar can you please review it and eventually sign/assign? Thanks.

cms-bot commands are listed here

[smuzaffar]

@cms-sw/all-l2 , I have tried to replace the old jenkins instance with a new one but it still did not work. Looks like memory usage has been increased and system start killing jenkins process. I am now building a bigger instance ( 16 cores/32GBinstead of old 8 core/s16GB)

[makortel]

type documentation

[smuzaffar]

New jenkins seem stable now. I have restarted all PR jobs which were pending but if you still see any PR for which tests are now running then please let me know