[14.0.X] Add customize to include Alpaka HCal PF Clustering at HLT

[waredjeb]

This is a backport of #43971

This PR add customizeHLTforAlpakaParticleFlowClustering() to customizeHLTForAlpaka() to integrate the Alpaka HCAL PF Clustering at HLT.

The function defines all the needed modules and replace them in the necessary Sequences. Currently it also run the Alpaka CPU-serial version up to the PFClusterSoA collection, before the Legacy conversion.

To compare the GPU version against the CPU version a follow-up PR will be needed to perform the CPU legacy conversion and the comparison at DQM.
Validation

Validated running the following HLT configuration

hltGetConfiguration /dev/CMSSW_14_0_0/GRun --unprescale --output all --globaltag auto:phase1_2024_realistic --mc --max-events 10 --input /store/mc/Run3Winter24Digi/TT_TuneCP5_13p6TeV_powheg-pythia8/GEN-SIM-RAW/133X_mcRun3_2024_realistic_v8-v2/80000/dc984f7f-2e54-48c4-8950-5daa848b6db9.root --customise HLTrigger/Configuration/customizeHLTforAlpaka.customizeHLTforAlpaka

And also by merging #43958 and running workflow 12434.423

FYI @jsamudio @hatakeyamak

[cmsbuild]

A new Pull Request was created by @waredjeb (Wahid Redjeb) for CMSSW_14_0_X.

It involves the following packages:

• HLTrigger/Configuration (hlt)

@cmsbuild, @mmusich, @Martin-Grunewald can you please review it and eventually sign? Thanks.
@silviodonato, @Martin-Grunewald, @missirol this is something you requested to watch as well.
@antoniovilela, @sextonkennedy, @rappoccio you are the release manager for this.

cms-bot commands are listed here

• Backported from Add customize to include Alpaka HCal PF Clustering at HLT #43971

[cmsbuild]

cms-bot internal usage

[mmusich]

backport of #43971

[mmusich]

type pf

[mmusich]

And also by merging #43701 and running workflow 12434.423

is there a backport of this too?

[waredjeb]

And also by merging #43701 and running workflow 12434.423

is there a backport of this too?

Yes: #43958

[mmusich]

Yes: #43958

please amend the PR description then.

[mmusich]

enable gpu

[mmusich]

test parameters:

• workflow_opts_gpu= -w upgrade
• workflows_gpu= 12434.423

[mmusich]

will trigger test here only once #43971 (comment) is clarified.

[cmsbuild]

Pull request #43979 was updated. @mmusich, @Martin-Grunewald, @cmsbuild can you please check and sign again.

[mmusich]

@cmsbuild, please test

[mmusich]

@cmsbuild, please abort

• needs [14.0.X] Introduce HCAL only workflows using Alpaka-based PF clustering #43958 in an IB.

[mmusich]

please test

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-26f5d9/37514/summary.html
COMMIT: 28e9220
CMSSW: CMSSW_14_0_X_2024-02-15-2300/el8_amd64_gcc12
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/43979/37514/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

• You potentially added 90 lines to the logs
• Reco comparison results: 51 differences found in the comparisons
• DQMHistoTests: Total files compared: 48
• DQMHistoTests: Total histograms compared: 3248626
• DQMHistoTests: Total failures: 9
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3248595
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
• Checked 200 log files, 161 edm output root files, 48 DQM output files
• TriggerResults: no differences found

GPU Comparison Summary

Summary:

• No significant changes to the logs found
• Reco comparison results: 35 differences found in the comparisons
• DQMHistoTests: Total files compared: 4
• DQMHistoTests: Total histograms compared: 40949
• DQMHistoTests: Total failures: 1151
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 39798
• DQMHistoTests: Total skipped: 0
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 3 files compared)
• Checked 12 log files, 15 edm output root files, 4 DQM output files
• TriggerResults: found differences in 1 / 3 workflows

[Martin-Grunewald]

+1

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next CMSSW_14_0_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_14_1_X is complete. This pull request will now be reviewed by the release team before it's merged. @antoniovilela, @rappoccio, @sextonkennedy (and backports should be raised in the release meeting by the corresponding L2)

[antoniovilela]

+1

• Fast-track merging of backport for 14_0_0 build.