fff_dqmtools

fff_dqmtools aka DQM^2.

Twiki with more information here.

Building a package

Note

The makerpm.sh script will only work on RHEL-like OSes (e.g. an RHEL8 OpenStack VM). To run this script you will need to install rpmdevtools and rpmlint.

• Create a RPM by executing ./utils/makerpm.sh in the repository's root folder.

Installation

• For the manual installation at P5, copy the source code and the built package and then execute: ./utils/install.py --remote <machine_name> in the respository's root folder. This installation will be undone by puppet days/months later.

• To update all of the DQM machines at once, the dropbox could be used (you will need to be in the appropriate *_librarian group):

  ssh cmsdropboxcc8.cms
  sudo dropbox2 -z cms -o cc8 -s dqm -u /folder/with/fff_dqmtools/

[!INFO] Once the operation completes, you will receive a report of what machines were updated.

DQM^2 worflows

To update DQM^2 DB with client info

Create JSON report files in:

fff_dqmtools/applets/analyze_files.py

Line 100 in a62a1a3

def make_report(self, backlog=5):

Then read JSONs in folder:

fff_dqmtools/applets/fff_filemonitor.py

Line 181 in a62a1a3

def process_dir(self):

And upload with http:

fff_dqmtools/applets/fff_filemonitor.py

Line 82 in a62a1a3

def http_upload(lst_gen, port, log=None, test_webserver=False):

To be catched with web client:

fff_dqmtools/applets/fff_web.py

Line 462 in a62a1a3

def upload():

And saved to DB:

fff_dqmtools/applets/fff_web.py

Line 148 in a62a1a3

def direct_transactional_upload(self, bodydoc_generator):