Setting up a fddaq‐v5.2.0 software area - DUNE-DAQ/daqconf GitHub Wiki

13-Nov-2024 - 🔺 Work in progress! 🔺 Steps 1-8 in the first section have been verified to work. The Reference Information, and the remaining sections, will be (re)verified soon.

Reference information:

• general development: software development workflow, DUNE DAQ Software Style Guide
• suggested Spack commands to learn about the characteristics of an existing software area are available here
• an introduction to the "assets" system, which we use to store files that are not code, is here
• testing: NP04 computer inventory
• other: Working Group task lists, List of DUNE-DAQ GitHub teams and repos
• Main grafana dashboard
• Tag Collector
• OKS System Description
• DBE Editor Documentation
• Generate Configuration Diagrams

Here are the suggested steps:

1. create a new software area based on the release build (see step 1.v for the exact dbt-create command to use)

   1. The steps for this are based on the latest instructions for daq-buildtools

   2. As always, you should verify that your computer has access to /cvmfs/dunedaq.opensciencegrid.org

   3. If you are using one of the np04daq computers, and need to interact with GitHub servers (e.g clone packages), add the following lines to your $HOME/.gitconfig file. (Once you do this, there will be no need to activate the web proxy each time you want to run a git command that talks to the GitHub servers, and this means that you won't forget to disable it before running drunc...):

      [http]
        proxy = http://np04-web-proxy.cern.ch:3128
        sslVerify = false
      

   4. If you are using one of the np04daq computers, and need to install python packages into your python virtual environment using pip install, add the following lines to your $HOME/.config/pip/pip.conf file. (Once you do this, there will be no need to activate the web proxy each time you want to install a python package, and this means that you won't forget to disable it before running drunc...):

      [global]
        proxy = http://np04-web-proxy.cern.ch:3128
      

   5. Here are the steps for creating the new software area:

      cd <directory_above_where_you_want_the_new_software_area>
      source /cvmfs/dunedaq.opensciencegrid.org/setup_dunedaq.sh
      setup_dbt latest_v5
      dbt-create fddaq-v5.2.0-a9 [work_dir_name]  # work_dir_name is optional
      cd <work_dir_name if you specified one, or fddaq-v5.2.0-a9 otherwise>
      # or dbt-setup-release fddaq-v5.2.0-a9
      

   6. Please note that if you are following these instructions on a computer on which the DUNE-DAQ software has never been run before, there are several system packages that may need to be installed on that computer. These are mentioned in this script. To check whether a particular one is already installed, you can use a command like yum list libzstd and check whether the package is listed under Installed Packages.

2. add any desired repositories to the /sourcecode area. Some examples are provided in this section.

   1. clone the repositories (the following block has some extra directory checking; it can all be copy/pasted into your shell window)

      # change directory to the "sourcecode" subdir, if possible and needed
      if [[ -d "sourcecode" ]]; then
          cd sourcecode
      fi
      # double-check that we're in the correct subdir
      current_subdir=`echo ${PWD} | xargs basename`
      if [[ "$current_subdir" != "sourcecode" ]]; then
          echo ""
          echo "*** Current working directory is not \"sourcecode\", skipping repo clones"
      else
          # finally, do the repo clone(s)
          git clone https://github.com/DUNE-DAQ/daqsystemtest.git -b fddaq-v5.2.0
          cd ..
      fi
      
      

3. setup the work area and build the software. NB: even if you haven't checked out any packages the dbt-build is necessary to install the rte script passed to the applications started by drunc

   source env.sh
   dbt-build -j 20
   dbt-workarea-env
   

4. Set the ConnectivityService port in your local copy of the example configurations to a random available port number. This helps avoids conflicts between users running example systems on the same computer at the same time.

   daqconf_set_connectivity_service_port local-1x1-config config/daqsystemtest/example-configs.data.xml
   

5. The daqsystemtest repository contains a sample configuration for a small test system. It can be exercised using the following steps:

   # Modify your local copy of the example configs to have a randomly-generated (and therefore hopefully
   # reasonably unique) port number for the ConnectivityService.  This will help avoid collisions between users
   # running these examples at the same time on the same computer.
   <instructions for how to do this will be coming soon!>
   
   # from your Linux shell command line...
   drunc-unified-shell ssh-standalone config/daqsystemtest/example-configs.data.xml local-1x1-config
   
   # from within the drunc shell...
   # Note that it is best to use a different run number each time that you "start".
   boot --no-override-logs
   conf
   start 101
   enable-triggers
   # wait for a few seconds
   disable-triggers
   drain-dataflow
   stop-trigger-sources
   stop
   scrap
   terminate
   exit
   
   # Or, you can run everything in one Linux shell command:
   drunc-unified-shell ssh-standalone config/daqsystemtest/example-configs.data.xml local-1x1-config boot --no-override-logs wait 5 conf wait 3 start 101 enable-triggers wait 10 disable-triggers drain-dataflow stop-trigger-sources stop scrap terminate
   
   # after you exit `drunc`, you should wait for several seconds for controller processes to exit before starting another session
   

6. dfmodules contains unit tests which have been updated to use OKS, they can be run with

   dbt-unittest-summary.sh
   

7. Integration tests can be run straight from the release with

   pytest -s ${DAQSYSTEMTEST_SHARE}/integtest/minimal_system_quick_test.py
   

8. If developing drunc or druncschema, after these are cloned run pip install in the corresponding sourcecode subdirectories. Run dbt-workarea-env in the root of the working directory.

9. When you return to working with the software area after logging out, the steps that you'll need to redo are the following:

   cd <work_dir>
   source ./env.sh
   dbt-build  # if needed
   dbt-workarea-env  # if needed
   

• dbt-info release # prints out the release type and name, and the base release name (version)
• dbt-info package <dunedaq_package_name> # prints out the package version and commit hash used by the release
• dbt-info sourcecode # prints out the branch names of source repos under sourcecode, and marks those with local changes with "*"
• spack find --loaded -N <external_package_name>, e.g. spack find --loaded -N boost # prints out the version of the specified external package that is in use in the current software area
• spack info fddaq # prints out the packages that are included in the fddaq bundle for the current software area
• spack info coredaq # prints out the packages that are included in the coredaq (common) bundle for the current software area

Also see here.

This utility can be used to print out information from the HDF5 raw data files. To invoke it use

• HDF5LIBS_TestDumpRecord <filename>

h5dump-shared -H <filename>

This is another use of the h5dump-shared utility. This case uses the following command-line arguments:

• the HDF5 path of the block we want to dump (-d )
• the output binary file name (-o <output_file>)
• the HDF5 file to be dumped

An example is:

h5dump-shared -d /TriggerRecord00001.0000/RawData/Detector_Readout_0x00000064_WIBEth -
bLE -o dataset1.bin test_raw_run001041_0000_df-01_dw_0_20241113T163255.hdf5

Once you have the binary file, you can examine it with tools like Linux od (octal dump), for example

od -x dataset1.bin

There are several integration tests available in the integtest directory of the daqsystemtest package. To run them, we suggest adding the daqsystemtest package to your software area (if not already done), cd $DBT_AREA_ROOT/sourcecode/daqsystemtest/integtest, and cat the README file to view the suggestions listed within it. To run a test, type

pytest -s <test_name>

For example,

pytest -s minimal_system_quick_test.py

When running with drunc, metrics reports appear in the info_*.json files that are produced, one for each application (e.g. info_df-01.json). We can collate these, grouped by metric name, using python -m opmonlib.info_file_collator info_*.json (default output file is opmon_collated.json).

It is also possible to monitor the system using a graphic interface.