Research

Scale tests of the new DUNE data pipeline

DOE

Source: doe_osti

Questions this answers

Sources

Source record

The underlying research record — supporting evidence for the object above.

Key Details

Posted Date
Source
doe_osti

Description

In preparation for the second runs of the ProtoDUNE detectors at CERN (NP02 and NP04)[1], DUNE has established a new data pipeline for bringing the data from the EHN-1 experimental hall at CERN to primary tape storage at Fermilab and CERN, and then spreading it out to a distributed disk data store at many locations around the world. This system includes a new Ingest Daemon and a new Declaration Daemon. The Rucio[2] replica catalog, and FTS3 transport are used to transport all files. All file metadata is declared to the new MetaCat[3] metadata service. All of these new components have been successfully tested at a scale equal to the expected output of the detector data acquisition system (~2-4 GB/s), and the expected network bandwidth out of the experimental hall. We present the procedure that was used to test and the results of the test.. Authors: Timm, Steven [Fermilab] (ORCID:0000000226151910). DOE Contract: AC02-07CH11359

Frequently Asked Questions

What is this record?+
It is a publication associated with DOE — published findings, a technical standard, or a notice. It reports results or specifications. There is nothing here to apply for.

Where this record sits

What else do you want to know?

100M+ government records — search across all categories