Getting Started¶

Setting up directories¶

To run an MLy-Pipeline search we need a directory structure that will be used by the features of the pipeline. To make the creation of such directory structure easy we have a command automate the creation for us. Assumimg that there is a local MLy-Pipeline installation (located at ./mlyPipeline) we can create the directory structure by simply typing:

python ./mlyPipeline/initialisation.py -p ./mysearch

This will create the directory ./mysearch and also the following subdirectories:

triggerplot_directory

trigger_directory

output_directory

masterDirectory

bufferDirectory

falseAlarmRates

efficiencies

In addition to that it will also create a config file and bash script called runall.sh. This script is the only thing that you need to run from inside the ./mysearch directory for the search to comence. The config file is a .json file that has parameters that used by the search. It is up to the user to change those parameters to conduct the search the way they want.

Directory¶

The search functionality needs a provision of real-time data (data that become available in real time) from a predefined directory. This directory needs to be accessible directly from the location where the search scripts will be running. Usually the real-time data directory is located in the CIT LIGO cluster and we will use it as the default place to run the search. For more information about how to access it see here. Also note that sometimes those directories might be visible but not recieving the data. So make sure you are also running on the right node (in our case that was pcdev2)

Environment¶

MLy-Pipeline and MLy need a series of python packages and authentications. We summarasided all those dependences into one conda enviroment that you can sourse using the following command:

conda activate /home/vasileios.skliris/.conda/envs/igwn-keras2

Otherwise you can always clone it to your user directory, into your conda enviroements and activate it when it is ready:

conda create --name /home/vasileios.skliris/.conda/envs/igwn-keras2 --clone <your_env_name>
conda activate <your_env_name>

MLy installation¶

MLy-Pipeline uses MLy to run its routines. You need an installation of MLy (not included in the enviroment yet). Clone MLy in your local directory /home/albert.einstein, using the following command:

git clone git@git.ligo.org:mly/mly.git

Or if you haven’t set an ssh key yet use:

git clone https://git.ligo.org/mly/mly.git

Installation of MLy-pipeline¶

Finally, now you are ready to install MLy-pipeline. As before, you will have to clone the git repository of the pipeline:

git clone git@git.ligo.org:mly/o3-replay-online-search.git