v5.4

Updates base container to Fedora 40:

• Software is now compiled with GCC 14.
• Python version is now 3.12

Updates

• Add nctfp for FTP downloads.
• Big cleanup of container recipes (@AlexKurek).
• Increased verbosity in debug builds.
• Update AOFlagger to bdf03b28.
• Update casacore 3.5.0 -> 3.6.1.
• Update create_ms_list.py for updated ddf options (@lonbar).
• Update CUDA 12.3 -> 12.6
• Update DDFacet to 5cec4db.
• Update DP3 v6.2 -> 48e75b34.
• Update Dysco 2e7f331 -> 682fe5.
• Update EveryBeam to 65685cba.
• Update HDF5 to 1.14.5
• Update IDG 011687ed -> 2af6f285.
• Update killMS to v3.2.0.
• Update python-casacore 3.5.0 -> 3.6.1.
• Update OpenBLAS v0.3.22 -> v0.3.28.
• Update WSClean v3.5 -> 443bd576.

Notes

• MKL temporarily disabled for IDG in favour of upgrading IDG to the latest version.
• Wget is now at version 2, meaning no FTP support anymore. Use ncftpget instead.

v5.3.1

This is the final release with fedora 38, as it is EOL.

Updates

• Add cx_Oracle Python package.
• Add Oracle Instant Client
• DNF installs common to all both recipes are now (mostly) consolidated into a single file.

Fixes

• Fix installation of sub_sources_outside_region.py.
• Fix h5py installation.
• Fix LSMTool installation.

v5.3.0

Python 3.8 reaches end-of-life in October 2024, therefore this release drops support for it.

Updates

• Add VLBI-cwl to the container.
• Add libaio
• Add ripgrep.
• Add scikit-build.
• Add torch.
• Add option for local flocs directory to runners.
• Drop support for Python 3.8.
• Install RMextract from PyPI.
• Update DP3 to v6.2
• Update WSClean to v3.5

Fixes

• Fix h5py installation (reported by @cristina-star)
• Fix LOFAR LTA client installation (reported by @cristina-star)
• Fix build due to old setuptools (reported by @mat-ole)

5.2.0

Updates

• Add Dask[full] Python package.
• Add statsmodels Python package.
• Added LINC and LOFAR-VLBI to the containers (mainly intended as mount points for local versions) to facilitate Toil usage.
• Update DP3 to 930b81f8
• Update EveryBeam to df937562
• Update LOFAR-H5plot to v2.9.1
• Update WSClean to 7efb5092
• Upgrade HDF5 to 1.14.3

Fixes

• Added -e option for split directions runner.
• Fixed RFI strategy parameter for LINC JSON generator.

5.1.0

Updates

• Added breizorro.
• Added lofarsun.
• Added LoSiTo.
• Added SunPy.
• Added jupyter lab.
• Added LOFAR LTA client.
• Added PyMultiNest.
• Added support for the subtract workflow in the LOFAR-VLBI pipeline.
• Automatically bind data and runtime directories if a container is used.

Fixes

• Fixed boolean parsing in create_ms_list.py.
• Fix DDFacet CPU allocation for Slurm.
• Fix ms list creation arguments VLBI delay calibration runner.
• Fix demix argument type for LINC configs.
• Fix spurious apostrophes in some runners.
• Removed unnecessary sed in vlbi runners.

5.0.0

Base container updated to Fedora 38

Updates

• Add altair and polars Python packages.
• Refactored create_ms_list.py to be more flexible (not backwards compatible with older versions).
• Update ddf-pipeline to 72e5285.
• Update DDFacet to v0.7.2.
• Update DP3 to 4df56d1f.
• Update EveryBeam to d52668ec.
• Update LOFAR H5plot to 2.8.1.
• Update IDG to 011687ed.
• Update WSClean to 843f87c8.

Fixes

• Split-Directions runner now clones the master branch again.

4.5.0

Container will now follow flocs naming scheme: flocs_vx.Y.Z_<march>_<mtune>_{mkl/aocl}[_cuda].sif

Updates

• Add bc
• Add missing --min_unflagged_fraction option to create_ms_list.py.
• Add lotss-hba-survey scripts.
• Add rename_MS_from_LTA.sh for renaming files downloaded from the LTA through wget.
• Add extract_MS_and_compress.sh to extract MS tarballs, dysco compress them and remove the full resolution flags.
• Add example for the Split-Directions workflow as run_lofar-vlbi-split-directions.sh.
• create_ms_list.py will now check frequency coverage between LINC calibrator and target.
• Downgrade DP3 back to 161559ff to make DD solints work with model columns.
• Renamed run_lofar-vlbi.sh example to run_lofar-vlbi-delay-calibration.sh.
• Replace sub-sources-outside-region.py with facetselfcal version.
• Set the unflagged fraction limit for LINC to 5% in the example runner, because 50% is annoying.
• Update example runners to produce cleaner output. Temporary directory will now be renamed to L<obsid>_<pipeline> after a run, e.g. L123456_LINC_calibrator.
• Update ddf-pipeline to 712618b.
• Update LOFAR H5plot to 2.8.0.

Fixes

• Fix filter_baselines argument in LINC calibrator runner.
• Fix missing calibrator solutions argument in LINC target runner.
• Fix running LINC target without container.
• Fix some issues when using the runners without container argument.
• Include DP3 aoflagger update required to run delay calibration.

LOFAR_SKSP 4.4.0

Updates

• Add SciencePlots Python package.
• Fix default baseline selection for LINC target.
• Custom LINC runners are now included, intended to be mildly user friendly and require no editing of scripts for default runs. See run_LINC_calibrator.sh -h and run_LINC_target.sh -h.
• Experimental VLBI-cwl runner included. See run_lofar-vlbi.sh -h.
• Update DP3 to 161559ff.
• Update EveryBeam to 22cd113b.
• Update WSClean to a5b4e037.

Fixes

• Do not remove lofarstman after installation.

LOFAR_SKSP 4.3.1

Updates

• Add bces, bilby, nmmn, numdifftools and pymultinest
• Add nomacs image viewer
• Add LINC concatenation averageing options to create_mslist.py
• Clean up lofar-vlbi runner
• Update python-casacore to 3.5.2

LOFAR_SKSP 4.3.0

Updates

• Add RM-Tools
• Add shadeMS
• Update AOCL to version 4
• Update create_mslist.py to include all LINC settings.
• Update DP3 to 161559ff
• Update EveryBeam to 22cd113b (support for MeerKAT beam)
• Update OpenBLAS to v0.3.22
• Update Toil to 5.10
• Update WSClean to 1c1c1d73 (support for MeerKAT beam)

Fixes

• Added missing MKL library path.
• Clean up LINC runners.
• Fix ddf-pipeline boostrap crash.