Cobaya: running parallel chains

Use of Healpix, camb, CLASS, cosmomc, compilers, etc.
Post Reply
Tanvi Karwal
Posts: 6
Joined: April 10 2020
Affiliation: University of Pennsylvania

Cobaya: running parallel chains

Post by Tanvi Karwal » May 11 2020

Hello,

I'm having trouble running parallel chains with Cobaya. I'm using the latest Cobaya devel version from the github, a modified version of CLASS 2.9, running with Planck 2018, Pantheon SNe, BAO and H0 from Riess-19.

I want to run 8 chains in parallel with cobaya. While my job output file has 8 copies of all output (shown below), all chain data is written into just one .txt file (i.e. <output_file_name>.1.txt) and my runs are rather slow (LCDM on the above datasets has already taken >3 days and convergence is at R-1 ~0.13).

Using cobaya version 2.1.0, Python 3.7.6, mpirun (Open MPI) 3.1.4.

My slurm-based job script includes the commands:

Code: Select all

#SBATCH --nodes=1
#SBATCH --ntasks-per-node=8
# number of cpus (threads) per task (process)
# #SBATCH --cpus-per-task=4

module load gcc/8.3.1
module load openmpi/3.1.4-gcc-8.3.1

# to use anaconda python 3
source /home/karwal/.bashrc

cd /home/karwal
source /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/bin/clik_profile.sh
cd mcmc_runs/planck2018_bao_pantheon/

mpirun -np 8 cobaya-run planck2018_bao_pantheon.yaml
and my job output looks like:

Code: Select all

[output_mpi] Output to be read-from/written-into folder 'chains', with prefix 'class_2.9_planck_bao_pantheon_bf_'
[output_mpi] Output to be read-from/written-into folder 'chains', with prefix 'class_2.9_planck_bao_pantheon_bf_'
[output_mpi] Output to be read-from/written-into folder 'chains', with prefix 'class_2.9_planck_bao_pantheon_bf_'
[output_mpi] Output to be read-from/written-into folder 'chains', with prefix 'class_2.9_planck_bao_pantheon_bf_'
[output_mpi] Output to be read-from/written-into folder 'chains', with prefix 'class_2.9_planck_bao_pantheon_bf_'
[output_mpi] Output to be read-from/written-into folder 'chains', with prefix 'class_2.9_planck_bao_pantheon_bf_'
[output_mpi] Output to be read-from/written-into folder 'chains', with prefix 'class_2.9_planck_bao_pantheon_bf_'
[output_mpi] Output to be read-from/written-into folder 'chains', with prefix 'class_2.9_planck_bao_pantheon_bf_'
[prior] *WARNING* External prior 'SZ' loaded. Mind that it might not be normalized!
[prior] *WARNING* External prior 'SZ' loaded. Mind that it might not be normalized!
[prior] *WARNING* External prior 'SZ' loaded. Mind that it might not be normalized!
[classy] Importing *local* classy from /home/karwal/class_gdm/
[classy] Importing *local* classy from /home/karwal/class_gdm/
[classy] Importing *local* classy from /home/karwal/class_gdm/
[planck_2018_lowl.tt] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
[planck_2018_lowl.tt] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
[planck_2018_lowl.tt] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
[prior] *WARNING* External prior 'SZ' loaded. Mind that it might not be normalized!
[prior] *WARNING* External prior 'SZ' loaded. Mind that it might not be normalized!
[prior] *WARNING* External prior 'SZ' loaded. Mind that it might not be normalized!
[prior] *WARNING* External prior 'SZ' loaded. Mind that it might not be normalized!
[classy] Importing *local* classy from /home/karwal/class_gdm/
[classy] Importing *local* classy from /home/karwal/class_gdm/
[classy] Importing *local* classy from /home/karwal/class_gdm/
[classy] Importing *local* classy from /home/karwal/class_gdm/
[planck_2018_lowl.tt] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
[planck_2018_lowl.tt] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
[planck_2018_lowl.tt] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
[planck_2018_lowl.tt] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
----
clik version 3be036bbb4f9
  gibbs_gauss b13c8fda-1837-41b5-ae2d-78d6b723fcf1
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/low_l/commander/commander_dx12_v3_2_29.clik' on test data. got -11.6257 expected -11.6257 (diff -1.07424e-09)
----
[planck_2018_lowl.ee] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
Initializing SimAll
----
clik version 3be036bbb4f9
  gibbs_gauss b13c8fda-1837-41b5-ae2d-78d6b723fcf1
----
clik version 3be036bbb4f9
  gibbs_gauss b13c8fda-1837-41b5-ae2d-78d6b723fcf1
----
clik version 3be036bbb4f9
  gibbs_gauss b13c8fda-1837-41b5-ae2d-78d6b723fcf1
----
clik version 3be036bbb4f9
  gibbs_gauss b13c8fda-1837-41b5-ae2d-78d6b723fcf1
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/low_l/commander/commander_dx12_v3_2_29.clik' on test data. got -11.6257 expected -11.6257 (diff -1.07424e-09)
----
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/low_l/commander/commander_dx12_v3_2_29.clik' on test data. got -11.6257 expected -11.6257 (diff -1.07424e-09)
----
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/low_l/commander/commander_dx12_v3_2_29.clik' on test data. got -11.6257 expected -11.6257 (diff -1.07424e-09)
----
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/low_l/commander/commander_dx12_v3_2_29.clik' on test data. got -11.6257 expected -11.6257 (diff -1.07424e-09)
----
----
clik version 3be036bbb4f9
  simall simall_EE_BB_TE
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/low_l/simall/simall_100x143_offlike5_EE_Aplanck_B.clik' on test data. got -197.99 expected -197.99 (diff -4.1778e-08)
----
[planck_2018_highl_plik.ttteee] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
[planck_2018_lowl.ee] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
[planck_2018_lowl.ee] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
[planck_2018_lowl.ee] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
[planck_2018_lowl.ee] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
Initializing SimAll
Initializing SimAll
Initializing SimAll
Initializing SimAll
----
clik version 3be036bbb4f9
  simall simall_EE_BB_TE
----
clik version 3be036bbb4f9
  simall simall_EE_BB_TE
----
clik version 3be036bbb4f9
  simall simall_EE_BB_TE
----
clik version 3be036bbb4f9
  simall simall_EE_BB_TE
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/low_l/simall/simall_100x143_offlike5_EE_Aplanck_B.clik' on test data. got -197.99 expected -197.99 (diff -4.1778e-08)
----
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/low_l/simall/simall_100x143_offlike5_EE_Aplanck_B.clik' on test data. got -197.99 expected -197.99 (diff -4.1778e-08)
----
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/low_l/simall/simall_100x143_offlike5_EE_Aplanck_B.clik' on test data. got -197.99 expected -197.99 (diff -4.1778e-08)
----
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/low_l/simall/simall_100x143_offlike5_EE_Aplanck_B.clik' on test data. got -197.99 expected -197.99 (diff -4.1778e-08)
----
[planck_2018_highl_plik.ttteee] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
[planck_2018_highl_plik.ttteee] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
[planck_2018_highl_plik.ttteee] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
[planck_2018_highl_plik.ttteee] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
----
clik version 3be036bbb4f9
  gibbs_gauss b13c8fda-1837-41b5-ae2d-78d6b723fcf1
----
clik version 3be036bbb4f9
  gibbs_gauss b13c8fda-1837-41b5-ae2d-78d6b723fcf1
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/low_l/commander/commander_dx12_v3_2_29.clik' on test data. got -11.6257 expected -11.6257 (diff -1.07424e-09)
----
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/low_l/commander/commander_dx12_v3_2_29.clik' on test data. got -11.6257 expected -11.6257 (diff -1.07424e-09)
----
[planck_2018_lowl.ee] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
[planck_2018_lowl.ee] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
Initializing SimAll
Initializing SimAll
----
clik version 3be036bbb4f9
  simall simall_EE_BB_TE
----
clik version 3be036bbb4f9
  simall simall_EE_BB_TE
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/low_l/simall/simall_100x143_offlike5_EE_Aplanck_B.clik' on test data. got -197.99 expected -197.99 (diff -4.1778e-08)
----
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/low_l/simall/simall_100x143_offlike5_EE_Aplanck_B.clik' on test data. got -197.99 expected -197.99 (diff -4.1778e-08)
----
[planck_2018_highl_plik.ttteee] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
[planck_2018_highl_plik.ttteee] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
[prior] *WARNING* External prior 'SZ' loaded. Mind that it might not be normalized!
[classy] Importing *local* classy from /home/karwal/class_gdm/
[planck_2018_lowl.tt] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
----
clik version 3be036bbb4f9
  smica
----
clik version 3be036bbb4f9
  smica
----
clik version 3be036bbb4f9
  smica
----
clik version 3be036bbb4f9
  smica
----
clik version 3be036bbb4f9
  smica
----
clik version 3be036bbb4f9
  smica
----
clik version 3be036bbb4f9
  smica
----
clik version 3be036bbb4f9
  gibbs_gauss b13c8fda-1837-41b5-ae2d-78d6b723fcf1
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/low_l/commander/commander_dx12_v3_2_29.clik' on test data. got -11.6257 expected -11.6257 (diff -1.07424e-09)
----
[planck_2018_lowl.ee] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
Initializing SimAll
----
clik version 3be036bbb4f9
  simall simall_EE_BB_TE
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/low_l/simall/simall_100x143_offlike5_EE_Aplanck_B.clik' on test data. got -197.99 expected -197.99 (diff -4.1778e-08)
----
[planck_2018_highl_plik.ttteee] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/hi_l/plik/plik_rd12_HM_v22b_TTTEEE.clik' on test data. got -1172.47 expected -1172.47 (diff -4.34054e-07)
----
[planck_2018_lensing.clik] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
Checking lensing likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/lensing/smicadx12_Dec5_ftl_mv2_ndclpp_p_teb_consext8.clik_lensing' on test data. got -4.42102
[bao.sixdf_2011_bao] Initialising.
[numexpr.utils] Note: NumExpr detected 40 cores but "NUMEXPR_MAX_THREADS" not set, so enforcing safe limit of 8.
[numexpr.utils] NumExpr defaulting to 8 threads.
[bao.sdss_dr7_mgs] Initialising.
[bao.sdss_dr12_consensus_bao] Initialising.
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/hi_l/plik/plik_rd12_HM_v22b_TTTEEE.clik' on test data. got -1172.47 expected -1172.47 (diff -4.34055e-07)
----
[planck_2018_lensing.clik] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
Checking lensing likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/lensing/smicadx12_Dec5_ftl_mv2_ndclpp_p_teb_consext8.clik_lensing' on test data. got -4.42102
[bao.sixdf_2011_bao] Initialising.
[numexpr.utils] Note: NumExpr detected 40 cores but "NUMEXPR_MAX_THREADS" not set, so enforcing safe limit of 8.
[numexpr.utils] NumExpr defaulting to 8 threads.
[bao.sdss_dr7_mgs] Initialising.
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/hi_l/plik/plik_rd12_HM_v22b_TTTEEE.clik' on test data. got -1172.47 expected -1172.47 (diff -4.34055e-07)
----
[planck_2018_lensing.clik] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
[bao.sdss_dr12_consensus_bao] Initialising.
Checking lensing likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/lensing/smicadx12_Dec5_ftl_mv2_ndclpp_p_teb_consext8.clik_lensing' on test data. got -4.42102
[bao.sixdf_2011_bao] Initialising.
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/hi_l/plik/plik_rd12_HM_v22b_TTTEEE.clik' on test data. got -1172.47 expected -1172.47 (diff -4.34055e-07)
----
[planck_2018_lensing.clik] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/hi_l/plik/plik_rd12_HM_v22b_TTTEEE.clik' on test data. got -1172.47 expected -1172.47 (diff -4.34054e-07)
----
[planck_2018_lensing.clik] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
Checking lensing likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/lensing/smicadx12_Dec5_ftl_mv2_ndclpp_p_teb_consext8.clik_lensing' on test data. got -4.42102
[bao.sixdf_2011_bao] Initialising.
[numexpr.utils] Note: NumExpr detected 40 cores but "NUMEXPR_MAX_THREADS" not set, so enforcing safe limit of 8.
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/hi_l/plik/plik_rd12_HM_v22b_TTTEEE.clik' on test data. got -1172.47 expected -1172.47 (diff -4.34055e-07)
----[numexpr.utils] NumExpr defaulting to 8 threads.

[planck_2018_lensing.clik] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
Checking lensing likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/lensing/smicadx12_Dec5_ftl_mv2_ndclpp_p_teb_consext8.clik_lensing' on test data. got -4.42102
[bao.sixdf_2011_bao] Initialising.
[bao.sdss_dr7_mgs] Initialising.
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/hi_l/plik/plik_rd12_HM_v22b_TTTEEE.clik' on test data. got -1172.47 expected -1172.47 (diff -4.34055e-07)
----
[planck_2018_lensing.clik] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
[numexpr.utils] Note: NumExpr detected 40 cores but "NUMEXPR_MAX_THREADS" not set, so enforcing safe limit of 8.
[numexpr.utils] NumExpr defaulting to 8 threads.
[bao.sdss_dr7_mgs] Initialising.
[bao.sdss_dr12_consensus_bao] Initialising.
Checking lensing likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/lensing/smicadx12_Dec5_ftl_mv2_ndclpp_p_teb_consext8.clik_lensing' on test data. got -4.42102
[bao.sixdf_2011_bao] Initialising.
[bao.sdss_dr12_consensus_bao] Initialising.
Checking lensing likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/lensing/smicadx12_Dec5_ftl_mv2_ndclpp_p_teb_consext8.clik_lensing' on test data. got -4.42102
[bao.sixdf_2011_bao] Initialising.
[numexpr.utils] Note: NumExpr detected 40 cores but "NUMEXPR_MAX_THREADS" not set, so enforcing safe limit of 8.
[numexpr.utils] NumExpr defaulting to 8 threads.
[bao.sdss_dr7_mgs] Initialising.
[numexpr.utils] Note: NumExpr detected 40 cores but "NUMEXPR_MAX_THREADS" not set, so enforcing safe limit of 8.
[numexpr.utils] NumExpr defaulting to 8 threads.
[bao.sdss_dr7_mgs] Initialising.
[bao.sdss_dr12_consensus_bao] Initialising.
[bao.sdss_dr12_consensus_bao] Initialising.
[numexpr.utils] Note: NumExpr detected 40 cores but "NUMEXPR_MAX_THREADS" not set, so enforcing safe limit of 8.
[numexpr.utils] NumExpr defaulting to 8 threads.
[bao.sdss_dr7_mgs] Initialising.
[bao.sdss_dr12_consensus_bao] Initialising.
----
clik version 3be036bbb4f9
  smica
Checking likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/hi_l/plik/plik_rd12_HM_v22b_TTTEEE.clik' on test data. got -1172.47 expected -1172.47 (diff -4.34054e-07)
----
[planck_2018_lensing.clik] Importing clik from /home/karwal/Planck_2018/code/plc_3.0/plc-3.01/
Checking lensing likelihood '/home/karwal/Planck_2018/baseline/plc_3.0/lensing/smicadx12_Dec5_ftl_mv2_ndclpp_p_teb_consext8.clik_lensing' on test data. got -4.42102
[bao.sixdf_2011_bao] Initialising.
[numexpr.utils] Note: NumExpr detected 40 cores but "NUMEXPR_MAX_THREADS" not set, so enforcing safe limit of 8.
[numexpr.utils] NumExpr defaulting to 8 threads.
[bao.sdss_dr7_mgs] Initialising.
[bao.sdss_dr12_consensus_bao] Initialising.
[mcmc] Getting initial point... (this may take a few seconds)
[mcmc] Getting initial point... (this may take a few seconds)
[mcmc] Getting initial point... (this may take a few seconds)
[mcmc] Getting initial point... (this may take a few seconds)
[mcmc] Getting initial point... (this may take a few seconds)
[mcmc] Getting initial point... (this may take a few seconds)
[mcmc] Getting initial point... (this may take a few seconds)
[mcmc] Getting initial point... (this may take a few seconds)
[model] Measuring speeds... (this may take a few seconds)
[model] Measuring speeds... (this may take a few seconds)
[model] Measuring speeds... (this may take a few seconds)
[model] Measuring speeds... (this may take a few seconds)
[model] Measuring speeds... (this may take a few seconds)
[model] Measuring speeds... (this may take a few seconds)
[model] Measuring speeds... (this may take a few seconds)
[model] Measuring speeds... (this may take a few seconds)
[model] Setting measured speeds (per sec): {planck_2018_lowl.TT: 1160.0, planck_2018_lowl.EE: 4120.0, planck_2018_highl_plik.TTTEEE: 6.35, planck_2018_lensing.clik: 793.0, bao.sixdf_2011_bao: 2010.0, bao.sdss_dr7_mgs: 4650.0, bao.sdss_dr12_consensus_bao: 3980.0, sn.pantheon: 57.3, classy: 0.31}
[mcmc] Dragging with number of interpolating steps:
[mcmc] *  1 : [['logA', 'n_s', 'H0', 'omega_b', 'omega_cdm', 'tau_reio']]
[mcmc] * 10 : [['A_planck'], ['calib_100T', 'calib_217T', 'A_cib_217', 'xi_sz_cib', 'A_sz', 'ksz_norm', 'gal545_A_100', 'gal545_A_143', 'gal545_A_143_217', 'gal545_A_217', 'ps_A_100_100', 'ps_A_143_143', 'ps_A_143_217', 'ps_A_217_217', 'galf_TE_A_100', 'galf_TE_A_100_143', 'galf_TE_A_100_217', 'galf_TE_A_143', 'galf_TE_A_143_217', 'galf_TE_A_217']]
[mcmc] Covariance matrix loaded for params ['omega_b', 'omega_cdm', 'tau_reio', 'logA', 'n_s', 'A_planck', 'A_cib_217', 'xi_sz_cib', 'A_sz', 'ps_A_100_100', 'ps_A_143_143', 'ps_A_143_217', 'ps_A_217_217', 'ksz_norm', 'gal545_A_100', 'gal545_A_143', 'gal545_A_143_217', 'gal545_A_217', 'galf_TE_A_100', 'galf_TE_A_100_143', 'galf_TE_A_100_217', 'galf_TE_A_143', 'galf_TE_A_143_217', 'galf_TE_A_217', 'calib_100T', 'calib_217T']
[mcmc] Missing proposal covariance for params ['H0']
[mcmc] Covariance matrix not complete. We will start learning the covariance of the proposal earlier: R-1 = 30 (would be 2 if all params loaded).
[mcmc] Initial point: logA:3.04848, n_s:0.9687781, H0:68.08468, omega_b:0.02246575, omega_cdm:0.1186904, tau_reio:0.04843484, A_planck:1.002363, calib_100T:1.000995, calib_217T:1.001559, A_cib_217:67.37011, xi_sz_cib:0.08462953, A_sz:5.284399, ksz_norm:5.63676, gal545_A_100:7.440061, gal545_A_143:9.896562, gal545_A_143_217:19.19826, gal545_A_217:65.87489, ps_A_100_100:263.675, ps_A_143_143:38.05049, ps_A_143_217:36.47985, ps_A_217_217:105.1184, galf_TE_A_100:0.2295163, galf_TE_A_100_143:0.0697819, galf_TE_A_100_217:0.5970371, galf_TE_A_143:0.1692007, galf_TE_A_143_217:0.5382565, galf_TE_A_217:1.928028
[mcmc] Sampling!
[model] Setting measured speeds (per sec): {planck_2018_lowl.TT: 1140.0, planck_2018_lowl.EE: 4040.0, planck_2018_highl_plik.TTTEEE: 9.03, planck_2018_lensing.clik: 810.0, bao.sixdf_2011_bao: 1950.0, bao.sdss_dr7_mgs: 4610.0, bao.sdss_dr12_consensus_bao: 3770.0, sn.pantheon: 78.8, classy: 0.266}
[mcmc] Dragging with number of interpolating steps:
[mcmc] *  1 : [['logA', 'n_s', 'H0', 'omega_b', 'omega_cdm', 'tau_reio']]
[mcmc] * 14 : [['A_planck'], ['calib_100T', 'calib_217T', 'A_cib_217', 'xi_sz_cib', 'A_sz', 'ksz_norm', 'gal545_A_100', 'gal545_A_143', 'gal545_A_143_217', 'gal545_A_217', 'ps_A_100_100', 'ps_A_143_143', 'ps_A_143_217', 'ps_A_217_217', 'galf_TE_A_100', 'galf_TE_A_100_143', 'galf_TE_A_100_217', 'galf_TE_A_143', 'galf_TE_A_143_217', 'galf_TE_A_217']]
[mcmc] Covariance matrix loaded for params ['omega_b', 'omega_cdm', 'tau_reio', 'logA', 'n_s', 'A_planck', 'A_cib_217', 'xi_sz_cib', 'A_sz', 'ps_A_100_100', 'ps_A_143_143', 'ps_A_143_217', 'ps_A_217_217', 'ksz_norm', 'gal545_A_100', 'gal545_A_143', 'gal545_A_143_217', 'gal545_A_217', 'galf_TE_A_100', 'galf_TE_A_100_143', 'galf_TE_A_100_217', 'galf_TE_A_143', 'galf_TE_A_143_217', 'galf_TE_A_217', 'calib_100T', 'calib_217T']
[mcmc] Missing proposal covariance for params ['H0']
[mcmc] Covariance matrix not complete. We will start learning the covariance of the proposal earlier: R-1 = 30 (would be 2 if all params loaded).
[mcmc] Initial point: logA:3.049138, n_s:0.9654146, H0:68.69254, omega_b:0.02237297, omega_cdm:0.1208468, tau_reio:0.06155952, A_planck:0.9962657, calib_100T:0.999867, calib_217T:0.9987796, A_cib_217:69.70384, xi_sz_cib:0.1639786, A_sz:6.479643, ksz_norm:5.965317, gal545_A_100:9.122566, gal545_A_143:7.57729, gal545_A_143_217:18.35609, gal545_A_217:63.8683, ps_A_100_100:266.4325, ps_A_143_143:35.38891, ps_A_143_217:26.26979, ps_A_217_217:70.75745, galf_TE_A_100:0.2723436, galf_TE_A_100_143:-0.05193679, galf_TE_A_100_217:0.2711299, galf_TE_A_143:0.1408246, galf_TE_A_143_217:0.6248861, galf_TE_A_217:1.701553
[mcmc] Sampling!
[model] Setting measured speeds (per sec): {planck_2018_lowl.TT: 1600.0, planck_2018_lowl.EE: 4610.0, planck_2018_highl_plik.TTTEEE: 7.36, planck_2018_lensing.clik: 881.0, bao.sixdf_2011_bao: 2850.0, bao.sdss_dr7_mgs: 5630.0, bao.sdss_dr12_consensus_bao: 3980.0, sn.pantheon: 141.0, classy: 0.274}
[mcmc] Dragging with number of interpolating steps:
[mcmc] *  1 : [['logA', 'n_s', 'H0', 'omega_b', 'omega_cdm', 'tau_reio']]
[mcmc] * 10 : [['A_planck'], ['calib_100T', 'calib_217T', 'A_cib_217', 'xi_sz_cib', 'A_sz', 'ksz_norm', 'gal545_A_100', 'gal545_A_143', 'gal545_A_143_217', 'gal545_A_217', 'ps_A_100_100', 'ps_A_143_143', 'ps_A_143_217', 'ps_A_217_217', 'galf_TE_A_100', 'galf_TE_A_100_143', 'galf_TE_A_100_217', 'galf_TE_A_143', 'galf_TE_A_143_217', 'galf_TE_A_217']]
[mcmc] Covariance matrix loaded for params ['omega_b', 'omega_cdm', 'tau_reio', 'logA', 'n_s', 'A_planck', 'A_cib_217', 'xi_sz_cib', 'A_sz', 'ps_A_100_100', 'ps_A_143_143', 'ps_A_143_217', 'ps_A_217_217', 'ksz_norm', 'gal545_A_100', 'gal545_A_143', 'gal545_A_143_217', 'gal545_A_217', 'galf_TE_A_100', 'galf_TE_A_100_143', 'galf_TE_A_100_217', 'galf_TE_A_143', 'galf_TE_A_143_217', 'galf_TE_A_217', 'calib_100T', 'calib_217T']
[mcmc] Missing proposal covariance for params ['H0']
[mcmc] Covariance matrix not complete. We will start learning the covariance of the proposal earlier: R-1 = 30 (would be 2 if all params loaded).
[mcmc] Initial point: logA:3.048443, n_s:0.966664, H0:69.56761, omega_b:0.02240199, omega_cdm:0.1190076, tau_reio:0.04570036, A_planck:1.000105, calib_100T:1.000038, calib_217T:0.9956825, A_cib_217:78.29973, xi_sz_cib:0.2528361, A_sz:8.254604, ksz_norm:2.740994, gal545_A_100:7.121848, gal545_A_143:7.991087, gal545_A_143_217:20.80313, gal545_A_217:95.34046, ps_A_100_100:296.3016, ps_A_143_143:52.23909, ps_A_143_217:53.35309, ps_A_217_217:102.6363, galf_TE_A_100:0.1441718, galf_TE_A_100_143:0.190824, galf_TE_A_100_217:0.4227772, galf_TE_A_143:0.1740229, galf_TE_A_143_217:0.7251196, galf_TE_A_217:1.75673
[model] Setting measured speeds (per sec): {planck_2018_lowl.TT: 1800.0, planck_2018_lowl.EE: 4690.0, planck_2018_highl_plik.TTTEEE: 6.95, planck_2018_lensing.clik: 888.0, bao.sixdf_2011_bao: 2780.0, bao.sdss_dr7_mgs: 5690.0, bao.sdss_dr12_consensus_bao: 3990.0, sn.pantheon: 66.3, classy: 0.279}
[mcmc] Dragging with number of interpolating steps:
[mcmc] *  1 : [['logA', 'n_s', 'H0', 'omega_b', 'omega_cdm', 'tau_reio']]
[mcmc] * 10 : [['A_planck'], ['calib_100T', 'calib_217T', 'A_cib_217', 'xi_sz_cib', 'A_sz', 'ksz_norm', 'gal545_A_100', 'gal545_A_143', 'gal545_A_143_217', 'gal545_A_217', 'ps_A_100_100', 'ps_A_143_143', 'ps_A_143_217', 'ps_A_217_217', 'galf_TE_A_100', 'galf_TE_A_100_143', 'galf_TE_A_100_217', 'galf_TE_A_143', 'galf_TE_A_143_217', 'galf_TE_A_217']]
[mcmc] Covariance matrix loaded for params ['omega_b', 'omega_cdm', 'tau_reio', 'logA', 'n_s', 'A_planck', 'A_cib_217', 'xi_sz_cib', 'A_sz', 'ps_A_100_100', 'ps_A_143_143', 'ps_A_143_217', 'ps_A_217_217', 'ksz_norm', 'gal545_A_100', 'gal545_A_143', 'gal545_A_143_217', 'gal545_A_217', 'galf_TE_A_100', 'galf_TE_A_100_143', 'galf_TE_A_100_217', 'galf_TE_A_143', 'galf_TE_A_143_217', 'galf_TE_A_217', 'calib_100T', 'calib_217T']
[mcmc] Missing proposal covariance for params ['H0']
[mcmc] Covariance matrix not complete. We will start learning the covariance of the proposal earlier: R-1 = 30 (would be 2 if all params loaded).
[mcmc] Initial point: logA:3.049501, n_s:0.9665352, H0:69.25499, omega_b:0.0223287, omega_cdm:0.1200503, tau_reio:0.05242163, A_planck:1.001935, calib_100T:1.001052, calib_217T:0.9975702, A_cib_217:60.21447, xi_sz_cib:0.01937746, A_sz:5.770672, ksz_norm:3.032077, gal545_A_100:6.337759, gal545_A_143:6.565886, gal545_A_143_217:26.28255, gal545_A_217:55.7477, ps_A_100_100:249.9083, ps_A_143_143:34.00191, ps_A_143_217:42.97221, ps_A_217_217:80.51975, galf_TE_A_100:0.2394203, galf_TE_A_100_143:0.04782775, galf_TE_A_100_217:0.3805384, galf_TE_A_143:0.1112743, galf_TE_A_143_217:0.7317949, galf_TE_A_217:1.618371
[mcmc] Sampling!
[mcmc] Sampling!
[mcmc] Progress @ 2020-05-11 09:59:51 : 1 steps taken, and 0 accepted.
[model] Setting measured speeds (per sec): {planck_2018_lowl.TT: 1660.0, planck_2018_lowl.EE: 4590.0, planck_2018_highl_plik.TTTEEE: 5.42, planck_2018_lensing.clik: 880.0, bao.sixdf_2011_bao: 2790.0, bao.sdss_dr7_mgs: 5730.0, bao.sdss_dr12_consensus_bao: 4110.0, sn.pantheon: 147.0, classy: 0.268}
[mcmc] Dragging with number of interpolating steps:
[mcmc] *  1 : [['logA', 'n_s', 'H0', 'omega_b', 'omega_cdm', 'tau_reio']]
[mcmc] * 10 : [['A_planck'], ['calib_100T', 'calib_217T', 'A_cib_217', 'xi_sz_cib', 'A_sz', 'ksz_norm', 'gal545_A_100', 'gal545_A_143', 'gal545_A_143_217', 'gal545_A_217', 'ps_A_100_100', 'ps_A_143_143', 'ps_A_143_217', 'ps_A_217_217', 'galf_TE_A_100', 'galf_TE_A_100_143', 'galf_TE_A_100_217', 'galf_TE_A_143', 'galf_TE_A_143_217', 'galf_TE_A_217']]
[mcmc] Covariance matrix loaded for params ['omega_b', 'omega_cdm', 'tau_reio', 'logA', 'n_s', 'A_planck', 'A_cib_217', 'xi_sz_cib', 'A_sz', 'ps_A_100_100', 'ps_A_143_143', 'ps_A_143_217', 'ps_A_217_217', 'ksz_norm', 'gal545_A_100', 'gal545_A_143', 'gal545_A_143_217', 'gal545_A_217', 'galf_TE_A_100', 'galf_TE_A_100_143', 'galf_TE_A_100_217', 'galf_TE_A_143', 'galf_TE_A_143_217', 'galf_TE_A_217', 'calib_100T', 'calib_217T']
[mcmc] Missing proposal covariance for params ['H0']
[mcmc] Covariance matrix not complete. We will start learning the covariance of the proposal earlier: R-1 = 30 (would be 2 if all params loaded).
[mcmc] Initial point: logA:3.049476, n_s:0.9646643, H0:66.37593, omega_b:0.02245887, omega_cdm:0.1217121, tau_reio:0.06180218, A_planck:0.9992613, calib_100T:1.000842, calib_217T:0.9984593, A_cib_217:76.27982, xi_sz_cib:0.1190162, A_sz:9.294615, ksz_norm:0.06861349, gal545_A_100:5.218414, gal545_A_143:8.525438, gal545_A_143_217:19.13479, gal545_A_217:98.07568, ps_A_100_100:239.1407, ps_A_143_143:50.59149, ps_A_143_217:37.55786, ps_A_217_217:116.6164, galf_TE_A_100:0.1868849, galf_TE_A_100_143:0.2092564, galf_TE_A_100_217:0.4475238, galf_TE_A_143:0.3857214, galf_TE_A_143_217:0.6724917, galf_TE_A_217:1.926587
[mcmc] Sampling!
[mcmc] Progress @ 2020-05-11 09:59:51 : 1 steps taken, and 0 accepted.
[model] Setting measured speeds (per sec): {planck_2018_lowl.TT: 1490.0, planck_2018_lowl.EE: 4200.0, planck_2018_highl_plik.TTTEEE: 4.6, planck_2018_lensing.clik: 896.0, bao.sixdf_2011_bao: 2780.0, bao.sdss_dr7_mgs: 5590.0, bao.sdss_dr12_consensus_bao: 4140.0, sn.pantheon: 140.0, classy: 0.284}
[mcmc] Dragging with number of interpolating steps:
[mcmc] *  1 : [['logA', 'n_s', 'H0', 'omega_b', 'omega_cdm', 'tau_reio']]
[mcmc] * 10 : [['A_planck'], ['calib_100T', 'calib_217T', 'A_cib_217', 'xi_sz_cib', 'A_sz', 'ksz_norm', 'gal545_A_100', 'gal545_A_143', 'gal545_A_143_217', 'gal545_A_217', 'ps_A_100_100', 'ps_A_143_143', 'ps_A_143_217', 'ps_A_217_217', 'galf_TE_A_100', 'galf_TE_A_100_143', 'galf_TE_A_100_217', 'galf_TE_A_143', 'galf_TE_A_143_217', 'galf_TE_A_217']]
[mcmc] Covariance matrix loaded for params ['omega_b', 'omega_cdm', 'tau_reio', 'logA', 'n_s', 'A_planck', 'A_cib_217', 'xi_sz_cib', 'A_sz', 'ps_A_100_100', 'ps_A_143_143', 'ps_A_143_217', 'ps_A_217_217', 'ksz_norm', 'gal545_A_100', 'gal545_A_143', 'gal545_A_143_217', 'gal545_A_217', 'galf_TE_A_100', 'galf_TE_A_100_143', 'galf_TE_A_100_217', 'galf_TE_A_143', 'galf_TE_A_143_217', 'galf_TE_A_217', 'calib_100T', 'calib_217T']
[mcmc] Missing proposal covariance for params ['H0']
[mcmc] Covariance matrix not complete. We will start learning the covariance of the proposal earlier: R-1 = 30 (would be 2 if all params loaded).
[mcmc] Initial point: logA:3.050471, n_s:0.9609636, H0:67.54149, omega_b:0.02247223, omega_cdm:0.1207451, tau_reio:0.05534895, A_planck:0.9998273, calib_100T:0.9998161, calib_217T:0.9985374, A_cib_217:75.02101, xi_sz_cib:0.02594849, A_sz:5.277067, ksz_norm:0.1936635, gal545_A_100:9.477179, gal545_A_143:11.91588, gal545_A_143_217:17.26781, gal545_A_217:63.58023, ps_A_100_100:277.9761, ps_A_143_143:32.64392, ps_A_143_217:47.15422, ps_A_217_217:116.3797, galf_TE_A_100:0.161029, galf_TE_A_100_143:0.3325325, galf_TE_A_100_217:0.3580412, galf_TE_A_143:0.3697995, galf_TE_A_143_217:0.7241791, galf_TE_A_217:1.821867
[mcmc] Sampling!
[mcmc] Progress @ 2020-05-11 09:59:52 : 1 steps taken, and 0 accepted.
[model] Setting measured speeds (per sec): {planck_2018_lowl.TT: 2220.0, planck_2018_lowl.EE: 4860.0, planck_2018_highl_plik.TTTEEE: 7.5, planck_2018_lensing.clik: 757.0, bao.sixdf_2011_bao: 2620.0, bao.sdss_dr7_mgs: 5850.0, bao.sdss_dr12_consensus_bao: 4010.0, sn.pantheon: 43.7, classy: 0.272}
[mcmc] Dragging with number of interpolating steps:
[mcmc] *  1 : [['logA', 'n_s', 'H0', 'omega_b', 'omega_cdm', 'tau_reio']]
[mcmc] * 10 : [['A_planck'], ['calib_100T', 'calib_217T', 'A_cib_217', 'xi_sz_cib', 'A_sz', 'ksz_norm', 'gal545_A_100', 'gal545_A_143', 'gal545_A_143_217', 'gal545_A_217', 'ps_A_100_100', 'ps_A_143_143', 'ps_A_143_217', 'ps_A_217_217', 'galf_TE_A_100', 'galf_TE_A_100_143', 'galf_TE_A_100_217', 'galf_TE_A_143', 'galf_TE_A_143_217', 'galf_TE_A_217']]
[mcmc] Covariance matrix loaded for params ['omega_b', 'omega_cdm', 'tau_reio', 'logA', 'n_s', 'A_planck', 'A_cib_217', 'xi_sz_cib', 'A_sz', 'ps_A_100_100', 'ps_A_143_143', 'ps_A_143_217', 'ps_A_217_217', 'ksz_norm', 'gal545_A_100', 'gal545_A_143', 'gal545_A_143_217', 'gal545_A_217', 'galf_TE_A_100', 'galf_TE_A_100_143', 'galf_TE_A_100_217', 'galf_TE_A_143', 'galf_TE_A_143_217', 'galf_TE_A_217', 'calib_100T', 'calib_217T']
[mcmc] Missing proposal covariance for params ['H0']
[mcmc] Covariance matrix not complete. We will start learning the covariance of the proposal earlier: R-1 = 30 (would be 2 if all params loaded).
[mcmc] Initial point: logA:3.049509, n_s:0.9671421, H0:65.56161, omega_b:0.02241275, omega_cdm:0.117857, tau_reio:0.06301017, A_planck:0.997469, calib_100T:0.999677, calib_217T:0.9992631, A_cib_217:69.75675, xi_sz_cib:0.2254455, A_sz:7.636992, ksz_norm:5.580574, gal545_A_100:7.003164, gal545_A_143:7.526233, gal545_A_143_217:22.86149, gal545_A_217:87.97539, ps_A_100_100:288.5689, ps_A_143_143:46.46168, ps_A_143_217:38.94541, ps_A_217_217:107.2629, galf_TE_A_100:0.1789156, galf_TE_A_100_143:0.0614563, galf_TE_A_100_217:0.5458789, galf_TE_A_143:0.08863906, galf_TE_A_143_217:0.4756484, galf_TE_A_217:1.981641
[mcmc] Sampling!
[model] Setting measured speeds (per sec): {planck_2018_lowl.TT: 1150.0, planck_2018_lowl.EE: 4030.0, planck_2018_highl_plik.TTTEEE: 6.19, planck_2018_lensing.clik: 801.0, bao.sixdf_2011_bao: 1970.0, bao.sdss_dr7_mgs: 4770.0, bao.sdss_dr12_consensus_bao: 3940.0, sn.pantheon: 92.8, classy: 0.248}
[mcmc] Dragging with number of interpolating steps:
[mcmc] *  1 : [['logA', 'n_s', 'H0', 'omega_b', 'omega_cdm', 'tau_reio']]
[mcmc] * 10 : [['A_planck'], ['calib_100T', 'calib_217T', 'A_cib_217', 'xi_sz_cib', 'A_sz', 'ksz_norm', 'gal545_A_100', 'gal545_A_143', 'gal545_A_143_217', 'gal545_A_217', 'ps_A_100_100', 'ps_A_143_143', 'ps_A_143_217', 'ps_A_217_217', 'galf_TE_A_100', 'galf_TE_A_100_143', 'galf_TE_A_100_217', 'galf_TE_A_143', 'galf_TE_A_143_217', 'galf_TE_A_217']]
[mcmc] Covariance matrix loaded for params ['omega_b', 'omega_cdm', 'tau_reio', 'logA', 'n_s', 'A_planck', 'A_cib_217', 'xi_sz_cib', 'A_sz', 'ps_A_100_100', 'ps_A_143_143', 'ps_A_143_217', 'ps_A_217_217', 'ksz_norm', 'gal545_A_100', 'gal545_A_143', 'gal545_A_143_217', 'gal545_A_217', 'galf_TE_A_100', 'galf_TE_A_100_143', 'galf_TE_A_100_217', 'galf_TE_A_143', 'galf_TE_A_143_217', 'galf_TE_A_217', 'calib_100T', 'calib_217T']
[mcmc] Missing proposal covariance for params ['H0']
[mcmc] Covariance matrix not complete. We will start learning the covariance of the proposal earlier: R-1 = 30 (would be 2 if all params loaded).
[mcmc] Initial point: logA:3.050914, n_s:0.9675858, H0:67.05625, omega_b:0.02250887, omega_cdm:0.1200974, tau_reio:0.04989173, A_planck:0.9994821, calib_100T:1.001696, calib_217T:0.9969125, A_cib_217:71.61517, xi_sz_cib:0.09058806, A_sz:8.872968, ksz_norm:2.582198, gal545_A_100:5.576223, gal545_A_143:10.9754, gal545_A_143_217:17.62291, gal545_A_217:80.12371, ps_A_100_100:291.2006, ps_A_143_143:35.14288, ps_A_143_217:53.01455, ps_A_217_217:112.8452, galf_TE_A_100:-0.0195371, galf_TE_A_100_143:0.03951167, galf_TE_A_100_217:0.4434256, galf_TE_A_143:0.2147817, galf_TE_A_143_217:0.6678661, galf_TE_A_217:2.023893
[mcmc] Sampling!
[mcmc] Progress @ 2020-05-11 09:59:59 : 1 steps taken, and 0 accepted.
[mcmc] Progress @ 2020-05-11 10:00:00 : 1 steps taken, and 0 accepted.
[mcmc] Progress @ 2020-05-11 10:00:01 : 1 steps taken, and 0 accepted.
[mcmc] Progress @ 2020-05-11 10:00:03 : 1 steps taken, and 0 accepted.
[mcmc] Progress @ 2020-05-11 10:00:03 : 1 steps taken, and 0 accepted.
[mcmc] Progress @ 2020-05-11 10:00:51 : 14 steps taken, and 3 accepted.
[mcmc] Progress @ 2020-05-11 10:00:56 : 13 steps taken, and 1 accepted.
[mcmc] Progress @ 2020-05-11 10:00:56 : 11 steps taken, and 2 accepted.
[mcmc] Progress @ 2020-05-11 10:01:03 : 11 steps taken, and 3 accepted.
[mcmc] Progress @ 2020-05-11 10:01:03 : 12 steps taken, and 2 accepted.
[mcmc] Progress @ 2020-05-11 10:01:04 : 11 steps taken, and 1 accepted.
[mcmc] Progress @ 2020-05-11 10:01:06 : 13 steps taken, and 1 accepted.
[mcmc] Progress @ 2020-05-11 10:01:07 : 12 steps taken, and 0 accepted.
[mcmc] Progress @ 2020-05-11 10:01:57 : 21 steps taken, and 2 accepted.
[mcmc] Progress @ 2020-05-11 10:01:58 : 26 steps taken, and 4 accepted.
[mcmc] Progress @ 2020-05-11 10:02:00 : 24 steps taken, and 2 accepted.
[mcmc] Progress @ 2020-05-11 10:02:03 : 21 steps taken, and 3 accepted.
[mcmc] Progress @ 2020-05-11 10:02:06 : 21 steps taken, and 2 accepted.
[mcmc] Progress @ 2020-05-11 10:02:08 : 23 steps taken, and 3 accepted.
[mcmc] Progress @ 2020-05-11 10:02:08 : 23 steps taken, and 2 accepted.
[mcmc] Progress @ 2020-05-11 10:02:12 : 24 steps taken, and 2 accepted.
[mcmc] Progress @ 2020-05-11 10:02:58 : 37 steps taken, and 5 accepted.
[mcmc] Progress @ 2020-05-11 10:02:59 : 32 steps taken, and 6 accepted.
[mcmc] Progress @ 2020-05-11 10:03:02 : 34 steps taken, and 3 accepted.
[mcmc] Progress @ 2020-05-11 10:03:04 : 31 steps taken, and 5 accepted.
[mcmc] Progress @ 2020-05-11 10:03:08 : 32 steps taken, and 4 accepted.
[mcmc] Progress @ 2020-05-11 10:03:09 : 33 steps taken, and 3 accepted.
[mcmc] Progress @ 2020-05-11 10:03:12 : 35 steps taken, and 3 accepted.
[mcmc] Progress @ 2020-05-11 10:03:12 : 34 steps taken, and 4 accepted.
[mcmc] Progress @ 2020-05-11 10:04:00 : 50 steps taken, and 6 accepted.
[mcmc] Progress @ 2020-05-11 10:04:01 : 48 steps taken, and 7 accepted.
[mcmc] Progress @ 2020-05-11 10:04:06 : 41 steps taken, and 5 accepted.
[mcmc] Progress @ 2020-05-11 10:04:08 : 46 steps taken, and 4 accepted.
[mcmc] Progress @ 2020-05-11 10:04:10 : 44 steps taken, and 3 accepted.
[mcmc] Progress @ 2020-05-11 10:04:10 : 46 steps taken, and 4 accepted.
[mcmc] Progress @ 2020-05-11 10:04:13 : 44 steps taken, and 4 accepted.
[mcmc] Progress @ 2020-05-11 10:04:14 : 49 steps taken, and 3 accepted.
[mcmc] Progress @ 2020-05-11 10:05:02 : 61 steps taken, and 7 accepted.
[mcmc] Progress @ 2020-05-11 10:05:05 : 67 steps taken, and 7 accepted.
[mcmc] Progress @ 2020-05-11 10:05:08 : 51 steps taken, and 6 accepted.
[mcmc] Progress @ 2020-05-11 10:05:09 : 56 steps taken, and 4 accepted.
[mcmc] Progress @ 2020-05-11 10:05:11 : 54 steps taken, and 4 accepted.
[mcmc] Progress @ 2020-05-11 10:05:13 : 61 steps taken, and 4 accepted.
[mcmc] Progress @ 2020-05-11 10:05:15 : 54 steps taken, and 4 accepted.
[mcmc] Progress @ 2020-05-11 10:05:15 : 61 steps taken, and 3 accepted.
[mcmc] Progress @ 2020-05-11 10:06:03 : 81 steps taken, and 9 accepted.
[mcmc] Progress @ 2020-05-11 10:06:06 : 83 steps taken, and 7 accepted.
[mcmc] Progress @ 2020-05-11 10:06:08 : 61 steps taken, and 8 accepted.
[mcmc] Progress @ 2020-05-11 10:06:11 : 67 steps taken, and 5 accepted.
[mcmc] Progress @ 2020-05-11 10:06:15 : 71 steps taken, and 5 accepted.
[mcmc] Progress @ 2020-05-11 10:06:17 : 65 steps taken, and 5 accepted.
[mcmc] Progress @ 2020-05-11 10:06:18 : 71 steps taken, and 4 accepted.
[mcmc] Progress @ 2020-05-11 10:06:19 : 65 steps taken, and 4 accepted.
[mcmc] Progress @ 2020-05-11 10:07:07 : 98 steps taken, and 10 accepted.
[mcmc] Progress @ 2020-05-11 10:07:08 : 71 steps taken, and 8 accepted.
[mcmc] Progress @ 2020-05-11 10:07:09 : 98 steps taken, and 7 accepted.
[mcmc] Progress @ 2020-05-11 10:07:12 : 77 steps taken, and 7 accepted.
[mcmc] Progress @ 2020-05-11 10:07:19 : 81 steps taken, and 6 accepted.
[mcmc] Progress @ 2020-05-11 10:07:22 : 76 steps taken, and 6 accepted.
[mcmc] Progress @ 2020-05-11 10:07:22 : 82 steps taken, and 6 accepted.
[mcmc] Progress @ 2020-05-11 10:07:24 : 76 steps taken, and 5 accepted.

Grateful for any insight into what's going wrong here!

Tanvi Karwal
Posts: 6
Joined: April 10 2020
Affiliation: University of Pennsylvania

Re: Cobaya: running parallel chains

Post by Tanvi Karwal » May 11 2020

PS: I should say that previously, with the same commands, Cobaya master (installed via pip) and CLASS 2.7, for the same cosmology above, I was not experiencing this error. My job output had 10 copies of everything and I had 10 .txt files. (I was then running 10 chains.)
All this also used the same versions of python and mpi.

Jesus Torrado
Posts: 18
Joined: April 15 2013
Affiliation: RWTH Aachen
Contact:

Re: Cobaya: running parallel chains

Post by Jesus Torrado » May 11 2020

Hi Tanvi,

It looks like your Python MPI wrapper is not working properly. Can you successfully perform the test mentioned here?: https://cobaya.readthedocs.io/en/devel/installation.html#mpi-parallelization-optional-but-encouraged

Tanvi Karwal
Posts: 6
Joined: April 10 2020
Affiliation: University of Pennsylvania

Re: Cobaya: running parallel chains

Post by Tanvi Karwal » May 12 2020

Hi Jesus!

Thanks for the quick reply!!
I eventually got to the same conclusion - bad openmpi.
I tested that when installing cobaya and it had worked, but my cluster was recently simply pointing to the wrong installation of mpirun.
I pointed it back to the installation under ~/anaconda3/bin/mpirun and now it's working correctly ( I think?).

My runs are creating multiple <file_name>.#.txt files and job output looks like:

Code: Select all

...
[3 : mcmc] Progress @ 2020-05-11 15:11:16 : 42 steps taken, and 5 accepted.
[5 : mcmc] Progress @ 2020-05-11 15:11:21 : 42 steps taken, and 3 accepted.
[2 : mcmc] Progress @ 2020-05-11 15:11:24 : 51 steps taken, and 7 accepted.
[1 : mcmc] Progress @ 2020-05-11 15:11:30 : 33 steps taken, and 6 accepted.
[7 : mcmc] Progress @ 2020-05-11 15:11:31 : 36 steps taken, and 3 accepted.
[8 : mcmc] Progress @ 2020-05-11 15:11:43 : 35 steps taken, and 5 accepted.
[0 : mcmc] Progress @ 2020-05-11 15:11:54 : 42 steps taken, and 5 accepted.
[4 : mcmc] Progress @ 2020-05-11 15:12:16 : 34 steps taken, and 4 accepted.
[9 : mcmc] Progress @ 2020-05-11 15:12:19 : 40 steps taken, and 6 accepted.
[3 : mcmc] Progress @ 2020-05-11 15:12:33 : 56 steps taken, and 7 accepted.
...

Jesus Torrado
Posts: 18
Joined: April 15 2013
Affiliation: RWTH Aachen
Contact:

Re: Cobaya: running parallel chains

Post by Jesus Torrado » May 12 2020

Looks like it's working. Have fun with it!

Post Reply