parameter point rejected (logZero or outside prior)

Announcements, suggestions for new forums, ideas, etc.
Simony S. da Costa
Posts: 6
Joined: December 20 2022
Affiliation: INFN - Sezione di Pisa

parameter point rejected (logZero or outside prior)

Post by Simony S. da Costa » March 01 2023

Hello everyone,

I am using a modified version cosmomc to consider Delta Neff written in terms of other two parameters.
My first test was to consider one of them fixed and vary the second. Analyses done!
Now, that I want to vary both of them I got this error (see below), even if cosmomc compile well.

Code: Select all

No protocol specified
No protocol specified
 Number of MPI processes:           1
 file_root:test1-tauxM-w-PLA18+BAO+Pantheon
 Random seeds:  6979, 24148 rand_inst:   1
 Using clik with likelihood file 
 ./data/clik_14.0/hi_l/plik/plik_rd12_HM_v22b_TTTEEE.clik
----
clik version plc_3.1
  smica
Checking likelihood './data/clik_14.0/hi_l/plik/plik_rd12_HM_v22b_TTTEEE.clik' on test data. got -1172.47 expected -1172.47 (diff -4.34053e-07)
----
   TT from l=0 to l=        2508
   EE from l=0 to l=        2508
   TE from l=0 to l=        2508
 Clik will run with the following nuisance parameters:
 A_cib_217
 cib_index
 xi_sz_cib
 A_sz
 ps_A_100_100
 ps_A_143_143
 ps_A_143_217
 ps_A_217_217
 ksz_norm
 gal545_A_100
 gal545_A_143
 gal545_A_143_217
 gal545_A_217
 galf_EE_A_100
 galf_EE_A_100_143
 galf_EE_A_100_217
 galf_EE_A_143
 galf_EE_A_143_217
 galf_EE_A_217
 galf_EE_index
 galf_TE_A_100
 galf_TE_A_100_143
 galf_TE_A_100_217
 galf_TE_A_143
 galf_TE_A_143_217
 galf_TE_A_217
 galf_TE_index
 A_cnoise_e2e_100_100_EE
 A_cnoise_e2e_143_143_EE
 A_cnoise_e2e_217_217_EE
 A_sbpx_100_100_TT
 A_sbpx_143_143_TT
 A_sbpx_143_217_TT
 A_sbpx_217_217_TT
 A_sbpx_100_100_EE
 A_sbpx_100_143_EE
 A_sbpx_100_217_EE
 A_sbpx_143_143_EE
 A_sbpx_143_217_EE
 A_sbpx_217_217_EE
 calib_100T
 calib_217T
 calib_100P
 calib_143P
 calib_217P
 A_pol
 A_planck
 Using clik with likelihood file 
 ./data/clik_14.0/low_l/commander/commander_dx12_v3_2_29.clik
----
clik version plc_3.1
  gibbs_gauss b13c8fda-1837-41b5-ae2d-78d6b723fcf1
Checking likelihood './data/clik_14.0/low_l/commander/commander_dx12_v3_2_29.clik' on test data. got -11.6257 expected -11.6257 (diff -1.07424e-09)
----
   TT from l=0 to l=          29
 Clik will run with the following nuisance parameters:
 A_planck
 Using clik with likelihood file 
 ./data/clik_14.0/low_l/simall/simall_100x143_offlike5_EE_Aplanck_B.clik
Initializing SimAll
----
clik version plc_3.1
  simall simall_EE_BB_TE
Checking likelihood './data/clik_14.0/low_l/simall/simall_100x143_offlike5_EE_Aplanck_B.clik' on test data. got -197.99 expected -197.99 (diff -4.1778e-08)
----
   EE from l=0 to l=          29
 Clik will run with the following nuisance parameters:
 A_planck
 read jla dataset data/Pantheon/full_long.dataset
 reading BAO data set: 6DF
 reading BAO data set: MGS
 reading BAO data set: DR12BAO
 Doing non-linear Pk: F
 Doing CMB lensing: T
 Doing non-linear lensing: T
 TT lmax =  2508
 EE lmax =  2508
 ET lmax =  2508
 BB lmax =  2500
 PP lmax =  2500
 lmax_computed_cl  =  2508
 Computing tensors: F
 max_eta_k         =    14000.00    
 transfer kmax     =    1.000000    
 adding parameters for: smicadx12_Dec5_ftl_mv2_ndclpp_p_teb_consext8
 adding parameters for: 6DF
 adding parameters for: MGS
 adding parameters for: DR12BAO
 adding parameters for: JLA
 adding parameters for: commander_dx12_v3_2_29
 adding parameters for: simall_100x143_offlike5_EE_Aplanck_B
 adding parameters for: plik_rd12_HM_v22b_TTTEEE
 Fast divided into            1  blocks
 28 parameters ( 8 slow ( 0 semi-slow), 20 fast ( 0 semi-fast))
 starting Monte-Carlo
 MCMC.f90: Couldn't start after 1000 tries - check starting ranges
--------------------------------------------------------------------------
MPI_ABORT was invoked on rank 0 in communicator MPI_COMM_WORLD
with errorcode 220433680.

NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
You may or may not see output from other processes, depending on
exactly when Open MPI kills them.
--------------------------------------------------------------------------


So, I tried to check the likelihoods with action=4 and now I'm getting the following message:

Code: Select all

No protocol specified
No protocol specified
 Number of MPI processes:           1
 file_root:test
 Random seeds: 14337,   541 rand_inst:   1
 Using clik with likelihood file 
 ./data/clik_14.0/hi_l/plik/plik_rd12_HM_v22b_TTTEEE.clik
----
clik version plc_3.1
  smica
Checking likelihood './data/clik_14.0/hi_l/plik/plik_rd12_HM_v22b_TTTEEE.clik' on test data. got -1172.47 expected -1172.47 (diff -4.34052e-07)
----
   TT from l=0 to l=        2508
   EE from l=0 to l=        2508
   TE from l=0 to l=        2508
 Clik will run with the following nuisance parameters:
 A_cib_217
 cib_index
 xi_sz_cib
 A_sz
 ps_A_100_100
 ps_A_143_143
 ps_A_143_217
 ps_A_217_217
 ksz_norm
 gal545_A_100
 gal545_A_143
 gal545_A_143_217
 gal545_A_217
 galf_EE_A_100
 galf_EE_A_100_143
 galf_EE_A_100_217
 galf_EE_A_143
 galf_EE_A_143_217
 galf_EE_A_217
 galf_EE_index
 galf_TE_A_100
 galf_TE_A_100_143
 galf_TE_A_100_217
 galf_TE_A_143
 galf_TE_A_143_217
 galf_TE_A_217
 galf_TE_index
 A_cnoise_e2e_100_100_EE
 A_cnoise_e2e_143_143_EE
 A_cnoise_e2e_217_217_EE
 A_sbpx_100_100_TT
 A_sbpx_143_143_TT
 A_sbpx_143_217_TT
 A_sbpx_217_217_TT
 A_sbpx_100_100_EE
 A_sbpx_100_143_EE
 A_sbpx_100_217_EE
 A_sbpx_143_143_EE
 A_sbpx_143_217_EE
 A_sbpx_217_217_EE
 calib_100T
 calib_217T
 calib_100P
 calib_143P
 calib_217P
 A_pol
 A_planck
 Using clik with likelihood file 
 ./data/clik_14.0/low_l/commander/commander_dx12_v3_2_29.clik
----
clik version plc_3.1
  gibbs_gauss b13c8fda-1837-41b5-ae2d-78d6b723fcf1
Checking likelihood './data/clik_14.0/low_l/commander/commander_dx12_v3_2_29.clik' on test data. got -11.6257 expected -11.6257 (diff -1.07424e-09)
----
   TT from l=0 to l=          29
 Clik will run with the following nuisance parameters:
 A_planck
 Using clik with likelihood file 
 ./data/clik_14.0/low_l/simall/simall_100x143_offlike5_EE_Aplanck_B.clik
Initializing SimAll
----
clik version plc_3.1
  simall simall_EE_BB_TE
Checking likelihood './data/clik_14.0/low_l/simall/simall_100x143_offlike5_EE_Aplanck_B.clik' on test data. got -197.99 expected -197.99 (diff -4.1778e-08)
----
   EE from l=0 to l=          29
 Clik will run with the following nuisance parameters:
 A_planck
 Doing non-linear Pk: F
 Doing CMB lensing: T
 Doing non-linear lensing: T
 TT lmax =  2508
 EE lmax =  2508
 ET lmax =  2508
 BB lmax =  2500
 PP lmax =  2500
 lmax_computed_cl  =  2508
 Computing tensors: F
 max_eta_k         =    14000.00    
 transfer kmax     =    1.000000    
 adding parameters for: smicadx12_Dec5_ftl_mv2_ndclpp_p_teb_consext8
 adding parameters for: commander_dx12_v3_2_29
 adding parameters for: simall_100x143_offlike5_EE_Aplanck_B
 adding parameters for: plik_rd12_HM_v22b_TTTEEE
 Fast divided into            1  blocks
 30 parameters (10 slow ( 0 semi-slow), 20 fast ( 0 semi-fast))
    loglike     chi-sq
      0.000      0.000   CMB: lensing = smicadx12_Dec5_ftl_mv2_ndclpp_p_teb_consext8
      0.000      0.000   CMB: plik = plik_rd12_HM_v22b_TTTEEE
      0.000      0.000   CMB: lowl = commander_dx12_v3_2_29
      0.000      0.000   CMB: simall = simall_100x143_offlike5_EE_Aplanck_B
 Test likelihoods done, parameter point rejected (logZero or outside prior)
Lastly, this is my .ini file:

Code: Select all

#general settings, test file without require Planck likelihood code to be installed.
#see test_planck.ini for test file including Planck clik likelihoods

#Planck 2018
#high-L plik likelihood
DEFAULT(batch3/plik_rd12_HM_v22_TTTEEE.ini)

#low-L temperature
DEFAULT(batch3/lowl.ini)

#low-L EE polarization
DEFAULT(batch3/simall_EE.ini)

#Bicep-Keck-Planck 2015, varying cosmological parameters (use only if varying r)
#DEFAULT(batch3/BK15.ini)

#DES 1-yr joint
#DEFAULT(batch3/DES.ini)

#Planck 2018 lensing (native code, does not require Planck likelihood code)
DEFAULT(batch3/lensing.ini)

#BAO compilation
DEFAULT(batch3/BAO.ini)

#Pantheon SN
DEFAULT(batch3/Pantheon18.ini)


#general settings
DEFAULT(batch3/common.ini)

#e.g. to vary r in addition to standard 6:
#(for r>0 also need compute_tensors=T)
compute_tensors = F
#param[r] = 0.03 0 2 0.04 0.04

#high for new runs, to start learning new proposal matrix quickly
MPI_Max_R_ProposeUpdate = 30

propose_matrix= planck_covmats/base_TTTEEE_lensing_lowE_lowl_plikHM.covmat

#Folder where files (chains, checkpoints, etc.) are stored
root_dir = chains/

#Root name for files produced
file_root=test1-tauxM-w-PLA18+BAO+Pantheon
#action= 0 runs chains, 1 importance samples, 2 minimizes
#use action=4 just to quickly test likelihoods
action = 0

#expected result for -(log like)
test_check_compare = 1184.788 

#Don't need to set this if OMP_NUM_THREADS set appropriately
num_threads = 0

#if you want to get theory cl for test point
#test_output_root = output_cl_root

start_at_bestfit =F
feedback=1
use_fast_slow = T

#turn on checkpoint for real runs where you want to be able to continue them
checkpoint = F
#sampling_method=7 is a new fast-slow scheme good for Planck
sampling_method = 7
dragging_steps  = 3
propose_scale = 2

#Set >0 to make data files for importance sampling
indep_sample=10

#these are just small speedups for testing
get_sigma8=T

#Uncomment this if you don't want one 0.06eV neutrino by default
#neutrino_hierarchy = degenerate
#num_massive_neutrinos= 3
#to vary parameters set param[name]= center, min, max, start width, propose width
#param[mnu] = 0.06 0 5 0.05 0.05
param[omegabh2] = 0.0222 0.005 0.1 0.0001 0.0001
param[omegach2] = 0.1197 0.001 0.99 0.001 0.0005
param[theta] = 1.0411 0.5 10 0.0004 0.0002
param[tau] = 0.07 0.01 0.8 0.01 0.005
param[ns] = 0.96
param[logA] = 3.09
param[nnu] = 3.046
param[w] = -1.2 -3. -1 0.01 0.005
param[nnu_darkmat] = 8000. 2500. 25000. 500. 1000.
param[nnu_tau] = 100. 100. 10000. 500. 1000.
#for PICO install from https://pypi.python.org/pypi/pypico and download data file
#cosmology_calculator=PICO
#pico_datafile = pico3_tailmonty_v34.dat
#pico_verbose=F
Anyone knows what could be the problem?

Thanks in advance,
Simony

Antony Lewis
Posts: 1941
Joined: September 23 2004
Affiliation: University of Sussex
Contact:

Re: parameter point rejected (logZero or outside prior)

Post by Antony Lewis » March 02 2023

This should presumably be in the software topic

Simony S. da Costa
Posts: 6
Joined: December 20 2022
Affiliation: INFN - Sezione di Pisa

Re: parameter point rejected (logZero or outside prior)

Post by Simony S. da Costa » March 02 2023

Dear Antony,

I searched for other posts related and any of them could help to solve my problem, unfortunately.
The strange thing was that I just changed the prior ranges.
I remodeled my parameter to have one order of magnitude in less, and now the code is working.

The code works well if I use the prior range as:

Code: Select all

param[myparam] = 8e5 2.5e5 2.5e6 100 200
If, instead, I consider the prior range as:

Code: Select all

param[myparam] = 8e6 2.5e6 2.5e7 100 200
the code give me the following error:

Code: Select all

No protocol specified
No protocol specified
 Number of MPI processes:           1
 file_root:test1-tauxM-w-PLA18+BAO+Pantheon
 Random seeds:  6979, 24148 rand_inst:   1
 Using clik with likelihood file 
 ./data/clik_14.0/hi_l/plik/plik_rd12_HM_v22b_TTTEEE.clik
----
clik version plc_3.1
  smica
Checking likelihood './data/clik_14.0/hi_l/plik/plik_rd12_HM_v22b_TTTEEE.clik' on test data. got -1172.47 expected -1172.47 (diff -4.34053e-07)
----
   TT from l=0 to l=        2508
   EE from l=0 to l=        2508
   TE from l=0 to l=        2508
 Clik will run with the following nuisance parameters:
 A_cib_217
 cib_index
 xi_sz_cib
 A_sz
 ps_A_100_100
 ps_A_143_143
 ps_A_143_217
 ps_A_217_217
 ksz_norm
 gal545_A_100
 gal545_A_143
 gal545_A_143_217
 gal545_A_217
galf_EE_A_100
 galf_EE_A_100_143
 galf_EE_A_100_217
 galf_EE_A_143
 galf_EE_A_143_217
 galf_EE_A_217
 galf_EE_index
 galf_TE_A_100
 galf_TE_A_100_143
 galf_TE_A_100_217
 galf_TE_A_143
 galf_TE_A_143_217
 galf_TE_A_217
 galf_TE_index
 A_cnoise_e2e_100_100_EE
 A_cnoise_e2e_143_143_EE
 A_cnoise_e2e_217_217_EE
 A_sbpx_100_100_TT
 A_sbpx_143_143_TT
 A_sbpx_143_217_TT
 A_sbpx_217_217_TT
 A_sbpx_100_100_EE
 A_sbpx_100_143_EE
 A_sbpx_100_217_EE
 A_sbpx_143_143_EE
 A_sbpx_143_217_EE
 A_sbpx_217_217_EE
 calib_100T
 calib_217T
 calib_100P
 calib_143P
 calib_217P
 A_pol
 A_planck
 Using clik with likelihood file 
 ./data/clik_14.0/low_l/commander/commander_dx12_v3_2_29.clik
----
clik version plc_3.1
  gibbs_gauss b13c8fda-1837-41b5-ae2d-78d6b723fcf1
Checking likelihood './data/clik_14.0/low_l/commander/commander_dx12_v3_2_29.clik' on test data. got -11.6257 expected -11.6257 (diff -1.07424e-09)
----
   TT from l=0 to l=          29
 Clik will run with the following nuisance parameters:
 A_planck
 Using clik with likelihood file 
 ./data/clik_14.0/low_l/simall/simall_100x143_offlike5_EE_Aplanck_B.clik
Initializing SimAll
----
clik version plc_3.1
  simall simall_EE_BB_TE
Checking likelihood './data/clik_14.0/low_l/simall/simall_100x143_offlike5_EE_Aplanck_B.clik' on test data. got -197.99 expected -197.99 (diff -4.1778e-08)
----
   EE from l=0 to l=          29
 Clik will run with the following nuisance parameters:
 A_planck
 read jla dataset data/Pantheon/full_long.dataset
 reading BAO data set: 6DF
 reading BAO data set: MGS
 reading BAO data set: DR12BAO
 Doing non-linear Pk: F
 Doing CMB lensing: T
 Doing non-linear lensing: T
 TT lmax =  2508
 EE lmax =  2508
 ET lmax =  2508
 BB lmax =  2500
 PP lmax =  2500
 lmax_computed_cl  =  2508
 Computing tensors: F
 max_eta_k         =    14000.00    
 transfer kmax     =    1.000000    
 adding parameters for: smicadx12_Dec5_ftl_mv2_ndclpp_p_teb_consext8
 adding parameters for: 6DF
 adding parameters for: MGS
 adding parameters for: DR12BAO
 adding parameters for: JLA
 adding parameters for: commander_dx12_v3_2_29
 adding parameters for: simall_100x143_offlike5_EE_Aplanck_B
 adding parameters for: plik_rd12_HM_v22b_TTTEEE
 Fast divided into            1  blocks
 28 parameters ( 8 slow ( 0 semi-slow), 20 fast ( 0 semi-fast))
 starting Monte-Carlo
 MCMC.f90: Couldn't start after 1000 tries - check starting ranges
--------------------------------------------------------------------------
MPI_ABORT was invoked on rank 0 in communicator MPI_COMM_WORLD
with errorcode 220433680.

NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
You may or may not see output from other processes, depending on
exactly when Open MPI kills them.
--------------------------------------------------------------------------
So, I presume it is something related with the size of the vector where this parameter is allocated during the calculations (?).

If anyone had the same problem and would like to discuss, I would really appreciate.

Best,
Simony

Antony Lewis
Posts: 1941
Joined: September 23 2004
Affiliation: University of Sussex
Contact:

Re: parameter point rejected (logZero or outside prior)

Post by Antony Lewis » March 07 2023

Use the software forum, not Admin!

Post Reply