Building Planck likelihood

 Posts: 19
 Joined: March 03 2017
 Affiliation: IIT KANPUR
 Contact:
Building Planck likelihood
I am getting the following error when I run test_planck.ini
Number of MPI processes: 1
file_root:test
Random seeds: 17138, 20248 rand_inst: 1
Using clik with likelihood file
./data/clik/hi_l/plik/plik_dx11dr2_HM_v18_TT.clik
clik_init(../src/clik.c:57)::ForwardError
cldf_open(../src/cldf/cldf.c:191)::ForwardError
cldf_open_sub(../src/cldf/cldf.c:108)::Error 1234 (cannot stat file (error 1))

Primary job terminated normally, but 1 process returned
a nonzero exit code.. Per userdirection, the job has been aborted.


mpirun detected that one or more processes exited with nonzero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[53428,1],0]
Exit code: 46

Thanks in advance.....
Number of MPI processes: 1
file_root:test
Random seeds: 17138, 20248 rand_inst: 1
Using clik with likelihood file
./data/clik/hi_l/plik/plik_dx11dr2_HM_v18_TT.clik
clik_init(../src/clik.c:57)::ForwardError
cldf_open(../src/cldf/cldf.c:191)::ForwardError
cldf_open_sub(../src/cldf/cldf.c:108)::Error 1234 (cannot stat file (error 1))

Primary job terminated normally, but 1 process returned
a nonzero exit code.. Per userdirection, the job has been aborted.


mpirun detected that one or more processes exited with nonzero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[53428,1],0]
Exit code: 46

Thanks in advance.....

 Posts: 1369
 Joined: September 23 2004
 Affiliation: University of Sussex
 Contact:
Re: Building Planck likelihood
Did you make symlink OK so ./data/clik/hi_l/plik/plik_dx11dr2_HM_v18_TT.clik does actually exist?

 Posts: 43
 Joined: August 15 2016
 Affiliation: Oskar Klein Centre, Stockholm University
Building Planck likelihood
Looks like you might not have linked the Planck likelihood properly. First of all, did you install the Planck likelihood (basically, plc_2.0)? Next, did you link it correctly in your .ini files? For example, if I open my .ini file batch2/plik_dx11dr2_HM_v18_TT.ini, the last line reads:
clik_data_plik = /global/homes/v/vagnox92/Planck/data/plc_2.0/hi_l/plik/plik_dx11dr2_HM_v18_TT.clik
Make sure you also linked your Planck likelihood correctly, assuming you have installed it.
clik_data_plik = /global/homes/v/vagnox92/Planck/data/plc_2.0/hi_l/plik/plik_dx11dr2_HM_v18_TT.clik
Make sure you also linked your Planck likelihood correctly, assuming you have installed it.

 Posts: 19
 Joined: March 03 2017
 Affiliation: IIT KANPUR
 Contact:
Building Planck likelihood
Ty so much It is running now but I am encountering a new error.Please help
purnalingam@IDL:~/workspace/CosmoMCNov2016$ mpirun np 1 ./cosmomc test_planck.ini
Number of MPI processes: 1
file_root:test
Random seeds: 30574, 9385 rand_inst: 1
Using clik with likelihood file
./data/clik/hi_l/plik/plik_dx11dr2_HM_v18_TT.clik

clik version 6dc2a8cf3965
smica
Checking likelihood './data/clik/hi_l/plik/plik_dx11dr2_HM_v18_TT.clik' on test data. got 380.979 expected 380.979 (diff 8.68135e09)

TT from l=0 to l= 2508
Clik will run with the following nuisance parameters:
A_cib_217
cib_index
xi_sz_cib
A_sz
ps_A_100_100
ps_A_143_143
ps_A_143_217
ps_A_217_217
ksz_norm
gal545_A_100
gal545_A_143
gal545_A_143_217
gal545_A_217
calib_100T
calib_217T
A_planck
Using clik with likelihood file
./data/clik/low_l/commander/commander_rc2_v1.1_l2_29_B.clik

clik version 6dc2a8cf3965
gibbs_gauss 1478fb2d28fa49aca8ae677dbdc3600a
Checking likelihood './data/clik/low_l/commander/commander_rc2_v1.1_l2_29_B.clik' on test data. got 7.32304 expected 7.32304 (diff 2.52096e10)

TT from l=0 to l= 29
Clik will run with the following nuisance parameters:
A_planck
Doing nonlinear Pk: F
Doing CMB lensing: T
Doing nonlinear lensing: T
TT lmax = 2508
EE lmax = 2500
ET lmax = 2500
BB lmax = 2500
PP lmax = 2500
lmax_computed_cl = 2508
Computing tensors: F
max_eta_k = 14000.00
transfer kmax = 5.000000
adding parameters for: smica_g30_ftl_full_pp
adding parameters for: BKPlanck_detset_comb_dust
adding parameters for: commander_rc2_v1.1_l2_29_B
adding parameters for: plik_dx11dr2_HM_v18_TT
Fast divided into 1 blocks
22 parameters ( 8 slow ( 0 semislow), 14 fast ( 0 semifast))
Time for theory: 2.60129
Time for smica_g30_ftl_full_pp: 1.122732646763325E004
Time for BKPlanck_detset_comb_dust: 2.658066805452108E004
Time for commander_rc2_v1.1_l2_29_B: 4.227529279887676E005
Time for plik_dx11dr2_HM_v18_TT: 1.119635067880154E002
loglike chisq
21.932 43.864 CMB: BKPLANCK = BKPlanck_detset_comb_dust
15.348 30.696 CMB: lensing = smica_g30_ftl_full_pp
634.530 1269.060 CMB: plik = plik_dx11dr2_HM_v18_TT
9.002 18.005 CMB: lowl = commander_rc2_v1.1_l2_29_B
Test likelihoods done, total logLike, chieq = 680.937 1361.875
Expected likelihoods, total logLike, chieq = 5859.141 11718.282
** Likelihoods do not match **
MpiStop: 0

MPI_ABORT was invoked on rank 0 in communicator MPI_COMM_WORLD
with errorcode 256.
NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
You may or may not see output from other processes, depending on
exactly when Open MPI kills them.

purnalingam@IDL:~/workspace/CosmoMCNov2016$ mpirun np 1 ./cosmomc test_planck.ini
Number of MPI processes: 1
file_root:test
Random seeds: 30574, 9385 rand_inst: 1
Using clik with likelihood file
./data/clik/hi_l/plik/plik_dx11dr2_HM_v18_TT.clik

clik version 6dc2a8cf3965
smica
Checking likelihood './data/clik/hi_l/plik/plik_dx11dr2_HM_v18_TT.clik' on test data. got 380.979 expected 380.979 (diff 8.68135e09)

TT from l=0 to l= 2508
Clik will run with the following nuisance parameters:
A_cib_217
cib_index
xi_sz_cib
A_sz
ps_A_100_100
ps_A_143_143
ps_A_143_217
ps_A_217_217
ksz_norm
gal545_A_100
gal545_A_143
gal545_A_143_217
gal545_A_217
calib_100T
calib_217T
A_planck
Using clik with likelihood file
./data/clik/low_l/commander/commander_rc2_v1.1_l2_29_B.clik

clik version 6dc2a8cf3965
gibbs_gauss 1478fb2d28fa49aca8ae677dbdc3600a
Checking likelihood './data/clik/low_l/commander/commander_rc2_v1.1_l2_29_B.clik' on test data. got 7.32304 expected 7.32304 (diff 2.52096e10)

TT from l=0 to l= 29
Clik will run with the following nuisance parameters:
A_planck
Doing nonlinear Pk: F
Doing CMB lensing: T
Doing nonlinear lensing: T
TT lmax = 2508
EE lmax = 2500
ET lmax = 2500
BB lmax = 2500
PP lmax = 2500
lmax_computed_cl = 2508
Computing tensors: F
max_eta_k = 14000.00
transfer kmax = 5.000000
adding parameters for: smica_g30_ftl_full_pp
adding parameters for: BKPlanck_detset_comb_dust
adding parameters for: commander_rc2_v1.1_l2_29_B
adding parameters for: plik_dx11dr2_HM_v18_TT
Fast divided into 1 blocks
22 parameters ( 8 slow ( 0 semislow), 14 fast ( 0 semifast))
Time for theory: 2.60129
Time for smica_g30_ftl_full_pp: 1.122732646763325E004
Time for BKPlanck_detset_comb_dust: 2.658066805452108E004
Time for commander_rc2_v1.1_l2_29_B: 4.227529279887676E005
Time for plik_dx11dr2_HM_v18_TT: 1.119635067880154E002
loglike chisq
21.932 43.864 CMB: BKPLANCK = BKPlanck_detset_comb_dust
15.348 30.696 CMB: lensing = smica_g30_ftl_full_pp
634.530 1269.060 CMB: plik = plik_dx11dr2_HM_v18_TT
9.002 18.005 CMB: lowl = commander_rc2_v1.1_l2_29_B
Test likelihoods done, total logLike, chieq = 680.937 1361.875
Expected likelihoods, total logLike, chieq = 5859.141 11718.282
** Likelihoods do not match **
MpiStop: 0

MPI_ABORT was invoked on rank 0 in communicator MPI_COMM_WORLD
with errorcode 256.
NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
You may or may not see output from other processes, depending on
exactly when Open MPI kills them.


 Posts: 1369
 Joined: September 23 2004
 Affiliation: University of Sussex
 Contact:
Re: Building Planck likelihood
If you've changed from the default lowTEB likelihood in test_planck.ini, you can't expect the likelihoods to still match the test value.

 Posts: 19
 Joined: March 03 2017
 Affiliation: IIT KANPUR
 Contact:
Building Planck likelihood
oh ok ty sir but the same error persists when I run the default test.ini .Please look at the following results.
purnalingam@IDL:~/workspace/CosmoMCNov2016$ mpirun np 1 ./cosmomc test.ini
Number of MPI processes: 1
file_root:test
Random seeds: 9548, 22300 rand_inst: 1
Doing nonlinear Pk: F
Doing CMB lensing: T
Doing nonlinear lensing: T
TT lmax = 2500
EE lmax = 2500
ET lmax = 2500
BB lmax = 2500
PP lmax = 2500
lmax_computed_cl = 2500
Computing tensors: F
max_eta_k = 14000.00
transfer kmax = 5.000000
adding parameters for: smica_g30_ftl_full_pp
adding parameters for: BKPlanck_detset_comb_dust
Fast divided into 2 blocks
Block breaks at: 7
8 parameters ( 5 slow ( 0 semislow), 3 fast ( 0 semifast))
skipped unused params: acib217 xi asz143 aps100 aps143 aps143217 aps217 aksz kgal100 kgal143 kgal143217 kgal217 cal0 cal2
Time for theory: 2.68714
Time for smica_g30_ftl_full_pp: 1.212891656905413E004
Time for BKPlanck_detset_comb_dust: 2.706903032958508E004
loglike chisq
21.932 43.864 CMB: BKPLANCK = BKPlanck_detset_comb_dust
15.349 30.698 CMB: lensing = smica_g30_ftl_full_pp
Test likelihoods done, total logLike, chieq = 37.281 74.562
Expected likelihoods, total logLike, chieq = 28.337 56.674
** Likelihoods do not match **
MpiStop: 0

MPI_ABORT was invoked on rank 0 in communicator MPI_COMM_WORLD
with errorcode 256.
NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
You may or may not see output from other processes, depending on
exactly when Open MPI kills them.

purnalingam@IDL:~/workspace/CosmoMCNov2016$ mpirun np 1 ./cosmomc test.ini
Number of MPI processes: 1
file_root:test
Random seeds: 9548, 22300 rand_inst: 1
Doing nonlinear Pk: F
Doing CMB lensing: T
Doing nonlinear lensing: T
TT lmax = 2500
EE lmax = 2500
ET lmax = 2500
BB lmax = 2500
PP lmax = 2500
lmax_computed_cl = 2500
Computing tensors: F
max_eta_k = 14000.00
transfer kmax = 5.000000
adding parameters for: smica_g30_ftl_full_pp
adding parameters for: BKPlanck_detset_comb_dust
Fast divided into 2 blocks
Block breaks at: 7
8 parameters ( 5 slow ( 0 semislow), 3 fast ( 0 semifast))
skipped unused params: acib217 xi asz143 aps100 aps143 aps143217 aps217 aksz kgal100 kgal143 kgal143217 kgal217 cal0 cal2
Time for theory: 2.68714
Time for smica_g30_ftl_full_pp: 1.212891656905413E004
Time for BKPlanck_detset_comb_dust: 2.706903032958508E004
loglike chisq
21.932 43.864 CMB: BKPLANCK = BKPlanck_detset_comb_dust
15.349 30.698 CMB: lensing = smica_g30_ftl_full_pp
Test likelihoods done, total logLike, chieq = 37.281 74.562
Expected likelihoods, total logLike, chieq = 28.337 56.674
** Likelihoods do not match **
MpiStop: 0

MPI_ABORT was invoked on rank 0 in communicator MPI_COMM_WORLD
with errorcode 256.
NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
You may or may not see output from other processes, depending on
exactly when Open MPI kills them.


 Posts: 19
 Joined: March 03 2017
 Affiliation: IIT KANPUR
 Contact:
Building Planck likelihood
This is what I am getting when I run default test_planck.ini sir.Please help.
purnalingam@IDL:~/workspace/CosmoMCNov2016$ mpirun np 1 ./cosmomc test_planck.ini
Number of MPI processes: 1
file_root:test
Random seeds: 7996, 12392 rand_inst: 1
Using clik with likelihood file
./data/clik/hi_l/plik/plik_dx11dr2_HM_v18_TT.clik

clik version 6dc2a8cf3965
smica
Checking likelihood './data/clik/hi_l/plik/plik_dx11dr2_HM_v18_TT.clik' on test data. got 380.979 expected 380.979 (diff 8.68135e09)

TT from l=0 to l= 2508
Clik will run with the following nuisance parameters:
A_cib_217
cib_index
xi_sz_cib
A_sz
ps_A_100_100
ps_A_143_143
ps_A_143_217
ps_A_217_217
ksz_norm
gal545_A_100
gal545_A_143
gal545_A_143_217
gal545_A_217
calib_100T
calib_217T
A_planck
Using clik with likelihood file
./data/clik/low_l/bflike/lowl_SMW_70_dx11d_2014_10_03_v5c_Ap.clik
BFLike Ntemp = 2876
BFLike Nq = 1407
BFLike Nu = 1407
BFLike Nside = 16
BFLike Nwrite = 32393560
cls file appears to have 5+ columns
assuming it is a CAMB file with l, TT, EE, BB, TE
info = 0

clik version 6dc2a8cf3965
bflike_smw
Checking likelihood './data/clik/low_l/bflike/lowl_SMW_70_dx11d_2014_10_03_v5c_Ap.clik' on test data. got 5247.87 expected 5247.87 (diff 3.93629e07)

TT from l=0 to l= 29
EE from l=0 to l= 29
BB from l=0 to l= 29
TE from l=0 to l= 29
Clik will run with the following nuisance parameters:
A_planck
Doing nonlinear Pk: F
Doing CMB lensing: T
Doing nonlinear lensing: T
TT lmax = 2508
EE lmax = 2500
ET lmax = 2500
BB lmax = 2500
PP lmax = 2500
lmax_computed_cl = 2508
Computing tensors: F
max_eta_k = 14000.00
transfer kmax = 5.000000
adding parameters for: lowl_SMW_70_dx11d_2014_10_03_v5c_Ap
adding parameters for: smica_g30_ftl_full_pp
adding parameters for: BKPlanck_detset_comb_dust
adding parameters for: plik_dx11dr2_HM_v18_TT
Fast divided into 1 blocks
22 parameters ( 8 slow ( 0 semislow), 14 fast ( 0 semifast))
Time for theory: 2.85964
Time for lowl_SMW_70_dx11d_2014_10_03_v5c_Ap: 0.500910742674023
Time for smica_g30_ftl_full_pp: 1.108569558709860E004
Time for BKPlanck_detset_comb_dust: 2.647771034389734E004
Time for plik_dx11dr2_HM_v18_TT: 1.520338072441518E002
loglike chisq
21.932 43.864 CMB: BKPLANCK = BKPlanck_detset_comb_dust
15.348 30.696 CMB: lensing = smica_g30_ftl_full_pp
634.530 1269.060 CMB: plik = plik_dx11dr2_HM_v18_TT
5250.022 10500.044 CMB: lowTEB = lowl_SMW_70_dx11d_2014_10_03_v5c_Ap
Test likelihoods done, total logLike, chieq = 5921.957 11843.914
Expected likelihoods, total logLike, chieq = 5859.141 11718.282
** Likelihoods do not match **
MpiStop: 0

MPI_ABORT was invoked on rank 0 in communicator MPI_COMM_WORLD
with errorcode 256.
NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
You may or may not see output from other processes, depending on
exactly when Open MPI kills them.

purnalingam@IDL:~/workspace/CosmoMCNov2016$ mpirun np 1 ./cosmomc test_planck.ini
Number of MPI processes: 1
file_root:test
Random seeds: 7996, 12392 rand_inst: 1
Using clik with likelihood file
./data/clik/hi_l/plik/plik_dx11dr2_HM_v18_TT.clik

clik version 6dc2a8cf3965
smica
Checking likelihood './data/clik/hi_l/plik/plik_dx11dr2_HM_v18_TT.clik' on test data. got 380.979 expected 380.979 (diff 8.68135e09)

TT from l=0 to l= 2508
Clik will run with the following nuisance parameters:
A_cib_217
cib_index
xi_sz_cib
A_sz
ps_A_100_100
ps_A_143_143
ps_A_143_217
ps_A_217_217
ksz_norm
gal545_A_100
gal545_A_143
gal545_A_143_217
gal545_A_217
calib_100T
calib_217T
A_planck
Using clik with likelihood file
./data/clik/low_l/bflike/lowl_SMW_70_dx11d_2014_10_03_v5c_Ap.clik
BFLike Ntemp = 2876
BFLike Nq = 1407
BFLike Nu = 1407
BFLike Nside = 16
BFLike Nwrite = 32393560
cls file appears to have 5+ columns
assuming it is a CAMB file with l, TT, EE, BB, TE
info = 0

clik version 6dc2a8cf3965
bflike_smw
Checking likelihood './data/clik/low_l/bflike/lowl_SMW_70_dx11d_2014_10_03_v5c_Ap.clik' on test data. got 5247.87 expected 5247.87 (diff 3.93629e07)

TT from l=0 to l= 29
EE from l=0 to l= 29
BB from l=0 to l= 29
TE from l=0 to l= 29
Clik will run with the following nuisance parameters:
A_planck
Doing nonlinear Pk: F
Doing CMB lensing: T
Doing nonlinear lensing: T
TT lmax = 2508
EE lmax = 2500
ET lmax = 2500
BB lmax = 2500
PP lmax = 2500
lmax_computed_cl = 2508
Computing tensors: F
max_eta_k = 14000.00
transfer kmax = 5.000000
adding parameters for: lowl_SMW_70_dx11d_2014_10_03_v5c_Ap
adding parameters for: smica_g30_ftl_full_pp
adding parameters for: BKPlanck_detset_comb_dust
adding parameters for: plik_dx11dr2_HM_v18_TT
Fast divided into 1 blocks
22 parameters ( 8 slow ( 0 semislow), 14 fast ( 0 semifast))
Time for theory: 2.85964
Time for lowl_SMW_70_dx11d_2014_10_03_v5c_Ap: 0.500910742674023
Time for smica_g30_ftl_full_pp: 1.108569558709860E004
Time for BKPlanck_detset_comb_dust: 2.647771034389734E004
Time for plik_dx11dr2_HM_v18_TT: 1.520338072441518E002
loglike chisq
21.932 43.864 CMB: BKPLANCK = BKPlanck_detset_comb_dust
15.348 30.696 CMB: lensing = smica_g30_ftl_full_pp
634.530 1269.060 CMB: plik = plik_dx11dr2_HM_v18_TT
5250.022 10500.044 CMB: lowTEB = lowl_SMW_70_dx11d_2014_10_03_v5c_Ap
Test likelihoods done, total logLike, chieq = 5921.957 11843.914
Expected likelihoods, total logLike, chieq = 5859.141 11718.282
** Likelihoods do not match **
MpiStop: 0

MPI_ABORT was invoked on rank 0 in communicator MPI_COMM_WORLD
with errorcode 256.
NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
You may or may not see output from other processes, depending on
exactly when Open MPI kills them.


 Posts: 1369
 Joined: September 23 2004
 Affiliation: University of Sussex
 Contact:
Re: Building Planck likelihood
Sure you didn't change any other parameters in the .ini files (or included ones?). Check with a clean checkout of cosmomc if in doubt.

 Posts: 19
 Joined: March 03 2017
 Affiliation: IIT KANPUR
 Contact:
Building Planck likelihood
Sir, Actually I am running both cases.
1. without any additional parameters(the default code).
2. with 3 new theory parameters
I am getting the same mismatch in the likelihoods.If I have new parameters, should I ignore this error and continue with action = 0.
Thanks in advance.
1. without any additional parameters(the default code).
2. with 3 new theory parameters
I am getting the same mismatch in the likelihoods.If I have new parameters, should I ignore this error and continue with action = 0.
Thanks in advance.

 Posts: 43
 Joined: August 15 2016
 Affiliation: Oskar Klein Centre, Stockholm University
Building Planck likelihood
Could you please post your .ini file for the first case here (without any additional parameters)? I would just like to doublecheck and make sure you didn't inadvertently change something.
Building Planck likelihood
Just as a tip for debugging, if you are running CosmoMC in likelihood mode you needn't check it on MPI. The MPI will try and run lots of different processes, all just checking the likelihood. If you're using action = 4 you can just run it for the console.
As an aside question @Sunny and @Antony, should the test likelihood be identical to the expected likelihood? I think I might have checked and when it was close enough I just thought, well that's okay and carried on. Should I have configured them for indistinguishability??
Luke
As an aside question @Sunny and @Antony, should the test likelihood be identical to the expected likelihood? I think I might have checked and when it was close enough I just thought, well that's okay and carried on. Should I have configured them for indistinguishability??
Luke

 Posts: 19
 Joined: March 03 2017
 Affiliation: IIT KANPUR
 Contact:
Building Planck likelihood
Sorry for all the trouble I have once change tau value to 0.07 as it was giving error.That is is the cause of the likelihood mismatch.
ty so much.
but one more clarification.
I am adding 3 more theory parameters, by running with action = 4 I get the error likelihoods doesn't match.I have to confirm that can I start running action = 0 for my modified code?
thanks in advance.
ty so much.
but one more clarification.
I am adding 3 more theory parameters, by running with action = 4 I get the error likelihoods doesn't match.I have to confirm that can I start running action = 0 for my modified code?
thanks in advance.

 Posts: 1369
 Joined: September 23 2004
 Affiliation: University of Sussex
 Contact:
Re: Building Planck likelihood
The test files should run with "OK" result if the input files are unmodified, or any new parameter central values are set such that they have no impact on CAMB's theoretical predictions for the default model.

 Posts: 19
 Joined: March 03 2017
 Affiliation: IIT KANPUR
 Contact:
Building Planck likelihood
Ty so much sir, it is up and running.