## CosmoMC can't obtain root.converge_stat

Use of Healpix, camb, CLASS, cosmomc, compilers, etc.
Tian Qiu
Posts: 12
Joined: June 01 2017
Affiliation: University of Science and Technology of China

### CosmoMC can''t obtain root.converge_stat

I run CosmoMC on a cluster.
Everything seems to work well except the converge file. I can't get the root.converge_stat when the others are fine such as *.txt, *data, *.log, *.inputparams, etc.
At the meanwhile, there is no feedback about the R-1 showed below, in which there are only such things.

Code: Select all

 Chain&#58;1 drag accpt&#58;  0.4855783     fast/slow   72.54875     slow&#58;       33186
Chain&#58;13 drag accpt&#58;  0.4834013     fast/slow   72.26221     slow&#58;       33343
Chain&#58;6 drag accpt&#58;  0.4857524     fast/slow   72.30187     slow&#58;       33418
Chain&#58;11 drag accpt&#58;  0.4792885     fast/slow   72.25761     slow&#58;       33771
Chain&#58;9 drag accpt&#58;  0.4833719     fast/slow   72.40794     slow&#58;       33378
Chain&#58;10 drag accpt&#58;  0.4827319     fast/slow   72.31480     slow&#58;       33427
Chain&#58;8 drag accpt&#58;  0.4820674     fast/slow   72.17249     slow&#58;       33452
Chain&#58;3 drag accpt&#58;  0.4805302     fast/slow   72.22508     slow&#58;       33454
Chain&#58;15 drag accpt&#58;  0.4796885     fast/slow   72.20305     slow&#58;       33578
Chain&#58;0 drag accpt&#58;  0.4796197     fast/slow   72.22173     slow&#58;       33311
Chain&#58;12 drag accpt&#58;  0.4818384     fast/slow   72.20877     slow&#58;       33577
Chain&#58;4 drag accpt&#58;  0.4814351     fast/slow   72.46579     slow&#58;       33350

So I do not know when the program will shutdown, and how much my convergence is. I run CosmoMC for a long time but it never stops.
Anyone has the same problem? How can I fix this? Thanks a lot.

Ira *Wolfson
Posts: 64
Joined: January 24 2013
Affiliation: BGU
Contact:

### CosmoMC can''t obtain root.converge_stat

Please post the .ini fie you are using.

It is possible you are simulating over a degree of freedom the data do not constrain.

In such a case it will take an inordinate amount of time for the burn in to finish and CosmoMC to produce the .converge_stat file.

It might also be the case if that is indeed what you are doing that convergence will never be achieved....

As a rule for posting, I recommend specifying your machine specs, the compiler you used and the .ini file you use.

-- Ira

Tian Qiu
Posts: 12
Joined: June 01 2017
Affiliation: University of Science and Technology of China

### Re: CosmoMC can''''t obtain root.converge_stat

Ira *Wolfson wrote:Please post the .ini fie you are using.

It is possible you are simulating over a degree of freedom the data do not constrain.

In such a case it will take an inordinate amount of time for the burn in to finish and CosmoMC to produce the .converge_stat file.

It might also be the case if that is indeed what you are doing that convergence will never be achieved....

As a rule for posting, I recommend specifying your machine specs, the compiler you used and the .ini file you use.

-- Ira
Thank you for reply. I post the ini file below,

Code: Select all

#general settings
#Bicep-Keck-Planck, varying cosmological parameters
DEFAULT&#40;batch2/BKPlanck.ini&#41;

#Planck 2015, default just include native likelihoods &#40;others require clik&#41;
DEFAULT&#40;batch2/plik_dx11dr2_DS_v18_TT.ini&#41;
#DEFAULT&#40;batch2/lowTEB.ini&#41;
DEFAULT&#40;batch2/lowl.ini&#41;
#DEFAULT&#40;batch2/lensing.ini&#41;

#Other Likelihoods
#DEFAULT&#40;batch2/BAO.ini&#41;
#DEFAULT&#40;batch2/WiggleZ_MPK.ini&#41;
#DEFAULT&#40;batch2/MPK.ini&#41;
#DEFAULT&#40;batch2/WL.ini&#41;

#general settings
DEFAULT&#40;batch2/common.ini&#41;

#e.g. to vary r in addition to standard 6&#58;
#&#40;for r>0 also need compute_tensors=T&#41;
#compute_tensors = T
#param&#91;r&#93; = 0.03 0 2 0.04 0.04

#high for new runs
MPI_Max_R_ProposeUpdate = 30

propose_matrix= planck_covmats/base_TT_lowTEB_plik.covmat

#Folder where files &#40;chains, checkpoints, etc.&#41; are stored
root_dir = tTT+lowP/
#Root name for files produced
file_root=Planck TT+lowP
#action= 0 runs chains, 1 importance samples, 2 minimizes
#use action=4 just to quickly test likelihoods
action = 0

#expected result for -&#40;log like&#41;
test_check_compare = 28.337

#if you want to get theory cl for test point
#test_output_root = output_cl_root

start_at_bestfit =F
feedback=1
use_fast_slow = T

checkpoint = T

#sampling_method=7 is a new fast-slow scheme good for Planck
sampling_method = 7
dragging_steps  = 3
propose_scale = 2

#Set >0 to make data files for importance sampling
indep_sample=10

#these are just small speedups for testing
get_sigma8=T

#Uncomment this if you don't want one 0.06eV neutrino by default
#num_massive_neutrinos=
#to vary parameters set param&#91;name&#93;= center, min, max, start width, propose width
#param&#91;mnu&#93; = 0 0 0 0 0

#cosmology_calculator=PICO
#pico_datafile = pico3_tailmonty_v34.dat
ico_verbose=F

The system is CentOS 6.6 and I compiled via ifort 17.0.3. Any advice? I am not familiar with these.

Yutong Wang
Posts: 9
Joined: May 06 2014
Affiliation: UCAS

### CosmoMC can''''t obtain root.converge_stat

I met the same problem, when I use the old version of ifort, there is no problems, and when I change the ifort 17.0.3,there are some problems,such as there is no .chk file,and can't obtain root.converge_stat

And by the way, what's your version number of MPI? I suspect the problem may be cause by the lastest MPI

Tian Qiu
Posts: 12
Joined: June 01 2017
Affiliation: University of Science and Technology of China

### Re: CosmoMC can''''''''t obtain root.converge_stat

Yutong Wang wrote:I met the same problem, when I use the old version of ifort, there is no problems, and when I change the ifort 17.0.3,there are some problems,such as there is no .chk file,and can't obtain root.converge_stat

And by the way, what's your version number of MPI? I suspect the problem may be cause by the lastest MPI
You reminded me that when I used the the old version 16.0.0, there was no problem. However after I ran it on a new cluster with ifort 17.0.3, it happened.
Now I use the Intel MPI version 2017 update 2. Before, I used the Open MPI 1.6.2, and there was no problem. Any idea?

Ira *Wolfson
Posts: 64
Joined: January 24 2013
Affiliation: BGU
Contact:

### CosmoMC can''t obtain root.converge_stat

I was having the same problems.

I was finally reduced to using the last version (November release),
with ifort compiler 16.3.

I don't know what's the deal with the code and ifort 17.xxx is...

Maybe Antony can clarify this...

Tian Qiu
Posts: 12
Joined: June 01 2017
Affiliation: University of Science and Technology of China

### Re: CosmoMC can''''t obtain root.converge_stat

Ira *Wolfson wrote:I was having the same problems.

I was finally reduced to using the last version (November release),
with ifort compiler 16.3.

I don't know what's the deal with the code and ifort 17.xxx is...

Maybe Antony can clarify this...
So it is the problem between the latest ifort version and CosmoMC. I will try the 16 one. Thank you.

Tian Qiu
Posts: 12
Joined: June 01 2017
Affiliation: University of Science and Technology of China

### Re: CosmoMC can''''t obtain root.converge_stat

Ira *Wolfson wrote:I was having the same problems.

I was finally reduced to using the last version (November release),
with ifort compiler 16.3.

I don't know what's the deal with the code and ifort 17.xxx is...

Maybe Antony can clarify this...
I can get the .chk now with ifort 16.0.4. However there was no .converge_stat still.

Ira *Wolfson
Posts: 64
Joined: January 24 2013
Affiliation: BGU
Contact:

### CosmoMC can''t obtain root.converge_stat

Have you seen an output saying that "burn-in" is done?

Tian Qiu
Posts: 12
Joined: June 01 2017
Affiliation: University of Science and Technology of China

### Re: CosmoMC can''''t obtain root.converge_stat

Ira *Wolfson wrote:Have you seen an output saying that "burn-in" is done?
Oh, it was obtained after a while. Maybe my machine works slowly. lol
Thank you.

Luke Hart
Posts: 60
Joined: July 13 2015
Affiliation: University of Manchester

### Re: CosmoMC can't obtain root.converge_stat

Has there been any development of this? Our cluster either has ifort14 or ifort17 and the 17 one has seemed to remove the converge_stat variable which is very bizarre? Anyone had any experience with this??

Luke