Too many files in the SAVE directory

Various technical topics such as parallelism and efficiency, netCDF problems, the Yambo code structure itself, are posted here.

Moderators: Daniele Varsano, andrea.ferretti, andrea marini, Conor Hogan, myrta gruning

Too many files in the SAVE directory

Postby javad » Wed Sep 16, 2015 4:18 pm

Dear yambo developers

I'm performing different BSE calculations with Yambo, to check parameters and so on, but I have a problem.

When I try to erase the old files in the SAVE folder, doing

Code: Select all
rm SAVE/ndb.BS*


I get the error message

Code: Select all
bash: /bin/rm: Argument list too long


it there a way to generate less files in the SAVE folder?

Javad
Javad Exirifard
IPM - Institute for Research in Fundamental Sciences
P. O. Box 19395-5746
Niavaran Square
Tehran, Iran
javad
 
Posts: 30
Joined: Fri Feb 28, 2014 10:23 pm

Re: Too many files in the SAVE directory

Postby Daniele Varsano » Wed Sep 16, 2015 4:37 pm

Dear Javad,

This is a known problem, here some workarounds:


Solution 1: Parallelize the BSE over the K-points e.g.:
Code: Select all
BS_CPU= "16 1 1"              # [PARALLEL] CPUs for each role
BS_ROLEs= "k eh t" 


Solution 2: Avoid to write database on file:
Code: Select all
DBsIOoff="BS"


Solution 1, the more cpu you use, lesser files you will have in the SAVE dir.
Solution 2, preferred. Any file will be written on disk, so you have to diagonalize it on the same run. Drawbacks, any restart is possible.

In an internal devel version we have implemented a way to soften this problem by avoiding this huge fragmentation. We will insert it in the release very soon.

Best,

Daniele
Dr. Daniele Varsano
S3-CNR Institute of Nanoscience and MaX Center, Italy
MaX - Materials design at the Exascale
http://www.nano.cnr.it
http://www.max-centre.eu/
User avatar
Daniele Varsano
 
Posts: 1973
Joined: Tue Mar 17, 2009 2:23 pm

Re: Too many files in the SAVE directory

Postby Davide Sangalli » Wed Sep 16, 2015 4:59 pm

Dear Javad,
another quick suggestion which may help is to run yambo with the -J JOBNAME option.
In this way the run will create a folder named JOBANAME and put there all the ndb.BS* files
Thus to erase them you can simply run: rm -r JOBNAME

This will avoid the problem.

Best,
D.
Davide Sangalli, PhD
CNR-ISM, Division of Ultrafast Processes in Materials (FLASHit) and MaX Centre
http://www.ism.cnr.it/en/davide-sangalli-cv/
http://www.max-centre.eu/
User avatar
Davide Sangalli
 
Posts: 314
Joined: Tue May 29, 2012 4:49 pm
Location: Via Salaria Km 29.3, CP 10, 00016, Monterotondo Stazione, Italy


Return to Technical Issues

Who is online

Users browsing this forum: No registered users and 1 guest