Difference between revisions of "RICH software and analysis"

From EIC-eRD14
Jump to: navigation, search
 
(14 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
= source code location =
 
= source code location =
  
pythia6 https://jlabsvn.jlab.org/svnroot/eic/evgen/pythiaeRHIC/1.0.0/
+
pythia6 docker container
 +
https://github.com/eictool/container/blob/master/log_evgen_pythia6
  
 
mRICH in JLEIC det1  https://github.com/EIC-eRD11/det1_rich_modular_eleside
 
mRICH in JLEIC det1  https://github.com/EIC-eRD11/det1_rich_modular_eleside
Line 10: Line 11:
  
 
general instruction running GEMC on ifarm at https://eic.jlab.org/wiki/index.php/EIC_Software#on_ifarm
 
general instruction running GEMC on ifarm at https://eic.jlab.org/wiki/index.php/EIC_Software#on_ifarm
 +
 +
run code in graphic mode on ifarm https://hallaweb.jlab.org/wiki/index.php/Ifarm_graphic_mode
  
 
The code to run farm jobs are at /work/eic/sim/eic_gemc/JLAB_VERSION_1.3/RICH
 
The code to run farm jobs are at /work/eic/sim/eic_gemc/JLAB_VERSION_1.3/RICH
Line 15: Line 18:
 
run "./LongRun_sim" and Give the start run number as 1, then Give the end  run number 100.  100 jobs will be launched.  
 
run "./LongRun_sim" and Give the start run number as 1, then Give the end  run number 100.  100 jobs will be launched.  
  
The main code is in "do_it_all.sh"
+
"LongRun_sim" calls "exec_sim" to create farm job submission script and submit them. Each job runs the main code "do_it_all.sh"
  
= simulation data location =
+
check job status "jobstat -u $USER" and log ~/.farm_out/
pythia6 events with both RICH simulation file
+
  
each file have 1e3 events and about 1GB size
+
refer to jlab farm https://scicomp.jlab.org
  
They are at jlab disk location
 
  
  /work/eic/sim/eic_gemc/JLAB_VERSION_1.3/RICH/
+
= simulation data location =
  output1/out.*.root (1st try)
+
 
  output2/out.*.root (2nd try, dRICH refraction index change,mRICH has no change)
+
They are at jlab computing
 +
 +
  /mss/eic/sim/eic_gemc/JLAB_VERSION_1.3/RICH/
 +
  tape location which can't be access directly.
 +
 
 +
/lustre/expphy/cache/eic/sim/eic_gemc/JLAB_VERSION_1.3/RICH
 +
  disk location which can be accessed directly,
 +
  files are gone back to tape if not used for a while, can get back from tape by "jcache get file_fullpath_on_mss", refer to https://scicomp.jlab.org/docs/%20
 +
   
 +
dir structure as follows
 +
output_flat_geo1gen1/yesfield
 +
output_flat_geo1gen1/nofield
 +
output_pythia6_geo1gen1/yesfield
 +
output_pythia6_geo1gen1/nofield
 +
 +
simulation files have both RICH
 +
each pythia6 file has 1e3 events and about 1GB size,  
 +
about 1000 files or 1TB are done for pythia6 file with and without field as of 2018/06
 +
each flat file has 1e4 events and about 1GB size
 +
about 100 files or 100GB are done for flat file with and without field as of 2018/06
 +
pythia6 events has no selection of channels
 +
flat events include pi,kaon,proton in each events
  
 
The easiest way would be running your analysis script at jlab ifarm to process the data
 
The easiest way would be running your analysis script at jlab ifarm to process the data
Or you have to download them by using scp from ftp.jlab.org with your jlab account or via [https://scicomp.jlab.org/docs/node/11 globus] (about 2x faster with some setup effort)
+
Or you have to download them by using "scp your_jlab_username@ftp.jlab.org:file_or_dir_fullpath" or via [https://scicomp.jlab.org/docs/node/11 globus] (about 2x faster with some setup effort)
 +
 
 +
= version info =
 +
 
 +
geo1 means geometry version 1, gen means generator version 1
 +
 
 +
detailed version info are in the readme files
 +
/cache/eic/sim/eic_gemc/JLAB_VERSION_1.3/RICH/output_pythia6_geo1gen1/readme
 +
/cache/eic/sim/eic_gemc/JLAB_VERSION_1.3/RICH/output_flat_geo1gen1/readme
 +
also here
 +
https://github.com/EIC-eRD11/det1_rich_modular_eleside  665a5c5
 +
https://github.com/EIC-eRD11/dualRICH_inMEIC/tree/master/gemc_drich/aerogel_c2f6  27e97ec
 +
https://jlabsvn.jlab.org/svnroot/eic/eic_gemc/field/det1_solenoid_hybrid_v1  437
 +
https://jlabsvn.jlab.org/svnroot/eic/evgen/pythiaeRHIC/1.0.0 529
  
 
= working at jlab ifarm =
 
= working at jlab ifarm =

Latest revision as of 18:21, 31 May 2019

source code location

pythia6 docker container https://github.com/eictool/container/blob/master/log_evgen_pythia6

mRICH in JLEIC det1 https://github.com/EIC-eRD11/det1_rich_modular_eleside

dRICH in JLEIC det1 https://github.com/EIC-eRD11/dualRICH_inMEIC/tree/master/gemc_drich/aerogel_c2f6

running simulation and analysis

general instruction running GEMC on ifarm at https://eic.jlab.org/wiki/index.php/EIC_Software#on_ifarm

run code in graphic mode on ifarm https://hallaweb.jlab.org/wiki/index.php/Ifarm_graphic_mode

The code to run farm jobs are at /work/eic/sim/eic_gemc/JLAB_VERSION_1.3/RICH

run "./LongRun_sim" and Give the start run number as 1, then Give the end run number 100. 100 jobs will be launched.

"LongRun_sim" calls "exec_sim" to create farm job submission script and submit them. Each job runs the main code "do_it_all.sh"

check job status "jobstat -u $USER" and log ~/.farm_out/

refer to jlab farm https://scicomp.jlab.org


simulation data location

They are at jlab computing

/mss/eic/sim/eic_gemc/JLAB_VERSION_1.3/RICH/
tape location which can't be access directly.
/lustre/expphy/cache/eic/sim/eic_gemc/JLAB_VERSION_1.3/RICH 
disk location which can be accessed directly, 
files are gone back to tape if not used for a while, can get back from tape by "jcache get file_fullpath_on_mss", refer to https://scicomp.jlab.org/docs/%20

dir structure as follows
output_flat_geo1gen1/yesfield
output_flat_geo1gen1/nofield
output_pythia6_geo1gen1/yesfield
output_pythia6_geo1gen1/nofield

simulation files have both RICH
each pythia6 file has 1e3 events and about 1GB size, 
about 1000 files or 1TB are done for pythia6 file with and without field as of 2018/06
each flat file has 1e4 events and about 1GB size 
about 100 files or 100GB are done for flat file with and without field as of 2018/06
pythia6 events has no selection of channels
flat events include pi,kaon,proton in each events

The easiest way would be running your analysis script at jlab ifarm to process the data Or you have to download them by using "scp your_jlab_username@ftp.jlab.org:file_or_dir_fullpath" or via globus (about 2x faster with some setup effort)

version info

geo1 means geometry version 1, gen means generator version 1

detailed version info are in the readme files
/cache/eic/sim/eic_gemc/JLAB_VERSION_1.3/RICH/output_pythia6_geo1gen1/readme
/cache/eic/sim/eic_gemc/JLAB_VERSION_1.3/RICH/output_flat_geo1gen1/readme
also here
https://github.com/EIC-eRD11/det1_rich_modular_eleside   665a5c5 
https://github.com/EIC-eRD11/dualRICH_inMEIC/tree/master/gemc_drich/aerogel_c2f6   27e97ec
https://jlabsvn.jlab.org/svnroot/eic/eic_gemc/field/det1_solenoid_hybrid_v1  437
https://jlabsvn.jlab.org/svnroot/eic/evgen/pythiaeRHIC/1.0.0 529

working at jlab ifarm

ssh -X your_jlab_username@login.jlab.org

ssh -X ifarm

source /group/eic/eic_svn/set_eic (this set up env for simulation including a root)

cd /work/eic/(your_jlab_username)