National Computational Infrastructure (NCI) Mass Data Storage System (MDSS) command module.
This module uses subprocess.Popen objects to execute MDSS commands. Forking processes inside MPI can be problematic, for example see OpenMPI FAQ 38 and OpenMPI FAQ 19 for OpenMPI related issues. If segmentation-faults occur during the fork of the MDSS processes, one can try to exclude the Infini-band transport layer (openib) by supplying the following mpirun (OpenMPI) argument:
mpirun -np 8 --mca btl self,sm,tcp python script.py
Forking is safe under recent linux kernels, recent OpenMPI versions and using only the self, shared-memory and TCP Byte-Transport-Layers (BTLs).
Indicates whether the “mdss” executable could be located.
| du([files, unit, project]) | Disk usage for files/directories in MDSS. |
| exists(file[, project]) | Returns whether specified file/directory exists on the MDSS file system. |
| get(files[, dest, recursive, project]) | Copies a file (or files) from MDSS to a specified location. |
| isfile(file[, project]) | Returns whether specified file is a plain file or link to a file. |
| isdir(file[, project]) | Returns whether specified file is a directory or link to a directory. |
| listdir([dir, project, all, appendType, ...]) | Lists file(s) in specified MDSS directory. |
| mkdir(dir[, mode, project]) | Creates MDSS directory. |
| makedirs(dirs[, mode, project]) | Creates MDSS directory with parent directories as necessary. |
| mv(files, dest[, project]) | Move/rename files/directories in MDSS. |
| put(files[, dest, recursive, wait, project]) | Copies a file (or files) from a specified location to MDSS. |
| remove(files[, project]) | Removes specified files (not directories) from MDSS. |
| rmdir(files[, project]) | Removes specified directories from MDSS. |
| rmtree(files[, project]) | Recursively removes specified files/directories from MDSS. |
| stage(files[, recursive, wait, project]) | Tell the mass-data filesystem that the nominated files will be accessed soon. |
| setDefaultProject([project]) | Sets the default project string for MDSS commands. |
| getDefaultProject() | Returns the default project string for MDSS commands. |