Running with gitlab-runner 15.5.0 (0d4137b8)
  on BB5 map runner pnPo3yJy
section_start:1667500323:resolve_secrets
Resolving secrets
section_end:1667500323:resolve_secrets
section_start:1667500323:prepare_executor
Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 15.5.0, user 
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor3520643321, slurm job id , CUSTOM_ENV_CI_RUNNER_TAGS is ["bb5_map"]
uid=0(root) gid=0(root) groups=0(root)
root
UID is 0
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 82473, build ref d25690d25bc3812691e66a0abdbef285abbd4b04, job ID 416918
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P82473, optional exclusive flag , optional cpus per task flag --cpus-per-task=8, optional qos flag 
CUSTOM_ENV_CI_RUNNER_TAGS is ["bb5_map"]
uid=0(root) gid=0(root) groups=0(root)
root
UID is 0
A slurm job will be created with name GL_J416918_PROD_P112_CP7_C10
Job parameters: memory=76G, cpus_per_task=8, duration=2:00:00, constraint=cpu ntasks=2 account=proj9998 user=bbpcihpcproj12 partition=prod qos=
Not executing the chown -R
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 969362
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=2 --cpus-per-task=8 --mem=76G   --job-name=GL_J416918_PROD_P112_CP7_C10 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P82473 --time=2:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P82473 --ntasks=2 --jobid=969362 --cpus-per-task=8 --mem=76G    
section_end:1667500324:prepare_executor
section_start:1667500324:prepare_script
Preparing environment
Running on r1i7n21 via bbpv1.epfl.ch...
section_end:1667500329:prepare_script
section_start:1667500329:get_sources
Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1667500329:get_sources
section_start:1667500329:restore_cache
Restoring cache
Checking cache for build:neuron:nmodl:nvhpc:omp:legacy-8-non_protected...
Runtime platform                                    arch=amd64 os=linux pid=167937 revision=58ba2b95 version=14.2.0
cache.zip is up to date                            
Successfully extracted cache
section_end:1667500335:restore_cache
section_start:1667500335:download_artifacts
Downloading artifacts
Downloading artifacts for spack_setup (416909)...
Runtime platform                                    arch=amd64 os=linux pid=168212 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok        id=416909 responseStatus=200 OK token=TKK4-uTd
section_end:1667500336:download_artifacts
section_start:1667500336:step_script
Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ export SPACK_USER_CONFIG_PATH=${PWD}/spack-config
$ mkdir ${SPACK_USER_CONFIG_PATH}
$ cat > ${SPACK_USER_CONFIG_PATH}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack config blame config
---                                                                                                           config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416918/spack-config/config.yaml:2                  build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416918/spack-config/config.yaml:3                  - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416918/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416918/spack-config/config.yaml:4                  source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416918/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/config.yaml:2               ccache: True
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:2                                                            install_tree:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:3                                                              root: $user_cache_path/software
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:4                                                              projections:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:5                                                                all: install_{compiler.name}-{compiler.version}-{target}/{name}-{version}-{hash:6}
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:6                                                            module_roots:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:7                                                              tcl: $user_cache_path/modules
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:9                                                            environments:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:10                                                             root: $user_cache_path/environments
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:88       concretization: separately
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:12                                                           build_jobs: 8
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:18     extensions:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:18     - $spack/bluebrain/spack-scripting
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:19     # This is the path to the root of the Spack install tree.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:19     # You can use $spack here to refer to the root of the spack instance.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:37     template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:37     - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     # Temporary locations Spack can try to use for builds.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     # Recommended options are given below.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     # Builds can be faster in temporary directories on some (e.g., HPC) systems.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     # Specifying `$tempdir` will ensure use of the default temporary directory
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     # (i.e., ``$TMP` or ``$TMPDIR``).
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     # Another option that prevents conflicts and potential permission issues is
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     # to specify `$user_cache_path/stage`, which ensures each user builds in their
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     # home directory.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     # A more traditional path uses the value of `$spack/var/spack/stage`, which
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     # builds directly inside Spack's instance without staging them in a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     # temporary space.  Problems with specifying a path inside a Spack instance
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     # are that it precludes its use as a system package and its ability to be
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     # pip installable.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     # In any case, if the username is not already in the path, Spack will append
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     # the value of `$user` in an attempt to avoid potential conflicts between
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     # users in shared temporary spaces.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     # The build stage can be purged with `spack clean --stage` and
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     # `spack clean -a`, so it is important that the specified directory uniquely
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:38     # identifies Spack staging to avoid accidentally wiping out non-Spack work.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:73     test_stage: $user_cache_path/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:82     misc_cache: $user_cache_path/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:94     connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:99     verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:107    suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:113    install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:118    checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:123    deprecated: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:128    dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:136    build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:145    locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:150    url_fetch_method: urllib
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:176    concretizer: clingo
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:183    db_lock_timeout: 300
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:191    package_lock_timeout: null
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:197    shared_linking: rpath
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:202    allow_sgid: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416909/spack/etc/spack/defaults/config.yaml:207    terminal_title: False
_builtin                                                                                                        debug: False
$ export XDG_CONFIG_HOME=${CI_BUILDS_DIR}/J${CI_JOB_ID}_local_config
$ echo "Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (${XDG_CONFIG_HOME})"
Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P82473/J416918_local_config)
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n  insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n  insteadOf = ssh://git@bbpgitlab.epfl.ch/" >> "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
  insteadOf = git@bbpgitlab.epfl.ch:
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
  insteadOf = ssh://git@bbpgitlab.epfl.ch/
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER} ${SPACK_PACKAGE_SPEC} ${SPACK_PACKAGE_DEPENDENCIES} ${SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron%nvhpc +coreneuron+debug+tests~legacy-unit~rx3d model_tests=channel-benchmark,olfactory,tqperf-heavy  
$ JSON_SPEC=$(spack spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(module load unstable python; echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][\"nodes\"][0][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be 3tcguoujns43b4vjkfzqhjnhfzyx64rp
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=$(realpath -P ${CI_BUILDS_DIR})
$ echo CCACHE_BASEDIR=${CCACHE_BASEDIR}
CCACHE_BASEDIR=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473
$ export CCACHE_MAXSIZE=512M
$ export CCACHE_DIR="${TMPDIR}/ccache"
$ mkdir -p ${CCACHE_DIR}
$ if [ -f ${CI_PROJECT_DIR}/ccache.tar ]; then
$ tar -C "${CCACHE_DIR}" -xf "${CI_PROJECT_DIR}/ccache.tar"
$ fi
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
  Cache directory:  /nvme/bbpcihpcproj12/969362/ccache
  Primary config:   /nvme/bbpcihpcproj12/969362/ccache/ccache.conf
  Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
  Stats updated:    Thu Nov  3 19:32:47 2022
  Hits:                 0 /    0
    Direct:             0 /    0
    Preprocessed:       0 /    0
  Misses:               0
    Direct:             0
    Preprocessed:       0
Primary storage:
  Hits:                 0 /    0
  Misses:               0
  Cache size (GB):   0.47 / 0.51 (91.59 %)
  Files:            15390
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: '3tcguoujns43b4vjkfzqhjnhfzyx64rp'
$ spack spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
 -   neuron%nvhpc+coreneuron+debug~legacy-unit~rx3d+tests model_tests=channel-benchmark,olfactory,tqperf-heavy

Concretized
--------------------------------
 -   3tcguou  neuron@develop%nvhpc@22.3+binary~caliper+coreneuron+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi~profile+python~rx3d+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory,tqperf-heavy patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c sanitizers=None arch=linux-rhel7-skylake
 -   6s6wcfe      ^bison@3.8.2%nvhpc@22.3 arch=linux-rhel7-skylake
 -   ucwiakr      ^cmake@3.21.4%nvhpc@22.3~doc+ncurses+openssl+ownlibs~qt build_type=Release arch=linux-rhel7-skylake
 -   ajxdymq      ^flex@2.6.3%nvhpc@22.3+lex~nls arch=linux-rhel7-skylake
[^]  lswrnpk      ^gettext@0.21%nvhpc@22.3+bzip2+curses+git~libunistring+libxml2+tar+xz patches=6e530daaae14725d578d6cafbf7d523accc9ed29fd817bd421cf98a5f51e9e1b,bbe9f0539aa504966ac104224d25a9260faa1015ed3adda936467be9c7de4eae,fb27a3fb5e414bdc50ffebbbe2da986473df70a493caa4396226f51a67c55424 arch=linux-rhel7-skylake
[^]  h3k3sur          ^bzip2@1.0.8%nvhpc@22.3~debug~pic+shared arch=linux-rhel7-skylake
[^]  f4hjvxq          ^libiconv@1.16%nvhpc@22.3 libs=shared,static arch=linux-rhel7-skylake
[^]  i3pi6vv          ^libxml2@2.9.12%nvhpc@22.3~python patches=05ff238cf435825ef835c7ae39376b52dc83d8caf19e962f0766c841386a305a,10a88ad47f9797cf7cf2d7d07241f665a3b6d1f31fa026728c8c2ae93e1664e9 arch=linux-rhel7-skylake
[^]  6dfyugs              ^pkgconf@1.8.0%nvhpc@22.3 arch=linux-rhel7-skylake
[^]  cqwvvjz              ^xz@5.2.5%nvhpc@22.3~pic libs=shared,static arch=linux-rhel7-skylake
[^]  h7lotu6              ^zlib@1.2.11%nvhpc@22.3+optimize+pic+shared arch=linux-rhel7-skylake
[^]  jpe3but          ^ncurses@6.2%nvhpc@22.3~symlinks+termlib abi=none arch=linux-rhel7-skylake
[^]  zmpra4b          ^tar@1.28%nvhpc@22.3 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-skylake
[^]  pjmdwuu      ^hpe-mpi@2.25.hmpt%nvhpc@22.3 arch=linux-rhel7-skylake
 -   cp3ofsp      ^ninja@1.10.2%nvhpc@22.3 arch=linux-rhel7-skylake
[^]  v2mlx7s      ^py-mpi4py@3.1.2%nvhpc@22.3 arch=linux-rhel7-skylake
[^]  l4z6bjq          ^py-setuptools@57.4.0%nvhpc@22.3 arch=linux-rhel7-skylake
[^]  f62u3oh              ^python@3.9.7%nvhpc@22.3+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87,4c2457325f2b608b1b6a2c63087df8c26e07db3e3d493caf36a56f0ecf6fb768,f2fd060afc4b4618fe8104c4c5d771f36dc55b1db5a4623785a4ea707ec72fb4 arch=linux-rhel7-skylake
[^]  kohlctm      ^py-numpy@1.17.5%gcc@11.2.0+blas+lapack patches=cf407c1024b0878c4222dd352aa9dece412073bb15b138243a2893725434c7b6 arch=linux-rhel7-skylake
[^]  r5cvgru          ^intel-mkl@2020.4.304%gcc@11.2.0~ilp64+shared threads=none arch=linux-rhel7-skylake
[^]  dzkzhqs      ^py-pytest@6.2.4%nvhpc@22.3 arch=linux-rhel7-skylake
[^]  iopgs7j          ^py-attrs@21.2.0%nvhpc@22.3 arch=linux-rhel7-skylake
[^]  prphkb7          ^py-iniconfig@1.1.1%nvhpc@22.3 arch=linux-rhel7-skylake
[^]  iwg6vas          ^py-packaging@21.0%nvhpc@22.3 arch=linux-rhel7-skylake
[^]  o7j2crb              ^py-pyparsing@2.4.7%nvhpc@22.3 arch=linux-rhel7-skylake
[^]  uecslka          ^py-pluggy@0.13.0%nvhpc@22.3 arch=linux-rhel7-skylake
[^]  fjgegze              ^py-setuptools-scm@6.3.2%nvhpc@22.3+toml arch=linux-rhel7-skylake
[^]  xsvykjn                  ^py-tomli@1.2.1%nvhpc@22.3 arch=linux-rhel7-skylake
[^]  ovo4l65                      ^py-pip@21.1.2%nvhpc@22.3 arch=linux-rhel7-skylake
[^]  qhehf4e          ^py-py@1.9.0%nvhpc@22.3 arch=linux-rhel7-skylake
[^]  yg6s277          ^py-toml@0.10.2%nvhpc@22.3 arch=linux-rhel7-skylake
[^]  l6udtg7      ^py-pytest-cov@2.8.1%nvhpc@22.3 arch=linux-rhel7-skylake
[^]  lfjn2o4          ^py-coverage@5.5%nvhpc@22.3 arch=linux-rhel7-skylake
[^]  3333cwm      ^readline@8.1%nvhpc@22.3 arch=linux-rhel7-skylake

$ spack ${SPACK_INSTALL_EXTRA_FLAGS} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC} || install_failed=1
==> Warning: Expected user 904556 to own /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473, but it is owned by 0
==> bison@3.8.2 : has external module in ['bison/3.8.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/bison-3.8.2-ej2cew (external bison-3.8.2-6s6wcfeanp2mkdib4c3n3ivkcuosopgm)
==> cmake@3.21.4 : has external module in ['cmake/3.21.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/cmake-3.21.4-cdyb7k (external cmake-3.21.4-ucwiakreeghdgbo22kbqqhgnnlwxqtnn)
==> flex@2.6.3 : has external module in ['flex/2.6.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/flex-2.6.3-3mtl7j (external flex-2.6.3-ajxdymqhnzqgeuhvk5nu5zfymzq35n6i)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/bzip2-1.0.8-eu2d6e (external bzip2-1.0.8-h3k3surwc24macvlxbcme35uztk6dqiw)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.3-skylake/libiconv-1.16-f4hjvx
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.3-skylake/pkgconf-1.8.0-6dfyug
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.3-skylake/xz-5.2.5-cqwvvj
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/zlib-1.2.11-mswjss (external zlib-1.2.11-h7lotu6jszcvumwucry2y5jnhvxw5x2d)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ncurses-6.2-nsve5x (external ncurses-6.2-jpe3butfegqspi6dnm7cyikpjt5nphfo)
[+] /usr (external tar-1.28-zmpra4bla6bcjnayn6eze4rnd5u4txfm)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/hpe-mpi-2.25.hmpt-4ukyxt (external hpe-mpi-2.25.hmpt-pjmdwuu36ioiwqyrg6lrj7nrq3waqjj2)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ninja-1.10.2-eh33rh (external ninja-1.10.2-cp3ofspgkdqaqih5vrhotmdwvkozfswp)
==> python@3.9.7 : has external module in ['python/3.9.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/python-3.9.7-yj5alh (external python-3.9.7-f62u3ohchswt5q2b63chawohzqrl6wvy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/intel-mkl-2020.4.304-rzr3hj (external intel-mkl-2020.4.304-r5cvgrurdnt6y267arsmmmgqi75ouxd2)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/readline-8.1-we2frg (external readline-8.1-3333cwmykvahrsdydir4qeyasic3liq6)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.3-skylake/libxml2-2.9.12-i3pi6v
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.3-skylake/py-setuptools-57.4.0-l4z6bj
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.3-skylake/gettext-0.21-lswrnp
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-numpy-1.17.5-kohlct
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.3-skylake/py-coverage-5.5-lfjn2o
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.3-skylake/py-pip-21.1.2-ovo4l6
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.3-skylake/py-pyparsing-2.4.7-o7j2cr
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.3-skylake/py-toml-0.10.2-yg6s27
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.3-skylake/py-mpi4py-3.1.2-v2mlx7
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.3-skylake/py-attrs-21.2.0-iopgs7
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.3-skylake/py-iniconfig-1.1.1-prphkb
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.3-skylake/py-tomli-1.2.1-xsvykj
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.3-skylake/py-packaging-21.0-iwg6va
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.3-skylake/py-setuptools-scm-6.3.2-fjgegz
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.3-skylake/py-pluggy-0.13.0-uecslk
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.3-skylake/py-py-1.9.0-qhehf4
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.3-skylake/py-pytest-6.2.4-dzkzhq
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.3-skylake/py-pytest-cov-2.8.1-l6udtg
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/software/install_nvhpc-22.3-skylake/neuron-develop-3tcguo
$ chmod -R g+rX "${SPACK_BUILD}"
$ if [[ ${install_failed} == 1 ]]; then exit 1; fi
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
  Cache directory:  /nvme/bbpcihpcproj12/969362/ccache
  Primary config:   /nvme/bbpcihpcproj12/969362/ccache/ccache.conf
  Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
  Stats updated:    Thu Nov  3 19:43:48 2022
  Hits:                 0 /    0
    Direct:             0 /    0
    Preprocessed:       0 /    0
  Misses:               0
    Direct:             0
    Preprocessed:       0
Primary storage:
  Hits:                 0 /    0
  Misses:               0
  Cache size (GB):   0.47 / 0.51 (91.59 %)
  Files:            15390
$ tar -C "${CCACHE_DIR}" -cf "${CI_PROJECT_DIR}/ccache.tar" .
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
touch: cannot touch ‘/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P82473/J416918/spack-build/spack-stage-neuron-develop-3tcguoujns43b4vjkfzqhjnhfzyx64rp/spack-configure-args.txt’: No such file or directory
srun: error: r1i7n21: task 0: Exited with exit code 1
section_end:1667501029:step_script
section_start:1667501029:upload_artifacts_on_failure
Uploading artifacts for failed job
Uploading artifacts...
Runtime platform                                    arch=amd64 os=linux pid=171880 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories 
WARNING: spack_build_info.env: no matching files   
spack_clone_variables.env: found 1 matching files and directories 
initial_environment.env: found 1 matching files and directories 
WARNING: spack-build-env.txt: no matching files    
WARNING: spack-build-out.txt: no matching files    
WARNING: spack-configure-args.txt: no matching files 
Uploading artifacts as "archive" to coordinator... ok  id=416918 responseStatus=201 Created token=TKK4-uTd
Uploading artifacts...
Runtime platform                                    arch=amd64 os=linux pid=172066 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok  id=416918 responseStatus=201 Created token=TKK4-uTd
Uploading artifacts...
Runtime platform                                    arch=amd64 os=linux pid=172151 revision=58ba2b95 version=14.2.0
WARNING: spack_build_info.env: no matching files   
spack_clone_variables.env: found 1 matching files and directories 
Uploading artifacts as "dotenv" to coordinator... ok  id=416918 responseStatus=201 Created token=TKK4-uTd
section_end:1667501030:upload_artifacts_on_failure
section_start:1667501030:cleanup_file_variables
Cleaning up project directory and file based variables
section_end:1667501031:cleanup_file_variables
ERROR: Job failed: exit status 1