Running with gitlab-runner 15.5.0 (0d4137b8)
  on BB5 map runner pnPo3yJy
section_start:1668684208:resolve_secrets
Resolving secrets
section_end:1668684208:resolve_secrets
section_start:1668684208:prepare_executor
Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 15.5.0, user 
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor2644548611, slurm job id , CUSTOM_ENV_CI_RUNNER_TAGS is ["bb5_map"]
uid=0(root) gid=0(root) groups=0(root)
root
UID is 0
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 85404, build ref 525fc9e0cd0db5bdba5595fbf97a783e9633faaf, job ID 436454
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P85404, optional exclusive flag , optional cpus per task flag --cpus-per-task=2, optional qos flag 
CUSTOM_ENV_CI_RUNNER_TAGS is ["bb5_map"]
uid=0(root) gid=0(root) groups=0(root)
root
UID is 0
A slurm job will be created with name GL_J436454_PROD_P112_CP2_C16
Job parameters: memory=76G, cpus_per_task=2, duration=1:00:00, constraint=volta ntasks=16 account=proj9998 user=bbpcihpcproj12 partition=prod qos=
Not executing the chown -R
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 1010854
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=16 --cpus-per-task=2 --mem=76G   --job-name=GL_J436454_PROD_P112_CP2_C16 -C volta --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P85404 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P85404 --ntasks=16 --jobid=1010854 --cpus-per-task=2 --mem=76G    
section_end:1668684209:prepare_executor
section_start:1668684209:prepare_script
Preparing environment
Using git from spack modules
Running on ldir01u13.bbp.epfl.ch via bbpv1.epfl.ch...
section_end:1668684217:prepare_script
section_start:1668684217:get_sources
Getting source from Git repository
Using git from spack modules
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1668684217:get_sources
section_start:1668684217:download_artifacts
Downloading artifacts
Using git from spack modules
Downloading artifacts for build:neuron:mod2c:nvhpc:acc:shared (436446)...
Runtime platform                                    arch=amd64 os=linux pid=67030 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok        id=436446 responseStatus=200 OK token=A7kn7YbT
section_end:1668684218:download_artifacts
section_start:1668684218:step_script
Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
Using git from spack modules
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
   Site: r1i6n16
   Build name: Linux-nvc++
Create new tag: 20221117-1124 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P85404/J436446/spack-build/spack-stage-neuron-develop-fbkfxvsc35pya2x5suevdnre4zl5yele/spack-build-fbkfxvs
        Start 120: external_ringtest::coreneuron_cpu_mpi_offline::preparation
        Start 127: external_ringtest::coreneuron_gpu_mpi_offline::preparation
        Start 135: testcorenrn_bbcore::coreneuron_gpu_offline::preparation
        Start 139: testcorenrn_bbcore::coreneuron_cpu_offline::preparation
        Start 145: testcorenrn_conc::coreneuron_gpu_offline::preparation
        Start 149: testcorenrn_conc::coreneuron_cpu_offline::preparation
        Start 155: testcorenrn_deriv::coreneuron_gpu_offline::preparation
        Start 159: testcorenrn_deriv::coreneuron_cpu_offline::preparation
        Start 165: testcorenrn_gf::coreneuron_gpu_offline::preparation
        Start 169: testcorenrn_gf::coreneuron_cpu_offline::preparation
        Start 175: testcorenrn_kin::coreneuron_gpu_offline::preparation
        Start 179: testcorenrn_kin::coreneuron_cpu_offline::preparation
  1/242 Test #139: testcorenrn_bbcore::coreneuron_cpu_offline::preparation ............   Passed    2.60 sec
        Start 184: testcorenrn_patstim::coreneuron_gpu_offline::preparation
  2/242 Test #135: testcorenrn_bbcore::coreneuron_gpu_offline::preparation ............   Passed    2.62 sec
        Start 113: external_ringtest::neuron
  3/242 Test #145: testcorenrn_conc::coreneuron_gpu_offline::preparation ..............   Passed    3.32 sec
        Start 131: testcorenrn_bbcore::neuron
  4/242 Test #149: testcorenrn_conc::coreneuron_cpu_offline::preparation ..............   Passed    3.35 sec
        Start 132: testcorenrn_bbcore::coreneuron_gpu_online
  5/242 Test #155: testcorenrn_deriv::coreneuron_gpu_offline::preparation .............   Passed    3.39 sec
        Start 133: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate
  6/242 Test #159: testcorenrn_deriv::coreneuron_cpu_offline::preparation .............   Passed    3.44 sec
        Start 134: testcorenrn_bbcore::coreneuron_gpu_offline
  7/242 Test #175: testcorenrn_kin::coreneuron_gpu_offline::preparation ...............   Passed    3.44 sec
        Start 136: testcorenrn_bbcore::coreneuron_cpu_online
  8/242 Test #179: testcorenrn_kin::coreneuron_cpu_offline::preparation ...............   Passed    3.44 sec
        Start 137: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate
  9/242 Test #165: testcorenrn_gf::coreneuron_gpu_offline::preparation ................   Passed    3.51 sec
        Start 187: testcorenrn_patstim::coreneuron_cpu_offline::preparation
 10/242 Test #169: testcorenrn_gf::coreneuron_cpu_offline::preparation ................   Passed    3.53 sec
        Start 193: testcorenrn_vecplay::coreneuron_gpu_offline::preparation
 11/242 Test #184: testcorenrn_patstim::coreneuron_gpu_offline::preparation ...........   Passed    1.44 sec
        Start 138: testcorenrn_bbcore::coreneuron_cpu_offline
 12/242 Test #113: external_ringtest::neuron ..........................................   Passed    1.47 sec
        Start 141: testcorenrn_conc::neuron
 13/242 Test #131: testcorenrn_bbcore::neuron .........................................   Passed    2.30 sec
        Start 142: testcorenrn_conc::coreneuron_gpu_online
 14/242 Test #141: testcorenrn_conc::neuron ...........................................   Passed    2.88 sec
        Start 143: testcorenrn_conc::coreneuron_gpu_online_psolve_alternate
 15/242 Test #193: testcorenrn_vecplay::coreneuron_gpu_offline::preparation ...........   Passed    3.45 sec
        Start 197: testcorenrn_vecplay::coreneuron_cpu_offline::preparation
 16/242 Test #187: testcorenrn_patstim::coreneuron_cpu_offline::preparation ...........   Passed    3.50 sec
        Start 213: testcorenrn_watch::coreneuron_gpu_offline::preparation
 17/242 Test #197: testcorenrn_vecplay::coreneuron_cpu_offline::preparation ...........   Passed    1.73 sec
        Start 217: testcorenrn_watch::coreneuron_cpu_offline::preparation
 18/242 Test #213: testcorenrn_watch::coreneuron_gpu_offline::preparation .............   Passed    1.81 sec
        Start 114: external_ringtest::neuron_mpi
 19/242 Test #138: testcorenrn_bbcore::coreneuron_cpu_offline .........................   Passed    4.83 sec
        Start 144: testcorenrn_conc::coreneuron_gpu_offline
 20/242 Test #136: testcorenrn_bbcore::coreneuron_cpu_online ..........................   Passed    5.50 sec
        Start 146: testcorenrn_conc::coreneuron_cpu_online
 21/242 Test #120: external_ringtest::coreneuron_cpu_mpi_offline::preparation .........   Passed    9.01 sec
        Start 115: external_ringtest::neuron_mpi_python
 22/242 Test #137: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate .........   Passed    5.53 sec
        Start 147: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate
 23/242 Test #127: external_ringtest::coreneuron_gpu_mpi_offline::preparation .........   Passed    9.02 sec
        Start 116: external_ringtest::coreneuron_cpu_mpi_offline_saverestore
 24/242 Test #217: testcorenrn_watch::coreneuron_cpu_offline::preparation .............   Passed    1.78 sec
        Start 117: external_ringtest::coreneuron_cpu_mpi
 25/242 Test #114: external_ringtest::neuron_mpi ......................................   Passed    3.16 sec
        Start 118: external_ringtest::coreneuron_cpu_mpi_python
 26/242 Test #146: testcorenrn_conc::coreneuron_cpu_online ............................   Passed    3.06 sec
        Start 148: testcorenrn_conc::coreneuron_cpu_offline
 27/242 Test #115: external_ringtest::neuron_mpi_python ...............................   Passed    3.11 sec
        Start 119: external_ringtest::coreneuron_cpu_mpi_offline
 28/242 Test #147: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate ...........   Passed    3.20 sec
        Start 151: testcorenrn_deriv::neuron
 29/242 Test #117: external_ringtest::coreneuron_cpu_mpi ..............................   Passed    3.22 sec
        Start 123: external_ringtest::coreneuron_gpu_mpi_offline_saverestore
 30/242 Test #151: testcorenrn_deriv::neuron ..........................................   Passed    1.57 sec
        Start 152: testcorenrn_deriv::coreneuron_gpu_online
 31/242 Test #148: testcorenrn_conc::coreneuron_cpu_offline ...........................   Passed    2.13 sec
        Start 153: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate
 32/242 Test #119: external_ringtest::coreneuron_cpu_mpi_offline ......................   Passed    2.69 sec
        Start 124: external_ringtest::coreneuron_gpu_mpi
 33/242 Test #118: external_ringtest::coreneuron_cpu_mpi_python .......................   Passed    3.25 sec
        Start 125: external_ringtest::coreneuron_gpu_mpi_python
 34/242 Test #116: external_ringtest::coreneuron_cpu_mpi_offline_saverestore ..........   Passed   10.53 sec
        Start 126: external_ringtest::coreneuron_gpu_mpi_offline
 35/242 Test #123: external_ringtest::coreneuron_gpu_mpi_offline_saverestore ..........   Passed    9.71 sec
        Start 154: testcorenrn_deriv::coreneuron_gpu_offline
        Start 156: testcorenrn_deriv::coreneuron_cpu_online
 36/242 Test #156: testcorenrn_deriv::coreneuron_cpu_online ...........................   Passed    2.46 sec
        Start 157: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate
 37/242 Test #157: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate ..........   Passed    2.56 sec
        Start 158: testcorenrn_deriv::coreneuron_cpu_offline
 38/242 Test #133: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate .........   Passed   25.95 sec
        Start 171: testcorenrn_kin::neuron
 39/242 Test #158: testcorenrn_deriv::coreneuron_cpu_offline ..........................   Passed    2.00 sec
        Start 172: testcorenrn_kin::coreneuron_gpu_online
 40/242 Test #171: testcorenrn_kin::neuron ............................................   Passed    1.37 sec
        Start 173: testcorenrn_kin::coreneuron_gpu_online_psolve_alternate
 41/242 Test #132: testcorenrn_bbcore::coreneuron_gpu_online ..........................   Passed   32.12 sec
        Start 174: testcorenrn_kin::coreneuron_gpu_offline
 42/242 Test #134: testcorenrn_bbcore::coreneuron_gpu_offline .........................   Passed   32.30 sec
        Start 176: testcorenrn_kin::coreneuron_cpu_online
 43/242 Test #176: testcorenrn_kin::coreneuron_cpu_online .............................   Passed    2.43 sec
        Start 177: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate
 44/242 Test #177: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate ............   Passed    2.74 sec
        Start 178: testcorenrn_kin::coreneuron_cpu_offline
 45/242 Test #178: testcorenrn_kin::coreneuron_cpu_offline ............................   Passed    2.13 sec
        Start 182: testcorenrn_patstim::coreneuron_gpu_offline_saverestore
 46/242 Test #142: testcorenrn_conc::coreneuron_gpu_online ............................   Passed   41.80 sec
        Start 183: testcorenrn_patstim::coreneuron_gpu_offline
 47/242 Test #144: testcorenrn_conc::coreneuron_gpu_offline ...........................   Passed   46.14 sec
        Start 224: channel_benchmark_hippo::neuron
 48/242 Test #143: testcorenrn_conc::coreneuron_gpu_online_psolve_alternate ...........   Passed   52.80 sec
        Start 225: channel_benchmark_hippo::coreneuron_gpu_online
 49/242 Test #152: testcorenrn_deriv::coreneuron_gpu_online ...........................   Passed   50.40 sec
        Start 226: channel_benchmark_hippo::coreneuron_gpu_filemode
 50/242 Test #153: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate ..........   Passed   54.64 sec
        Start 227: channel_benchmark_hippo::coreneuron_cpu_online
 51/242 Test #154: testcorenrn_deriv::coreneuron_gpu_offline ..........................   Passed   48.56 sec
        Start 228: channel_benchmark_hippo::coreneuron_cpu_filemode
 52/242 Test #172: testcorenrn_kin::coreneuron_gpu_online .............................   Passed   45.54 sec
        Start 230: channel_benchmark_sscx::neuron
 53/242 Test #124: external_ringtest::coreneuron_gpu_mpi ..............................   Passed   62.90 sec
        Start 161: testcorenrn_gf::neuron
 54/242 Test #174: testcorenrn_kin::coreneuron_gpu_offline ............................   Passed   42.40 sec
        Start 231: channel_benchmark_sscx::coreneuron_gpu_online
 55/242 Test #125: external_ringtest::coreneuron_gpu_mpi_python .......................   Passed   62.98 sec
        Start 162: testcorenrn_gf::coreneuron_gpu_online
 56/242 Test #126: external_ringtest::coreneuron_gpu_mpi_offline ......................   Passed   59.61 sec
        Start 163: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate
 57/242 Test #161: testcorenrn_gf::neuron .............................................   Passed    1.90 sec
        Start 164: testcorenrn_gf::coreneuron_gpu_offline
 58/242 Test #173: testcorenrn_kin::coreneuron_gpu_online_psolve_alternate ............   Passed   51.26 sec
        Start 232: channel_benchmark_sscx::coreneuron_gpu_filemode
 59/242 Test #183: testcorenrn_patstim::coreneuron_gpu_offline ........................   Passed   36.56 sec
        Start 233: channel_benchmark_sscx::coreneuron_cpu_online
 60/242 Test #182: testcorenrn_patstim::coreneuron_gpu_offline_saverestore ............   Passed   41.44 sec
        Start 234: channel_benchmark_sscx::coreneuron_cpu_filemode
 61/242 Test #163: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate .............   Passed   15.82 sec
        Start 166: testcorenrn_gf::coreneuron_cpu_online
 62/242 Test #162: testcorenrn_gf::coreneuron_gpu_online ..............................   Passed   17.04 sec
        Start 167: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate
 63/242 Test #164: testcorenrn_gf::coreneuron_gpu_offline .............................   Passed   16.78 sec
        Start 168: testcorenrn_gf::coreneuron_cpu_offline
 64/242 Test #168: testcorenrn_gf::coreneuron_cpu_offline .............................   Passed    5.18 sec
        Start 181: testcorenrn_patstim::neuron
 65/242 Test #166: testcorenrn_gf::coreneuron_cpu_online ..............................   Passed    6.65 sec
        Start 185: testcorenrn_patstim::coreneuron_cpu_offline_saverestore
 66/242 Test #167: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate .............   Passed    7.38 sec
        Start 186: testcorenrn_patstim::coreneuron_cpu_offline
 67/242 Test #181: testcorenrn_patstim::neuron ........................................   Passed    1.65 sec
        Start 189: testcorenrn_vecplay::neuron
 68/242 Test #189: testcorenrn_vecplay::neuron ........................................   Passed    2.22 sec
        Start 190: testcorenrn_vecplay::coreneuron_gpu_online
 69/242 Test #186: testcorenrn_patstim::coreneuron_cpu_offline ........................   Passed    5.61 sec
        Start 191: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate
 70/242 Test #185: testcorenrn_patstim::coreneuron_cpu_offline_saverestore ............   Passed    8.75 sec
        Start 192: testcorenrn_vecplay::coreneuron_gpu_offline
 71/242 Test #190: testcorenrn_vecplay::coreneuron_gpu_online .........................   Passed   12.66 sec
        Start 194: testcorenrn_vecplay::coreneuron_cpu_online
 72/242 Test #194: testcorenrn_vecplay::coreneuron_cpu_online .........................   Passed    2.82 sec
        Start 195: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate
 73/242 Test #195: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate ........   Passed    2.98 sec
        Start 196: testcorenrn_vecplay::coreneuron_cpu_offline
 74/242 Test #196: testcorenrn_vecplay::coreneuron_cpu_offline ........................   Passed    3.22 sec
        Start 209: testcorenrn_watch::neuron
 75/242 Test #192: testcorenrn_vecplay::coreneuron_gpu_offline ........................   Passed   18.03 sec
        Start 210: testcorenrn_watch::coreneuron_gpu_online
 76/242 Test #209: testcorenrn_watch::neuron ..........................................   Passed    1.58 sec
        Start 211: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate
 77/242 Test #191: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate ........   Passed   22.14 sec
        Start 212: testcorenrn_watch::coreneuron_gpu_offline
 78/242 Test #211: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate ..........   Passed   16.47 sec
        Start 214: testcorenrn_watch::coreneuron_cpu_online
 79/242 Test #212: testcorenrn_watch::coreneuron_gpu_offline ..........................   Passed   17.25 sec
        Start 215: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate
 80/242 Test #210: testcorenrn_watch::coreneuron_gpu_online ...........................   Passed   21.13 sec
        Start 216: testcorenrn_watch::coreneuron_cpu_offline
 81/242 Test #216: testcorenrn_watch::coreneuron_cpu_offline ..........................   Passed    2.90 sec
        Start 219: testcorenrn_netstimdirect::direct_netstimdirect
 82/242 Test #214: testcorenrn_watch::coreneuron_cpu_online ...........................   Passed    7.59 sec
        Start 220: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate
 83/242 Test #215: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate ..........   Passed    5.87 sec
        Start   1: cmd_interface_test
        Start   2: interleave_info_constructor_test
 84/242 Test   #2: interleave_info_constructor_test ...................................   Passed    0.04 sec
        Start   3: alignment_test
 85/242 Test   #1: cmd_interface_test .................................................   Passed    0.05 sec
        Start   4: queuing_test
 86/242 Test   #3: alignment_test .....................................................   Passed    0.02 sec
        Start   5: test-solver
 87/242 Test   #4: queuing_test .......................................................   Passed    0.02 sec
        Start   6: lfp_test
 88/242 Test   #6: lfp_test ...........................................................   Passed    0.04 sec
        Start   8: ringtest
 89/242 Test   #8: ringtest ...........................................................   Passed    0.25 sec
        Start   9: connect_dend
 90/242 Test   #9: connect_dend .......................................................   Passed    0.15 sec
        Start  10: mpi_init::nrniv_mpiopt
 91/242 Test  #10: mpi_init::nrniv_mpiopt .............................................   Passed    0.07 sec
        Start  11: mpi_init::nrniv_nrnmpi_init
 92/242 Test  #11: mpi_init::nrniv_nrnmpi_init ........................................   Passed    0.07 sec
        Start  12: mpi_init::python_nrnmpi_init
 93/242 Test  #12: mpi_init::python_nrnmpi_init .......................................   Passed    0.29 sec
        Start  13: mpi_init::python_mpienv
 94/242 Test  #13: mpi_init::python_mpienv ............................................   Passed    0.30 sec
        Start  14: mpi_init::nrniv_mpiexec_mpiopt
 95/242 Test  #14: mpi_init::nrniv_mpiexec_mpiopt .....................................   Passed    2.18 sec
        Start  15: mpi_init::nrniv_mpiexec_nrnmpi_init
 96/242 Test #219: testcorenrn_netstimdirect::direct_netstimdirect ....................   Passed    5.89 sec
        Start  16: mpi_init::python_mpiexec_nrnmpi_init
        Start  17: mpi_init::python_mpiexec_mpienv
 97/242 Test  #15: mpi_init::nrniv_mpiexec_nrnmpi_init ................................   Passed    1.39 sec
        Start  18: pynrn::basic_tests
 98/242 Test #220: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate ...   Passed    6.04 sec
        Start  19: coverage_tests::cover_tests
        Start  20: example_nmodl::ca_ap_hoc
 99/242 Test  #20: example_nmodl::ca_ap_hoc ...........................................   Passed    0.11 sec
        Start  21: example_nmodl::cabpump_hoc
100/242 Test  #21: example_nmodl::cabpump_hoc .........................................   Passed    0.19 sec
        Start  22: example_nmodl::cachan_hoc
101/242 Test  #22: example_nmodl::cachan_hoc ..........................................   Passed    0.13 sec
        Start  23: example_nmodl::cadif_hoc
102/242 Test  #23: example_nmodl::cadif_hoc ...........................................   Passed    0.15 sec
        Start  24: example_nmodl::cadifusl_hoc
103/242 Test  #24: example_nmodl::cadifusl_hoc ........................................   Passed    0.10 sec
        Start  25: example_nmodl::cadifusl1_hoc
104/242 Test   #5: test-solver ........................................................   Passed    5.96 sec
        Start  26: example_nmodl::cadifusl2_hoc
105/242 Test  #25: example_nmodl::cadifusl1_hoc .......................................   Passed    0.12 sec
        Start  27: example_nmodl::cagk_hoc
106/242 Test  #26: example_nmodl::cadifusl2_hoc .......................................   Passed    0.10 sec
        Start  28: example_nmodl::capmp_hoc
107/242 Test  #27: example_nmodl::cagk_hoc ............................................   Passed    0.08 sec
        Start  29: example_nmodl::cv_hoc
108/242 Test  #29: example_nmodl::cv_hoc ..............................................   Passed    0.09 sec
        Start  30: example_nmodl::fh_hoc
109/242 Test  #28: example_nmodl::capmp_hoc ...........................................   Passed    0.19 sec
        Start  31: example_nmodl::fit1_hoc
110/242 Test  #30: example_nmodl::fh_hoc ..............................................   Passed    0.11 sec
        Start  32: example_nmodl::gap_hoc
111/242 Test  #31: example_nmodl::fit1_hoc ............................................   Passed    0.08 sec
        Start  33: example_nmodl::hh1_hoc
112/242 Test  #32: example_nmodl::gap_hoc .............................................   Passed    0.08 sec
        Start  34: example_nmodl::hhvect_hoc
113/242 Test  #33: example_nmodl::hh1_hoc .............................................   Passed    0.09 sec
        Start  35: example_nmodl::nacum_hoc
114/242 Test  #34: example_nmodl::hhvect_hoc ..........................................   Passed    0.08 sec
        Start  36: example_nmodl::nadifl1_hoc
115/242 Test  #35: example_nmodl::nacum_hoc ...........................................   Passed    0.10 sec
        Start  37: example_nmodl::nadifl2_hoc
116/242 Test  #36: example_nmodl::nadifl1_hoc .........................................   Passed    0.10 sec
        Start  38: example_nmodl::nadifl3_hoc
117/242 Test  #37: example_nmodl::nadifl2_hoc .........................................   Passed    0.15 sec
        Start  39: example_nmodl::nadifl4_hoc
118/242 Test  #38: example_nmodl::nadifl3_hoc .........................................   Passed    0.14 sec
        Start  40: example_nmodl::obj_ex_hoc
119/242 Test  #40: example_nmodl::obj_ex_hoc ..........................................   Passed    0.10 sec
        Start  41: example_nmodl::order_hoc
120/242 Test  #39: example_nmodl::nadifl4_hoc .........................................   Passed    0.17 sec
        Start  42: example_nmodl::passiv_hoc
121/242 Test  #41: example_nmodl::order_hoc ...........................................   Passed    0.16 sec
        Start  43: example_nmodl::stim1_hoc
122/242 Test  #42: example_nmodl::passiv_hoc ..........................................   Passed    0.10 sec
        Start  44: example_nmodl::syn1_hoc
123/242 Test  #43: example_nmodl::stim1_hoc ...........................................   Passed    0.12 sec
        Start  45: example_nmodl::synpre_hoc
124/242 Test  #44: example_nmodl::syn1_hoc ............................................   Passed    0.12 sec
        Start  46: example_nmodl::tstextrn_hoc
125/242 Test  #46: example_nmodl::tstextrn_hoc ........................................   Passed    0.08 sec
        Start  47: example_nmodl::tstpnt1_hoc
126/242 Test  #45: example_nmodl::synpre_hoc ..........................................   Passed    0.11 sec
        Start  48: example_nmodl::tstpnt2_hoc
127/242 Test  #47: example_nmodl::tstpnt1_hoc .........................................   Passed    0.08 sec
        Start  49: example_nmodl::tstvec_hoc
128/242 Test  #48: example_nmodl::tstpnt2_hoc .........................................   Passed    0.08 sec
        Start  50: example_nmodl::tstpnt1_py
129/242 Test  #49: example_nmodl::tstvec_hoc ..........................................   Passed    0.08 sec
        Start  51: example_nmodl::tstpnt2_py
130/242 Test  #19: coverage_tests::cover_tests ........................................   Passed    2.33 sec
        Start  52: hoctests::perf1_hoc
131/242 Test  #50: example_nmodl::tstpnt1_py ..........................................   Passed    0.30 sec
        Start  53: hoctests::test1_hoc
132/242 Test  #51: example_nmodl::tstpnt2_py ..........................................   Passed    0.29 sec
        Start  54: hoctests::test2_hoc
133/242 Test  #54: hoctests::test2_hoc ................................................   Passed    0.16 sec
        Start  55: hoctests::test3_hoc
134/242 Test  #53: hoctests::test1_hoc ................................................   Passed    0.32 sec
        Start  56: hoctests::test4_hoc
135/242 Test  #55: hoctests::test3_hoc ................................................   Passed    0.10 sec
        Start  57: hoctests::test5_hoc
136/242 Test  #57: hoctests::test5_hoc ................................................   Passed    0.08 sec
        Start  58: hoctests::test6_hoc
137/242 Test  #56: hoctests::test4_hoc ................................................   Passed    0.08 sec
        Start  59: hoctests::test7_hoc
138/242 Test  #58: hoctests::test6_hoc ................................................   Passed    0.11 sec
        Start  60: hoctests::test8_hoc
139/242 Test  #59: hoctests::test7_hoc ................................................   Passed    0.11 sec
        Start  61: hoctests::test1_py
140/242 Test  #60: hoctests::test8_hoc ................................................   Passed    0.08 sec
        Start  62: hoctests::test2_py
141/242 Test  #61: hoctests::test1_py .................................................   Passed    0.29 sec
        Start  63: hoctests::test9_py
142/242 Test  #62: hoctests::test2_py .................................................   Passed    0.35 sec
        Start  68: coreneuron_standalone::test_nrn_corenrn_standalone
143/242 Test  #63: hoctests::test9_py .................................................   Passed    0.28 sec
        Start  69: coreneuron_modtests::version_macros
144/242 Test  #52: hoctests::perf1_hoc ................................................   Passed    1.62 sec
        Start  70: coreneuron_modtests::fornetcon_py_cpu
145/242 Test  #16: mpi_init::python_mpiexec_nrnmpi_init ...............................   Passed    4.46 sec
        Start  71: coreneuron_modtests::direct_py_cpu
146/242 Test  #17: mpi_init::python_mpiexec_mpienv ....................................   Passed    4.46 sec
        Start  72: coreneuron_modtests::direct_hoc_cpu
147/242 Test  #72: coreneuron_modtests::direct_hoc_cpu ................................   Passed    1.13 sec
        Start  73: coreneuron_modtests::spikes_py_cpu
148/242 Test  #68: coreneuron_standalone::test_nrn_corenrn_standalone .................   Passed    3.22 sec
        Start  74: coreneuron_modtests::spikes_file_mode_py_cpu
149/242 Test  #69: coreneuron_modtests::version_macros ................................   Passed    3.50 sec
        Start  75: coreneuron_modtests::fast_imem_py_cpu
150/242 Test  #70: coreneuron_modtests::fornetcon_py_cpu ..............................   Passed    3.13 sec
        Start  76: coreneuron_modtests::datareturn_py_cpu
151/242 Test  #71: coreneuron_modtests::direct_py_cpu .................................   Passed    3.10 sec
        Start  77: coreneuron_modtests::test_units_py_cpu
152/242 Test  #73: coreneuron_modtests::spikes_py_cpu .................................   Passed    3.26 sec
        Start  78: coreneuron_modtests::test_netmove_py_cpu
153/242 Test  #74: coreneuron_modtests::spikes_file_mode_py_cpu .......................   Passed    3.56 sec
        Start  79: coreneuron_modtests::test_pointer_py_cpu
154/242 Test  #75: coreneuron_modtests::fast_imem_py_cpu ..............................   Passed    3.43 sec
        Start  80: coreneuron_modtests::test_watchrange_py_cpu
155/242 Test  #77: coreneuron_modtests::test_units_py_cpu .............................   Passed    3.37 sec
        Start  81: coreneuron_modtests::test_psolve_py_cpu
156/242 Test  #76: coreneuron_modtests::datareturn_py_cpu .............................   Passed    3.69 sec
        Start  82: coreneuron_modtests::test_ba_py_cpu
157/242 Test  #18: pynrn::basic_tests .................................................   Passed   12.03 sec
        Start  83: coreneuron_modtests::test_natrans_py_cpu
158/242 Test  #78: coreneuron_modtests::test_netmove_py_cpu ...........................   Passed    3.26 sec
        Start  87: coreneuron_modtests::fornetcon_py_gpu
159/242 Test  #80: coreneuron_modtests::test_watchrange_py_cpu ........................   Passed    3.37 sec
        Start  88: coreneuron_modtests::direct_py_gpu
160/242 Test  #81: coreneuron_modtests::test_psolve_py_cpu ............................   Passed    3.63 sec
        Start  89: coreneuron_modtests::direct_hoc_gpu
161/242 Test  #82: coreneuron_modtests::test_ba_py_cpu ................................   Passed    3.48 sec
        Start  90: coreneuron_modtests::spikes_py_gpu
162/242 Test  #83: coreneuron_modtests::test_natrans_py_cpu ...........................   Passed    3.20 sec
        Start  91: coreneuron_modtests::spikes_file_mode_py_gpu
163/242 Test  #87: coreneuron_modtests::fornetcon_py_gpu ..............................   Passed    3.56 sec
        Start  92: coreneuron_modtests::fast_imem_py_gpu
164/242 Test  #89: coreneuron_modtests::direct_hoc_gpu ................................   Passed    1.57 sec
        Start  93: coreneuron_modtests::datareturn_py_gpu
165/242 Test  #79: coreneuron_modtests::test_pointer_py_cpu ...........................   Passed    8.15 sec
        Start  94: coreneuron_modtests::test_units_py_gpu
166/242 Test  #88: coreneuron_modtests::direct_py_gpu .................................   Passed    4.96 sec
        Start  95: coreneuron_modtests::test_netmove_py_gpu
167/242 Test  #91: coreneuron_modtests::spikes_file_mode_py_gpu .......................   Passed    4.05 sec
        Start  96: coreneuron_modtests::test_pointer_py_gpu
168/242 Test  #92: coreneuron_modtests::fast_imem_py_gpu ..............................   Passed    4.54 sec
        Start  97: coreneuron_modtests::test_watchrange_py_gpu
169/242 Test  #90: coreneuron_modtests::spikes_py_gpu .................................   Passed    5.97 sec
        Start  98: coreneuron_modtests::test_psolve_py_gpu
170/242 Test  #94: coreneuron_modtests::test_units_py_gpu .............................   Passed    3.03 sec
        Start  99: coreneuron_modtests::test_ba_py_gpu
171/242 Test  #93: coreneuron_modtests::datareturn_py_gpu .............................   Passed    7.32 sec
        Start 100: coreneuron_modtests::test_natrans_py_gpu
172/242 Test  #97: coreneuron_modtests::test_watchrange_py_gpu ........................   Passed    3.75 sec
        Start 104: modlunit_unitstest
173/242 Test #104: modlunit_unitstest .................................................   Passed    0.09 sec
        Start 105: modlunit_hh
174/242 Test #105: modlunit_hh ........................................................   Passed    0.02 sec
        Start 106: modlunit_stim
175/242 Test #106: modlunit_stim ......................................................   Passed    0.01 sec
        Start 107: modlunit_pattern
176/242 Test #107: modlunit_pattern ...................................................   Passed    0.01 sec
        Start 108: external_nrntest
177/242 Test  #98: coreneuron_modtests::test_psolve_py_gpu ............................   Passed    3.49 sec
        Start 140: testcorenrn_bbcore::compare_results
178/242 Test #140: testcorenrn_bbcore::compare_results ................................   Passed    0.08 sec
        Start 150: testcorenrn_conc::compare_results
179/242 Test #150: testcorenrn_conc::compare_results ..................................   Passed    0.07 sec
        Start 160: testcorenrn_deriv::compare_results
180/242 Test #160: testcorenrn_deriv::compare_results .................................   Passed    0.08 sec
        Start 170: testcorenrn_gf::compare_results
181/242 Test #170: testcorenrn_gf::compare_results ....................................   Passed    0.11 sec
        Start 180: testcorenrn_kin::compare_results
182/242 Test #180: testcorenrn_kin::compare_results ...................................   Passed    0.08 sec
        Start 188: testcorenrn_patstim::compare_results
183/242 Test #188: testcorenrn_patstim::compare_results ...............................   Passed    0.16 sec
        Start 198: testcorenrn_vecplay::compare_results
184/242 Test #198: testcorenrn_vecplay::compare_results ...............................   Passed    0.16 sec
        Start 218: testcorenrn_watch::compare_results
185/242 Test  #99: coreneuron_modtests::test_ba_py_gpu ................................   Passed    3.24 sec
        Start 221: testcorenrn_netstimdirect::compare_results
186/242 Test #218: testcorenrn_watch::compare_results .................................   Passed    0.12 sec
187/242 Test  #95: coreneuron_modtests::test_netmove_py_gpu ...........................   Passed    5.96 sec
        Start  65: parallel::partrans
188/242 Test #221: testcorenrn_netstimdirect::compare_results .........................   Passed    0.28 sec
189/242 Test #100: coreneuron_modtests::test_natrans_py_gpu ...........................   Passed    4.12 sec
        Start  66: parallel::netpar
190/242 Test  #65: parallel::partrans .................................................   Passed    2.92 sec
        Start  67: parallel::bas
191/242 Test  #96: coreneuron_modtests::test_pointer_py_gpu ...........................   Passed   10.35 sec
192/242 Test  #66: parallel::netpar ...................................................   Passed    3.07 sec
        Start  84: coreneuron_modtests::spikes_mpi_py_cpu
193/242 Test  #67: parallel::bas ......................................................   Passed    6.15 sec
        Start  85: coreneuron_modtests::spikes_mpi_file_mode_py_cpu
194/242 Test  #84: coreneuron_modtests::spikes_mpi_py_cpu .............................   Passed    7.21 sec
        Start  86: coreneuron_modtests::inputpresyn_py_cpu
195/242 Test  #85: coreneuron_modtests::spikes_mpi_file_mode_py_cpu ...................   Passed    3.75 sec
        Start 101: coreneuron_modtests::spikes_mpi_py_gpu
196/242 Test  #86: coreneuron_modtests::inputpresyn_py_cpu ............................   Passed    4.86 sec
        Start 102: coreneuron_modtests::spikes_mpi_file_mode_py_gpu
197/242 Test #101: coreneuron_modtests::spikes_mpi_py_gpu .............................   Passed    8.61 sec
        Start 103: coreneuron_modtests::inputpresyn_py_gpu
198/242 Test #224: channel_benchmark_hippo::neuron ....................................   Passed  149.99 sec
199/242 Test #102: coreneuron_modtests::spikes_mpi_file_mode_py_gpu ...................   Passed    7.03 sec
        Start 203: testcorenrn_vecevent::coreneuron_gpu_offline::preparation
200/242 Test #103: coreneuron_modtests::inputpresyn_py_gpu ............................   Passed    4.44 sec
201/242 Test #203: testcorenrn_vecevent::coreneuron_gpu_offline::preparation ..........   Passed    2.21 sec
        Start 207: testcorenrn_vecevent::coreneuron_cpu_offline::preparation
202/242 Test #207: testcorenrn_vecevent::coreneuron_cpu_offline::preparation ..........   Passed    2.19 sec
        Start 237: olfactory-bulb-3d::neuron::preparation
203/242 Test #237: olfactory-bulb-3d::neuron::preparation .............................   Passed    0.06 sec
        Start 239: olfactory-bulb-3d::coreneuron_gpu_online::preparation
204/242 Test #239: olfactory-bulb-3d::coreneuron_gpu_online::preparation ..............   Passed    0.02 sec
        Start 241: olfactory-bulb-3d::coreneuron_cpu_online::preparation
205/242 Test #241: olfactory-bulb-3d::coreneuron_cpu_online::preparation ..............   Passed    0.04 sec
        Start 109: reduced_dentate::neuron
206/242 Test #230: channel_benchmark_sscx::neuron .....................................   Passed  139.44 sec
207/242 Test #227: channel_benchmark_hippo::coreneuron_cpu_online .....................   Passed  149.98 sec
        Start 110: reduced_dentate::coreneuron_cpu
208/242 Test #228: channel_benchmark_hippo::coreneuron_cpu_filemode ...................   Passed  149.95 sec
209/242 Test #233: channel_benchmark_sscx::coreneuron_cpu_online ......................   Passed  140.15 sec
210/242 Test #234: channel_benchmark_sscx::coreneuron_cpu_filemode ....................   Passed  142.49 sec
211/242 Test #225: channel_benchmark_hippo::coreneuron_gpu_online .....................   Passed  188.47 sec
        Start 111: reduced_dentate::coreneuron_gpu
212/242 Test #109: reduced_dentate::neuron ............................................   Passed   40.34 sec
        Start 199: testcorenrn_vecevent::neuron
213/242 Test #226: channel_benchmark_hippo::coreneuron_gpu_filemode ...................   Passed  189.41 sec
        Start 229: channel_benchmark_hippo::compare_results
214/242 Test #229: channel_benchmark_hippo::compare_results ...........................   Passed    0.08 sec
215/242 Test #231: channel_benchmark_sscx::coreneuron_gpu_online ......................   Passed  176.30 sec
216/242 Test #199: testcorenrn_vecevent::neuron .......................................   Passed    1.96 sec
        Start 121: external_ringtest::coreneuron_cpu_mpi_threads
217/242 Test #121: external_ringtest::coreneuron_cpu_mpi_threads ......................   Passed    3.15 sec
        Start 122: external_ringtest::coreneuron_cpu_mpi_threads_python
218/242 Test #232: channel_benchmark_sscx::coreneuron_gpu_filemode ....................   Passed  176.76 sec
        Start 235: channel_benchmark_sscx::compare_results
219/242 Test #235: channel_benchmark_sscx::compare_results ............................   Passed    0.18 sec
220/242 Test #110: reduced_dentate::coreneuron_cpu ....................................   Passed   41.37 sec
        Start 200: testcorenrn_vecevent::coreneuron_gpu_online
221/242 Test #122: external_ringtest::coreneuron_cpu_mpi_threads_python ...............   Passed    3.37 sec
        Start 128: external_ringtest::coreneuron_gpu_mpi_threads
222/242 Test #108: external_nrntest ...................................................   Passed  114.58 sec
223/242 Test #200: testcorenrn_vecevent::coreneuron_gpu_online ........................   Passed   43.00 sec
        Start 129: external_ringtest::coreneuron_gpu_mpi_threads_python
224/242 Test #111: reduced_dentate::coreneuron_gpu ....................................   Passed   58.24 sec
        Start 201: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate
225/242 Test #201: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate .......   Passed   19.19 sec
        Start 202: testcorenrn_vecevent::coreneuron_gpu_offline
226/242 Test #202: testcorenrn_vecevent::coreneuron_gpu_offline .......................   Passed   18.63 sec
        Start 204: testcorenrn_vecevent::coreneuron_cpu_online
227/242 Test #128: external_ringtest::coreneuron_gpu_mpi_threads ......................   Passed   83.40 sec
        Start 205: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate
        Start 112: reduced_dentate::compare_results
228/242 Test #112: reduced_dentate::compare_results ...................................   Passed    0.08 sec
229/242 Test #204: testcorenrn_vecevent::coreneuron_cpu_online ........................   Passed    2.99 sec
        Start 206: testcorenrn_vecevent::coreneuron_cpu_offline
230/242 Test #205: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate .......   Passed    3.06 sec
        Start 236: olfactory-bulb-3d::neuron
231/242 Test #206: testcorenrn_vecevent::coreneuron_cpu_offline .......................   Passed    2.51 sec
        Start 238: olfactory-bulb-3d::coreneuron_gpu_online
        Start 208: testcorenrn_vecevent::compare_results
232/242 Test #208: testcorenrn_vecevent::compare_results ..............................   Passed    0.06 sec
233/242 Test #129: external_ringtest::coreneuron_gpu_mpi_threads_python ...............   Passed   51.64 sec
        Start 240: olfactory-bulb-3d::coreneuron_cpu_online
        Start 130: external_ringtest::compare_results
234/242 Test #130: external_ringtest::compare_results .................................   Passed    0.07 sec
235/242 Test #238: olfactory-bulb-3d::coreneuron_gpu_online ...........................   Passed   39.27 sec
        Start  64: parallel::subworld
236/242 Test  #64: parallel::subworld .................................................   Passed    3.62 sec
237/242 Test #240: olfactory-bulb-3d::coreneuron_cpu_online ...........................   Passed   53.82 sec
238/242 Test #236: olfactory-bulb-3d::neuron ..........................................   Passed   62.58 sec
        Start   7: unit_tests::testneuron
239/242 Test   #7: unit_tests::testneuron .............................................   Passed   33.57 sec
        Start 222: tqperf::coreneuron_special
240/242 Test #222: tqperf::coreneuron_special .........................................   Passed   14.60 sec
        Start 223: tqperf::coreneuron_python
241/242 Test #223: tqperf::coreneuron_python ..........................................   Passed   10.43 sec
        Start 242: olfactory-bulb-3d::compare_results
242/242 Test #242: olfactory-bulb-3d::compare_results .................................   Passed    0.23 sec

100% tests passed, 0 tests failed out of 242

Total Test time (real) = 469.43 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.9.7
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1668684717:step_script
section_start:1668684717:upload_artifacts_on_success
Uploading artifacts for successful job
Using git from spack modules
Uploading artifacts...
Runtime platform                                    arch=amd64 os=linux pid=6154 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories 
Testing/: found 7 matching files and directories   
Uploading artifacts as "archive" to coordinator... ok  id=436454 responseStatus=201 Created token=A7kn7YbT
Uploading artifacts...
Runtime platform                                    arch=amd64 os=linux pid=6218 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories  
Uploading artifacts as "junit" to coordinator... ok  id=436454 responseStatus=201 Created token=A7kn7YbT
section_end:1668684719:upload_artifacts_on_success
section_start:1668684719:cleanup_file_variables
Cleaning up project directory and file based variables
Using git from spack modules
section_end:1668684720:cleanup_file_variables
Job succeeded