Running with gitlab-runner 15.5.0 (0d4137b8)
  on BB5 map runner pnPo3yJy
section_start:1668578693:resolve_secrets
Resolving secrets
section_end:1668578693:resolve_secrets
section_start:1668578693:prepare_executor
Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 15.5.0, user 
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor4160062498, slurm job id , CUSTOM_ENV_CI_RUNNER_TAGS is ["bb5_map"]
uid=0(root) gid=0(root) groups=0(root)
root
UID is 0
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 84996, build ref 5482bd84bcb9fe9378f5326f8f33d3b63fa888a4, job ID 433567
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P84996, optional exclusive flag , optional cpus per task flag --cpus-per-task=2, optional qos flag 
CUSTOM_ENV_CI_RUNNER_TAGS is ["bb5_map"]
uid=0(root) gid=0(root) groups=0(root)
root
UID is 0
A slurm job will be created with name GL_J433567_PROD_P112_CP6_C10
Job parameters: memory=76G, cpus_per_task=2, duration=1:00:00, constraint=volta ntasks=16 account=proj9998 user=bbpcihpcproj12 partition=prod qos=
Not executing the chown -R
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 1007419
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=16 --cpus-per-task=2 --mem=76G   --job-name=GL_J433567_PROD_P112_CP6_C10 -C volta --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P84996 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P84996 --ntasks=16 --jobid=1007419 --cpus-per-task=2 --mem=76G    
section_end:1668578695:prepare_executor
section_start:1668578695:prepare_script
Preparing environment
Using git from spack modules
Running on r2i3n0 via bbpv1.epfl.ch...
section_end:1668578696:prepare_script
section_start:1668578696:get_sources
Getting source from Git repository
Using git from spack modules
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1668578697:get_sources
section_start:1668578697:download_artifacts
Downloading artifacts
Using git from spack modules
Downloading artifacts for build:neuron:nmodl:nvhpc:acc:debug:legacy (433559)...
Runtime platform                                    arch=amd64 os=linux pid=143429 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok        id=433559 responseStatus=200 OK token=xDdydh_5
section_end:1668578698:download_artifacts
section_start:1668578698:step_script
Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
Using git from spack modules
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
   Site: r1i5n3
   Build name: Linux-nvc++
Create new tag: 20221116-0605 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P84996/J433559/spack-build/spack-stage-neuron-develop-srcz5aowefbsnvqo6zuzkpvuke67vikh/spack-build-srcz5ao
        Start 118: external_ringtest::coreneuron_cpu_mpi_offline::preparation
        Start 123: external_ringtest::coreneuron_gpu_mpi_offline::preparation
        Start 130: testcorenrn_bbcore::coreneuron_gpu_offline::preparation
        Start 134: testcorenrn_bbcore::coreneuron_cpu_offline::preparation
        Start 140: testcorenrn_conc::coreneuron_gpu_offline::preparation
        Start 144: testcorenrn_conc::coreneuron_cpu_offline::preparation
        Start 150: testcorenrn_deriv::coreneuron_gpu_offline::preparation
        Start 154: testcorenrn_deriv::coreneuron_cpu_offline::preparation
        Start 160: testcorenrn_gf::coreneuron_gpu_offline::preparation
        Start 164: testcorenrn_gf::coreneuron_cpu_offline::preparation
        Start 170: testcorenrn_kin::coreneuron_gpu_offline::preparation
        Start 174: testcorenrn_kin::coreneuron_cpu_offline::preparation
  1/236 Test #130: testcorenrn_bbcore::coreneuron_gpu_offline::preparation ............   Passed    3.34 sec
        Start 179: testcorenrn_patstim::coreneuron_gpu_offline::preparation
  2/236 Test #134: testcorenrn_bbcore::coreneuron_cpu_offline::preparation ............   Passed    3.40 sec
        Start 112: external_ringtest::neuron
  3/236 Test #140: testcorenrn_conc::coreneuron_gpu_offline::preparation ..............   Passed    4.26 sec
        Start 126: testcorenrn_bbcore::neuron
  4/236 Test #154: testcorenrn_deriv::coreneuron_cpu_offline::preparation .............   Passed    4.41 sec
        Start 127: testcorenrn_bbcore::coreneuron_gpu_online
  5/236 Test #144: testcorenrn_conc::coreneuron_cpu_offline::preparation ..............   Passed    4.46 sec
        Start 128: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate
  6/236 Test #150: testcorenrn_deriv::coreneuron_gpu_offline::preparation .............   Passed    4.48 sec
        Start 129: testcorenrn_bbcore::coreneuron_gpu_offline
  7/236 Test #170: testcorenrn_kin::coreneuron_gpu_offline::preparation ...............   Passed    4.52 sec
        Start 131: testcorenrn_bbcore::coreneuron_cpu_online
  8/236 Test #174: testcorenrn_kin::coreneuron_cpu_offline::preparation ...............   Passed    4.56 sec
        Start 132: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate
  9/236 Test #160: testcorenrn_gf::coreneuron_gpu_offline::preparation ................   Passed    4.73 sec
        Start 182: testcorenrn_patstim::coreneuron_cpu_offline::preparation
 10/236 Test #164: testcorenrn_gf::coreneuron_cpu_offline::preparation ................   Passed    4.80 sec
        Start 188: testcorenrn_vecplay::coreneuron_gpu_offline::preparation
 11/236 Test #179: testcorenrn_patstim::coreneuron_gpu_offline::preparation ...........   Passed    1.91 sec
        Start 133: testcorenrn_bbcore::coreneuron_cpu_offline
 12/236 Test #112: external_ringtest::neuron ..........................................   Passed    1.89 sec
        Start 136: testcorenrn_conc::neuron
 13/236 Test #126: testcorenrn_bbcore::neuron .........................................   Passed    1.64 sec
        Start 137: testcorenrn_conc::coreneuron_gpu_online
 14/236 Test #118: external_ringtest::coreneuron_cpu_mpi_offline::preparation .........   Passed    6.35 sec
        Start 192: testcorenrn_vecplay::coreneuron_cpu_offline::preparation
 15/236 Test #123: external_ringtest::coreneuron_gpu_mpi_offline::preparation .........   Passed    6.44 sec
        Start 208: testcorenrn_watch::coreneuron_gpu_offline::preparation
 16/236 Test #129: testcorenrn_bbcore::coreneuron_gpu_offline .........................   Passed    3.46 sec
        Start 138: testcorenrn_conc::coreneuron_gpu_online_psolve_alternate
 17/236 Test #182: testcorenrn_patstim::coreneuron_cpu_offline::preparation ...........   Passed    3.40 sec
        Start 212: testcorenrn_watch::coreneuron_cpu_offline::preparation
 18/236 Test #133: testcorenrn_bbcore::coreneuron_cpu_offline .........................   Passed    3.09 sec
        Start 139: testcorenrn_conc::coreneuron_gpu_offline
 19/236 Test #188: testcorenrn_vecplay::coreneuron_gpu_offline::preparation ...........   Passed    3.58 sec
        Start 113: external_ringtest::neuron_mpi
 20/236 Test #136: testcorenrn_conc::neuron ...........................................   Passed    3.16 sec
        Start 141: testcorenrn_conc::coreneuron_cpu_online
 21/236 Test #131: testcorenrn_bbcore::coreneuron_cpu_online ..........................   Passed    4.47 sec
        Start 142: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate
 22/236 Test #208: testcorenrn_watch::coreneuron_gpu_offline::preparation .............   Passed    2.65 sec
        Start 114: external_ringtest::neuron_mpi_python
 23/236 Test #192: testcorenrn_vecplay::coreneuron_cpu_offline::preparation ...........   Passed    2.79 sec
        Start 115: external_ringtest::coreneuron_cpu_mpi_offline_saverestore
 24/236 Test #132: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate .........   Passed    4.58 sec
        Start 143: testcorenrn_conc::coreneuron_cpu_offline
 25/236 Test #212: testcorenrn_watch::coreneuron_cpu_offline::preparation .............   Passed    1.88 sec
        Start 116: external_ringtest::coreneuron_cpu_mpi
 26/236 Test #113: external_ringtest::neuron_mpi ......................................   Passed    2.88 sec
        Start 117: external_ringtest::coreneuron_cpu_mpi_offline
 27/236 Test #141: testcorenrn_conc::coreneuron_cpu_online ............................   Passed    2.86 sec
        Start 146: testcorenrn_deriv::neuron
 28/236 Test #143: testcorenrn_conc::coreneuron_cpu_offline ...........................   Passed    2.49 sec
        Start 147: testcorenrn_deriv::coreneuron_gpu_online
 29/236 Test #142: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate ...........   Passed    2.99 sec
        Start 148: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate
 30/236 Test #114: external_ringtest::neuron_mpi_python ...............................   Passed    3.06 sec
        Start 120: external_ringtest::coreneuron_gpu_mpi_offline_saverestore
 31/236 Test #146: testcorenrn_deriv::neuron ..........................................   Passed    1.59 sec
        Start 149: testcorenrn_deriv::coreneuron_gpu_offline
 32/236 Test #116: external_ringtest::coreneuron_cpu_mpi ..............................   Passed    3.53 sec
        Start 121: external_ringtest::coreneuron_gpu_mpi
 33/236 Test #117: external_ringtest::coreneuron_cpu_mpi_offline ......................   Passed    3.05 sec
        Start 122: external_ringtest::coreneuron_gpu_mpi_offline
 34/236 Test #115: external_ringtest::coreneuron_cpu_mpi_offline_saverestore ..........   Passed   11.36 sec
        Start 151: testcorenrn_deriv::coreneuron_cpu_online
        Start 152: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate
 35/236 Test #127: testcorenrn_bbcore::coreneuron_gpu_online ..........................   Passed   18.06 sec
        Start 153: testcorenrn_deriv::coreneuron_cpu_offline
 36/236 Test #120: external_ringtest::coreneuron_gpu_mpi_offline_saverestore ..........   Passed   10.97 sec
        Start 156: testcorenrn_gf::neuron
 37/236 Test #151: testcorenrn_deriv::coreneuron_cpu_online ...........................   Passed    2.78 sec
        Start 166: testcorenrn_kin::neuron
 38/236 Test #152: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate ..........   Passed    2.86 sec
        Start 167: testcorenrn_kin::coreneuron_gpu_online
 39/236 Test #128: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate .........   Passed   19.79 sec
        Start 168: testcorenrn_kin::coreneuron_gpu_online_psolve_alternate
 40/236 Test #153: testcorenrn_deriv::coreneuron_cpu_offline ..........................   Passed    2.19 sec
        Start 169: testcorenrn_kin::coreneuron_gpu_offline
 41/236 Test #166: testcorenrn_kin::neuron ............................................   Passed    1.58 sec
        Start 171: testcorenrn_kin::coreneuron_cpu_online
 42/236 Test #156: testcorenrn_gf::neuron .............................................   Passed    2.08 sec
        Start 157: testcorenrn_gf::coreneuron_gpu_online
 43/236 Test #171: testcorenrn_kin::coreneuron_cpu_online .............................   Passed    2.65 sec
        Start 172: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate
 44/236 Test #172: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate ............   Passed    2.71 sec
        Start 173: testcorenrn_kin::coreneuron_cpu_offline
 45/236 Test #173: testcorenrn_kin::coreneuron_cpu_offline ............................   Passed    3.40 sec
        Start 177: testcorenrn_patstim::coreneuron_gpu_offline_saverestore
 46/236 Test #137: testcorenrn_conc::coreneuron_gpu_online ............................   Passed   53.42 sec
        Start 178: testcorenrn_patstim::coreneuron_gpu_offline
 47/236 Test #139: testcorenrn_conc::coreneuron_gpu_offline ...........................   Passed   60.82 sec
        Start 218: channel_benchmark_hippo::neuron
 48/236 Test #147: testcorenrn_deriv::coreneuron_gpu_online ...........................   Passed   77.19 sec
        Start 219: channel_benchmark_hippo::coreneuron_gpu_online
 49/236 Test #149: testcorenrn_deriv::coreneuron_gpu_offline ..........................   Passed   79.42 sec
        Start 220: channel_benchmark_hippo::coreneuron_gpu_filemode
 50/236 Test #138: testcorenrn_conc::coreneuron_gpu_online_psolve_alternate ...........   Passed   87.19 sec
        Start 221: channel_benchmark_hippo::coreneuron_cpu_online
 51/236 Test #148: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate ..........   Passed   92.37 sec
        Start 222: channel_benchmark_hippo::coreneuron_cpu_filemode
 52/236 Test #167: testcorenrn_kin::coreneuron_gpu_online .............................   Passed   90.71 sec
        Start 224: channel_benchmark_sscx::neuron
 53/236 Test #169: testcorenrn_kin::coreneuron_gpu_offline ............................   Passed   91.30 sec
        Start 225: channel_benchmark_sscx::coreneuron_gpu_online
 54/236 Test #168: testcorenrn_kin::coreneuron_gpu_online_psolve_alternate ............   Passed   93.63 sec
        Start 226: channel_benchmark_sscx::coreneuron_gpu_filemode
 55/236 Test #121: external_ringtest::coreneuron_gpu_mpi ..............................   Passed  114.99 sec
        Start 158: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate
 56/236 Test #122: external_ringtest::coreneuron_gpu_mpi_offline ......................   Passed  114.88 sec
        Start 159: testcorenrn_gf::coreneuron_gpu_offline
 57/236 Test #177: testcorenrn_patstim::coreneuron_gpu_offline_saverestore ............   Passed  115.41 sec
        Start 227: channel_benchmark_sscx::coreneuron_cpu_online
 58/236 Test #157: testcorenrn_gf::coreneuron_gpu_online ..............................   Passed  126.71 sec
        Start 161: testcorenrn_gf::coreneuron_cpu_online
 59/236 Test #178: testcorenrn_patstim::coreneuron_gpu_offline ........................   Passed   92.89 sec
        Start 228: channel_benchmark_sscx::coreneuron_cpu_filemode
 60/236 Test #161: testcorenrn_gf::coreneuron_cpu_online ..............................   Passed    3.15 sec
        Start 162: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate
 61/236 Test #162: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate .............   Passed    3.34 sec
        Start 163: testcorenrn_gf::coreneuron_cpu_offline
 62/236 Test #163: testcorenrn_gf::coreneuron_cpu_offline .............................   Passed    2.86 sec
        Start 176: testcorenrn_patstim::neuron
 63/236 Test #176: testcorenrn_patstim::neuron ........................................   Passed    1.79 sec
        Start 180: testcorenrn_patstim::coreneuron_cpu_offline_saverestore
 64/236 Test #158: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate .............   Passed   35.39 sec
        Start 181: testcorenrn_patstim::coreneuron_cpu_offline
 65/236 Test #159: testcorenrn_gf::coreneuron_gpu_offline .............................   Passed   35.74 sec
        Start 184: testcorenrn_vecplay::neuron
 66/236 Test #181: testcorenrn_patstim::coreneuron_cpu_offline ........................   Passed    2.47 sec
        Start 185: testcorenrn_vecplay::coreneuron_gpu_online
 67/236 Test #184: testcorenrn_vecplay::neuron ........................................   Passed    1.80 sec
        Start 186: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate
 68/236 Test #180: testcorenrn_patstim::coreneuron_cpu_offline_saverestore ............   Passed    6.95 sec
        Start 187: testcorenrn_vecplay::coreneuron_gpu_offline
 69/236 Test #185: testcorenrn_vecplay::coreneuron_gpu_online .........................   Passed   35.59 sec
        Start 189: testcorenrn_vecplay::coreneuron_cpu_online
 70/236 Test #189: testcorenrn_vecplay::coreneuron_cpu_online .........................   Passed    2.89 sec
        Start 190: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate
 71/236 Test #218: channel_benchmark_hippo::neuron ....................................   Passed  136.18 sec
        Start   1: cmd_interface_test
 72/236 Test   #1: cmd_interface_test .................................................   Passed    0.08 sec
        Start   2: interleave_info_constructor_test
 73/236 Test   #2: interleave_info_constructor_test ...................................   Passed    0.05 sec
        Start   3: alignment_test
 74/236 Test   #3: alignment_test .....................................................   Passed    0.04 sec
        Start   4: queuing_test
 75/236 Test   #4: queuing_test .......................................................   Passed    0.04 sec
        Start   5: test-solver
 76/236 Test #190: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate ........   Passed    3.16 sec
        Start 191: testcorenrn_vecplay::coreneuron_cpu_offline
 77/236 Test   #5: test-solver ........................................................   Passed    3.14 sec
        Start   6: lfp_test
 78/236 Test #187: testcorenrn_vecplay::coreneuron_gpu_offline ........................   Passed   38.71 sec
        Start 204: testcorenrn_watch::neuron
 79/236 Test   #6: lfp_test ...........................................................   Passed    0.06 sec
        Start   8: ringtest
 80/236 Test   #8: ringtest ...........................................................   Passed    0.32 sec
        Start   9: connect_dend
 81/236 Test   #9: connect_dend .......................................................   Passed    0.21 sec
        Start  10: mpi_init::nrniv_mpiopt
 82/236 Test  #10: mpi_init::nrniv_mpiopt .............................................   Passed    0.13 sec
        Start  11: mpi_init::nrniv_nrnmpi_init
 83/236 Test  #11: mpi_init::nrniv_nrnmpi_init ........................................   Passed    0.10 sec
        Start  12: mpi_init::python_nrnmpi_init
 84/236 Test  #12: mpi_init::python_nrnmpi_init .......................................   Passed    0.37 sec
        Start  13: mpi_init::python_mpienv
 85/236 Test  #13: mpi_init::python_mpienv ............................................   Passed    0.37 sec
        Start  14: mpi_init::nrniv_mpiexec_mpiopt
 86/236 Test #191: testcorenrn_vecplay::coreneuron_cpu_offline ........................   Passed    2.41 sec
        Start 205: testcorenrn_watch::coreneuron_gpu_online
 87/236 Test #204: testcorenrn_watch::neuron ..........................................   Passed    1.86 sec
        Start 206: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate
 88/236 Test  #14: mpi_init::nrniv_mpiexec_mpiopt .....................................   Passed    1.48 sec
        Start  15: mpi_init::nrniv_mpiexec_nrnmpi_init
 89/236 Test  #15: mpi_init::nrniv_mpiexec_nrnmpi_init ................................   Passed    1.50 sec
        Start  16: mpi_init::python_mpiexec_nrnmpi_init
 90/236 Test  #16: mpi_init::python_mpiexec_nrnmpi_init ...............................   Passed    1.75 sec
        Start  17: mpi_init::python_mpiexec_mpienv
 91/236 Test  #17: mpi_init::python_mpiexec_mpienv ....................................   Passed    1.72 sec
        Start  18: pynrn::basic_tests
 92/236 Test  #18: pynrn::basic_tests .................................................   Passed    6.37 sec
        Start  19: coverage_tests::cover_tests
 93/236 Test  #19: coverage_tests::cover_tests ........................................   Passed    2.35 sec
        Start  20: example_nmodl::ca_ap_hoc
 94/236 Test  #20: example_nmodl::ca_ap_hoc ...........................................   Passed    0.11 sec
        Start  21: example_nmodl::cabpump_hoc
 95/236 Test  #21: example_nmodl::cabpump_hoc .........................................   Passed    0.20 sec
        Start  22: example_nmodl::cachan_hoc
 96/236 Test  #22: example_nmodl::cachan_hoc ..........................................   Passed    0.10 sec
        Start  23: example_nmodl::cadif_hoc
 97/236 Test  #23: example_nmodl::cadif_hoc ...........................................   Passed    0.19 sec
        Start  24: example_nmodl::cadifusl_hoc
 98/236 Test  #24: example_nmodl::cadifusl_hoc ........................................   Passed    0.12 sec
        Start  25: example_nmodl::cadifusl1_hoc
 99/236 Test  #25: example_nmodl::cadifusl1_hoc .......................................   Passed    0.14 sec
        Start  26: example_nmodl::cadifusl2_hoc
100/236 Test  #26: example_nmodl::cadifusl2_hoc .......................................   Passed    0.11 sec
        Start  27: example_nmodl::cagk_hoc
101/236 Test  #27: example_nmodl::cagk_hoc ............................................   Passed    0.10 sec
        Start  28: example_nmodl::capmp_hoc
102/236 Test  #28: example_nmodl::capmp_hoc ...........................................   Passed    0.16 sec
        Start  29: example_nmodl::cv_hoc
103/236 Test  #29: example_nmodl::cv_hoc ..............................................   Passed    0.10 sec
        Start  30: example_nmodl::fh_hoc
104/236 Test  #30: example_nmodl::fh_hoc ..............................................   Passed    0.11 sec
        Start  31: example_nmodl::fit1_hoc
105/236 Test  #31: example_nmodl::fit1_hoc ............................................   Passed    0.11 sec
        Start  32: example_nmodl::gap_hoc
106/236 Test  #32: example_nmodl::gap_hoc .............................................   Passed    0.11 sec
        Start  33: example_nmodl::hh1_hoc
107/236 Test  #33: example_nmodl::hh1_hoc .............................................   Passed    0.10 sec
        Start  34: example_nmodl::hhvect_hoc
108/236 Test  #34: example_nmodl::hhvect_hoc ..........................................   Passed    0.15 sec
        Start  35: example_nmodl::nacum_hoc
109/236 Test  #35: example_nmodl::nacum_hoc ...........................................   Passed    0.10 sec
        Start  36: example_nmodl::nadifl1_hoc
110/236 Test  #36: example_nmodl::nadifl1_hoc .........................................   Passed    0.12 sec
        Start  37: example_nmodl::nadifl2_hoc
111/236 Test  #37: example_nmodl::nadifl2_hoc .........................................   Passed    0.19 sec
        Start  38: example_nmodl::nadifl3_hoc
112/236 Test  #38: example_nmodl::nadifl3_hoc .........................................   Passed    0.20 sec
        Start  39: example_nmodl::nadifl4_hoc
113/236 Test  #39: example_nmodl::nadifl4_hoc .........................................   Passed    0.20 sec
        Start  40: example_nmodl::obj_ex_hoc
114/236 Test  #40: example_nmodl::obj_ex_hoc ..........................................   Passed    0.12 sec
        Start  41: example_nmodl::order_hoc
115/236 Test  #41: example_nmodl::order_hoc ...........................................   Passed    0.19 sec
        Start  42: example_nmodl::passiv_hoc
116/236 Test  #42: example_nmodl::passiv_hoc ..........................................   Passed    0.10 sec
        Start  43: example_nmodl::stim1_hoc
117/236 Test  #43: example_nmodl::stim1_hoc ...........................................   Passed    0.10 sec
        Start  44: example_nmodl::syn1_hoc
118/236 Test  #44: example_nmodl::syn1_hoc ............................................   Passed    0.11 sec
        Start  45: example_nmodl::synpre_hoc
119/236 Test  #45: example_nmodl::synpre_hoc ..........................................   Passed    0.13 sec
        Start  46: example_nmodl::tstextrn_hoc
120/236 Test  #46: example_nmodl::tstextrn_hoc ........................................   Passed    0.10 sec
        Start  47: example_nmodl::tstpnt1_hoc
121/236 Test  #47: example_nmodl::tstpnt1_hoc .........................................   Passed    0.10 sec
        Start  48: example_nmodl::tstpnt2_hoc
122/236 Test  #48: example_nmodl::tstpnt2_hoc .........................................   Passed    0.15 sec
        Start  49: example_nmodl::tstvec_hoc
123/236 Test  #49: example_nmodl::tstvec_hoc ..........................................   Passed    0.10 sec
        Start  50: example_nmodl::tstpnt1_py
124/236 Test  #50: example_nmodl::tstpnt1_py ..........................................   Passed    0.34 sec
        Start  51: example_nmodl::tstpnt2_py
125/236 Test  #51: example_nmodl::tstpnt2_py ..........................................   Passed    0.33 sec
        Start  52: hoctests::perf1_hoc
126/236 Test #221: channel_benchmark_hippo::coreneuron_cpu_online .....................   Passed  135.27 sec
        Start  53: hoctests::test1_hoc
127/236 Test  #53: hoctests::test1_hoc ................................................   Passed    0.32 sec
        Start  54: hoctests::test2_hoc
128/236 Test  #54: hoctests::test2_hoc ................................................   Passed    0.17 sec
        Start  55: hoctests::test3_hoc
129/236 Test  #55: hoctests::test3_hoc ................................................   Passed    0.12 sec
        Start  56: hoctests::test4_hoc
130/236 Test  #56: hoctests::test4_hoc ................................................   Passed    0.10 sec
        Start  57: hoctests::test5_hoc
131/236 Test  #57: hoctests::test5_hoc ................................................   Passed    0.10 sec
        Start  58: hoctests::test6_hoc
132/236 Test  #58: hoctests::test6_hoc ................................................   Passed    0.10 sec
        Start  59: hoctests::test7_hoc
133/236 Test  #59: hoctests::test7_hoc ................................................   Passed    0.10 sec
        Start  60: hoctests::test8_hoc
134/236 Test  #60: hoctests::test8_hoc ................................................   Passed    0.10 sec
        Start  61: hoctests::test1_py
135/236 Test  #52: hoctests::perf1_hoc ................................................   Passed    1.47 sec
        Start  62: hoctests::test2_py
136/236 Test  #61: hoctests::test1_py .................................................   Passed    0.34 sec
        Start  63: hoctests::test9_py
137/236 Test  #62: hoctests::test2_py .................................................   Passed    0.37 sec
        Start  68: coreneuron_modtests::version_macros
138/236 Test  #63: hoctests::test9_py .................................................   Passed    0.40 sec
        Start  69: coreneuron_modtests::fornetcon_py_cpu
139/236 Test  #68: coreneuron_modtests::version_macros ................................   Passed    1.22 sec
        Start  70: coreneuron_modtests::direct_py_cpu
140/236 Test  #69: coreneuron_modtests::fornetcon_py_cpu ..............................   Passed    1.25 sec
        Start  71: coreneuron_modtests::direct_hoc_cpu
141/236 Test  #70: coreneuron_modtests::direct_py_cpu .................................   Passed    1.28 sec
        Start  72: coreneuron_modtests::spikes_py_cpu
142/236 Test  #71: coreneuron_modtests::direct_hoc_cpu ................................   Passed    1.38 sec
        Start  73: coreneuron_modtests::spikes_file_mode_py_cpu
143/236 Test  #72: coreneuron_modtests::spikes_py_cpu .................................   Passed    1.32 sec
        Start  74: coreneuron_modtests::fast_imem_py_cpu
144/236 Test #219: channel_benchmark_hippo::coreneuron_gpu_online .....................   Passed  147.06 sec
        Start  75: coreneuron_modtests::datareturn_py_cpu
145/236 Test  #73: coreneuron_modtests::spikes_file_mode_py_cpu .......................   Passed    1.26 sec
        Start  76: coreneuron_modtests::test_units_py_cpu
146/236 Test  #74: coreneuron_modtests::fast_imem_py_cpu ..............................   Passed    1.61 sec
        Start  77: coreneuron_modtests::test_netmove_py_cpu
147/236 Test  #76: coreneuron_modtests::test_units_py_cpu .............................   Passed    1.43 sec
        Start  78: coreneuron_modtests::test_pointer_py_cpu
148/236 Test  #75: coreneuron_modtests::datareturn_py_cpu .............................   Passed    1.74 sec
        Start  79: coreneuron_modtests::test_watchrange_py_cpu
149/236 Test  #77: coreneuron_modtests::test_netmove_py_cpu ...........................   Passed    1.45 sec
        Start  80: coreneuron_modtests::test_psolve_py_cpu
150/236 Test  #79: coreneuron_modtests::test_watchrange_py_cpu ........................   Passed    1.35 sec
        Start  81: coreneuron_modtests::test_ba_py_cpu
151/236 Test #220: channel_benchmark_hippo::coreneuron_gpu_filemode ...................   Passed  147.84 sec
        Start  82: coreneuron_modtests::test_natrans_py_cpu
152/236 Test  #81: coreneuron_modtests::test_ba_py_cpu ................................   Passed    1.23 sec
        Start  86: coreneuron_modtests::fornetcon_py_gpu
153/236 Test  #80: coreneuron_modtests::test_psolve_py_cpu ............................   Passed    1.43 sec
        Start  87: coreneuron_modtests::direct_py_gpu
154/236 Test #222: channel_benchmark_hippo::coreneuron_cpu_filemode ...................   Passed  135.91 sec
        Start  88: coreneuron_modtests::direct_hoc_gpu
155/236 Test #224: channel_benchmark_sscx::neuron .....................................   Passed  126.81 sec
        Start  89: coreneuron_modtests::spikes_py_gpu
156/236 Test  #82: coreneuron_modtests::test_natrans_py_cpu ...........................   Passed    1.48 sec
        Start  90: coreneuron_modtests::spikes_file_mode_py_gpu
157/236 Test  #78: coreneuron_modtests::test_pointer_py_cpu ...........................   Passed    8.00 sec
        Start  91: coreneuron_modtests::fast_imem_py_gpu
158/236 Test  #88: coreneuron_modtests::direct_hoc_gpu ................................   Passed    5.68 sec
        Start  92: coreneuron_modtests::datareturn_py_gpu
159/236 Test  #90: coreneuron_modtests::spikes_file_mode_py_gpu .......................   Passed    8.58 sec
        Start  93: coreneuron_modtests::test_units_py_gpu
160/236 Test  #93: coreneuron_modtests::test_units_py_gpu .............................   Passed    2.54 sec
        Start  94: coreneuron_modtests::test_netmove_py_gpu
161/236 Test #225: channel_benchmark_sscx::coreneuron_gpu_online ......................   Passed  142.92 sec
        Start  95: coreneuron_modtests::test_pointer_py_gpu
162/236 Test  #91: coreneuron_modtests::fast_imem_py_gpu ..............................   Passed   14.10 sec
        Start  96: coreneuron_modtests::test_watchrange_py_gpu
163/236 Test  #87: coreneuron_modtests::direct_py_gpu .................................   Passed   20.87 sec
        Start  97: coreneuron_modtests::test_psolve_py_gpu
164/236 Test #226: channel_benchmark_sscx::coreneuron_gpu_filemode ....................   Passed  144.39 sec
        Start  98: coreneuron_modtests::test_ba_py_gpu
165/236 Test  #86: coreneuron_modtests::fornetcon_py_gpu ..............................   Passed   22.32 sec
        Start  99: coreneuron_modtests::test_natrans_py_gpu
166/236 Test  #98: coreneuron_modtests::test_ba_py_gpu ................................   Passed    1.25 sec
        Start 103: modlunit_unitstest
167/236 Test #103: modlunit_unitstest .................................................   Passed    0.03 sec
        Start 104: modlunit_hh
168/236 Test #104: modlunit_hh ........................................................   Passed    0.03 sec
        Start 105: modlunit_stim
169/236 Test #105: modlunit_stim ......................................................   Passed    0.03 sec
        Start 106: modlunit_pattern
170/236 Test #106: modlunit_pattern ...................................................   Passed    0.02 sec
        Start 107: external_nrntest
171/236 Test  #89: coreneuron_modtests::spikes_py_gpu .................................   Passed   22.99 sec
        Start 135: testcorenrn_bbcore::compare_results
172/236 Test  #99: coreneuron_modtests::test_natrans_py_gpu ...........................   Passed    1.35 sec
        Start 145: testcorenrn_conc::compare_results
173/236 Test #135: testcorenrn_bbcore::compare_results ................................   Passed    0.10 sec
        Start 155: testcorenrn_deriv::compare_results
174/236 Test #145: testcorenrn_conc::compare_results ..................................   Passed    0.13 sec
        Start 165: testcorenrn_gf::compare_results
175/236 Test #155: testcorenrn_deriv::compare_results .................................   Passed    0.25 sec
        Start 175: testcorenrn_kin::compare_results
176/236 Test #165: testcorenrn_gf::compare_results ....................................   Passed    0.35 sec
        Start 183: testcorenrn_patstim::compare_results
177/236 Test #175: testcorenrn_kin::compare_results ...................................   Passed    0.40 sec
        Start 223: channel_benchmark_hippo::compare_results
178/236 Test #183: testcorenrn_patstim::compare_results ...............................   Passed    0.38 sec
179/236 Test #223: channel_benchmark_hippo::compare_results ...........................   Passed    0.19 sec
        Start 207: testcorenrn_watch::coreneuron_gpu_offline
180/236 Test  #96: coreneuron_modtests::test_watchrange_py_gpu ........................   Passed    6.74 sec
181/236 Test  #97: coreneuron_modtests::test_psolve_py_gpu ............................   Passed    6.03 sec
        Start 209: testcorenrn_watch::coreneuron_cpu_online
182/236 Test  #95: coreneuron_modtests::test_pointer_py_gpu ...........................   Passed    8.56 sec
183/236 Test #209: testcorenrn_watch::coreneuron_cpu_online ...........................   Passed    5.30 sec
        Start 210: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate
184/236 Test #227: channel_benchmark_sscx::coreneuron_cpu_online ......................   Passed  127.53 sec
        Start 211: testcorenrn_watch::coreneuron_cpu_offline
185/236 Test #186: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate ........   Passed  110.74 sec
        Start 214: testcorenrn_netstimdirect::direct_netstimdirect
186/236 Test #210: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate ..........   Passed    6.79 sec
        Start 215: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate
187/236 Test #228: channel_benchmark_sscx::coreneuron_cpu_filemode ....................   Passed  128.10 sec
        Start 193: testcorenrn_vecplay::compare_results
188/236 Test #211: testcorenrn_watch::coreneuron_cpu_offline ..........................   Passed    4.14 sec
        Start  65: parallel::partrans
189/236 Test #193: testcorenrn_vecplay::compare_results ...............................   Passed    1.04 sec
        Start 229: channel_benchmark_sscx::compare_results
190/236 Test #229: channel_benchmark_sscx::compare_results ............................   Passed    1.13 sec
191/236 Test #214: testcorenrn_netstimdirect::direct_netstimdirect ....................   Passed    8.23 sec
        Start  66: parallel::netpar
192/236 Test  #65: parallel::partrans .................................................   Passed    5.79 sec
        Start  67: parallel::bas
193/236 Test #215: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate ...   Passed    7.67 sec
        Start  83: coreneuron_modtests::spikes_mpi_py_cpu
        Start 216: testcorenrn_netstimdirect::compare_results
194/236 Test #216: testcorenrn_netstimdirect::compare_results .........................   Passed    0.99 sec
195/236 Test #206: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate ..........   Passed   78.60 sec
        Start  84: coreneuron_modtests::spikes_mpi_file_mode_py_cpu
196/236 Test  #66: parallel::netpar ...................................................   Passed    6.21 sec
        Start  85: coreneuron_modtests::inputpresyn_py_cpu
197/236 Test  #83: coreneuron_modtests::spikes_mpi_py_cpu .............................   Passed    7.74 sec
        Start 100: coreneuron_modtests::spikes_mpi_py_gpu
198/236 Test  #84: coreneuron_modtests::spikes_mpi_file_mode_py_cpu ...................   Passed    7.54 sec
        Start 101: coreneuron_modtests::spikes_mpi_file_mode_py_gpu
199/236 Test  #85: coreneuron_modtests::inputpresyn_py_cpu ............................   Passed    7.77 sec
        Start 102: coreneuron_modtests::inputpresyn_py_gpu
200/236 Test #205: testcorenrn_watch::coreneuron_gpu_online ...........................   Passed   96.10 sec
201/236 Test #102: coreneuron_modtests::inputpresyn_py_gpu ............................   Passed    7.47 sec
        Start 198: testcorenrn_vecevent::coreneuron_gpu_offline::preparation
202/236 Test #101: coreneuron_modtests::spikes_mpi_file_mode_py_gpu ...................   Passed   11.33 sec
203/236 Test  #67: parallel::bas ......................................................   Passed   22.12 sec
        Start 202: testcorenrn_vecevent::coreneuron_cpu_offline::preparation
204/236 Test  #92: coreneuron_modtests::datareturn_py_gpu .............................   Passed   66.01 sec
205/236 Test #198: testcorenrn_vecevent::coreneuron_gpu_offline::preparation ..........   Passed    5.14 sec
        Start 231: olfactory-bulb-3d::neuron::preparation
206/236 Test #231: olfactory-bulb-3d::neuron::preparation .............................   Passed    0.03 sec
        Start 233: olfactory-bulb-3d::coreneuron_gpu_online::preparation
207/236 Test #233: olfactory-bulb-3d::coreneuron_gpu_online::preparation ..............   Passed    0.03 sec
        Start 235: olfactory-bulb-3d::coreneuron_cpu_online::preparation
208/236 Test #100: coreneuron_modtests::spikes_mpi_py_gpu .............................   Passed   17.70 sec
        Start 108: reduced_dentate::neuron
209/236 Test #235: olfactory-bulb-3d::coreneuron_cpu_online::preparation ..............   Passed    0.03 sec
        Start 109: reduced_dentate::coreneuron_cpu
210/236 Test #202: testcorenrn_vecevent::coreneuron_cpu_offline::preparation ..........   Passed    4.45 sec
        Start 110: reduced_dentate::coreneuron_gpu
211/236 Test  #94: coreneuron_modtests::test_netmove_py_gpu ...........................   Passed   68.46 sec
212/236 Test #207: testcorenrn_watch::coreneuron_gpu_offline ..........................   Passed   65.07 sec
        Start 213: testcorenrn_watch::compare_results
213/236 Test #213: testcorenrn_watch::compare_results .................................   Passed    0.18 sec
214/236 Test #108: reduced_dentate::neuron ............................................   Passed   32.51 sec
        Start 119: external_ringtest::coreneuron_cpu_mpi_threads
215/236 Test #109: reduced_dentate::coreneuron_cpu ....................................   Passed   34.21 sec
        Start 194: testcorenrn_vecevent::neuron
216/236 Test #119: external_ringtest::coreneuron_cpu_mpi_threads ......................   Passed    3.64 sec
        Start 124: external_ringtest::coreneuron_gpu_mpi_threads
217/236 Test #194: testcorenrn_vecevent::neuron .......................................   Passed    2.25 sec
        Start 195: testcorenrn_vecevent::coreneuron_gpu_online
218/236 Test #110: reduced_dentate::coreneuron_gpu ....................................   Passed   40.68 sec
        Start 196: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate
        Start 111: reduced_dentate::compare_results
219/236 Test #111: reduced_dentate::compare_results ...................................   Passed    0.08 sec
220/236 Test #195: testcorenrn_vecevent::coreneuron_gpu_online ........................   Passed   11.16 sec
        Start 197: testcorenrn_vecevent::coreneuron_gpu_offline
221/236 Test #196: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate .......   Passed   10.00 sec
        Start 199: testcorenrn_vecevent::coreneuron_cpu_online
222/236 Test #199: testcorenrn_vecevent::coreneuron_cpu_online ........................   Passed    5.53 sec
        Start 200: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate
223/236 Test #197: testcorenrn_vecevent::coreneuron_gpu_offline .......................   Passed   14.75 sec
        Start 201: testcorenrn_vecevent::coreneuron_cpu_offline
224/236 Test #200: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate .......   Passed    5.74 sec
        Start 230: olfactory-bulb-3d::neuron
225/236 Test #124: external_ringtest::coreneuron_gpu_mpi_threads ......................   Passed   29.02 sec
        Start 232: olfactory-bulb-3d::coreneuron_gpu_online
        Start 125: external_ringtest::compare_results
226/236 Test #125: external_ringtest::compare_results .................................   Passed    0.11 sec
227/236 Test #201: testcorenrn_vecevent::coreneuron_cpu_offline .......................   Passed    2.96 sec
        Start 234: olfactory-bulb-3d::coreneuron_cpu_online
        Start 203: testcorenrn_vecevent::compare_results
228/236 Test #203: testcorenrn_vecevent::compare_results ..............................   Passed    0.09 sec
229/236 Test #232: olfactory-bulb-3d::coreneuron_gpu_online ...........................   Passed   41.27 sec
        Start  64: parallel::subworld
230/236 Test  #64: parallel::subworld .................................................   Passed    3.64 sec
231/236 Test #234: olfactory-bulb-3d::coreneuron_cpu_online ...........................   Passed   54.69 sec
232/236 Test #230: olfactory-bulb-3d::neuron ..........................................   Passed   64.90 sec
        Start 236: olfactory-bulb-3d::compare_results
233/236 Test #236: olfactory-bulb-3d::compare_results .................................   Passed    0.76 sec
234/236 Test #107: external_nrntest ...................................................   Passed  185.31 sec
        Start   7: unit_tests::testneuron
235/236 Test   #7: unit_tests::testneuron .............................................   Passed   27.30 sec
        Start 217: tqperf::coreneuron_special
236/236 Test #217: tqperf::coreneuron_special .........................................   Passed    9.97 sec

100% tests passed, 0 tests failed out of 236

Total Test time (real) = 486.31 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.9.7
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1668579215:step_script
section_start:1668579215:upload_artifacts_on_success
Uploading artifacts for successful job
Using git from spack modules
Uploading artifacts...
Runtime platform                                    arch=amd64 os=linux pid=163971 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories 
Testing/: found 7 matching files and directories   
Uploading artifacts as "archive" to coordinator... ok  id=433567 responseStatus=201 Created token=xDdydh_5
Uploading artifacts...
Runtime platform                                    arch=amd64 os=linux pid=164043 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories  
Uploading artifacts as "junit" to coordinator... ok  id=433567 responseStatus=201 Created token=xDdydh_5
section_end:1668579217:upload_artifacts_on_success
section_start:1668579217:cleanup_file_variables
Cleaning up project directory and file based variables
Using git from spack modules
section_end:1668579218:cleanup_file_variables
Job succeeded