[0KRunning with gitlab-runner 15.1.0 (76984217)[0;m [0K on BB5 map runner pnPo3yJy[0;m section_start:1659607495:resolve_secrets [0K[0K[36;1mResolving secrets[0;m[0;m section_end:1659607495:resolve_secrets [0Ksection_start:1659607495:prepare_executor [0K[0K[36;1mPreparing the "custom" executor[0;m[0;m [0KUsing Custom executor with driver BB5 PROD runner v0.0.3...[0;m BB5 PROD runner running on bbpv1.epfl.ch, version 15.1.0, user TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor2455085299, slurm job id Runner ID 29, project root hpc, project name coreneuron Pipeline ID 68123, build ref 74640ab6b28fa9037b36497bccb3b0d1bf5bfc7b, job ID 311870 Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P68123, optional exclusive flag , optional cpus per task flag --cpus-per-task=1, optional qos flag A slurm job will be created with name GL_J311870_PROD_P112_CP4_C5 Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=cpu ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod qos= Not executing the chown -R sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx] Submitted batch job 687419 job state: PD job state: PD job state: PD job state: PD job state: PD job state: PD job state: PD job state: PD job state: PD job state: PD job state: R sbatch: sbatch -p prod -A proj9998 --ntasks=8 --cpus-per-task=1 --mem=30750M --job-name=GL_J311870_PROD_P112_CP4_C5 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P68123 --time=1:00:00 --wrap="sleep infinity" srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P68123 --ntasks=8 --jobid=687419 --cpus-per-task=1 --mem=30750M section_end:1659607507:prepare_executor [0Ksection_start:1659607507:prepare_script [0K[0K[36;1mPreparing environment[0;m[0;m Running on r1i5n17 via bbpv1.epfl.ch... section_end:1659607510:prepare_script [0Ksection_start:1659607510:get_sources [0K[0K[36;1mGetting source from Git repository[0;m[0;m [32;1mSkipping Git repository setup[0;m [32;1mSkipping Git checkout[0;m [32;1mSkipping Git submodules setup[0;m section_end:1659607511:get_sources [0Ksection_start:1659607511:download_artifacts [0K[0K[36;1mDownloading artifacts[0;m[0;m [32;1mDownloading artifacts for build:coreneuron:mod2c:intel (311859)...[0;m Runtime platform [0;m arch[0;m=amd64 os[0;m=linux pid[0;m=237766 revision[0;m=58ba2b95 version[0;m=14.2.0 Downloading artifacts from coordinator... ok [0;m id[0;m=311859 responseStatus[0;m=200 OK token[0;m=Kx4k9Vkz section_end:1659607512:download_artifacts [0Ksection_start:1659607512:step_script [0K[0K[36;1mExecuting "step_script" stage of the job script[0;m[0;m [0;33mWARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426[0;m [32;1m$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env[0;m [32;1m$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}[0;m [32;1m$ . ${SPACK_ROOT}/share/spack/setup-env.sh[0;m [32;1m$ cd ${SPACK_BUILD_DIR}[0;m [32;1m$ export BOOST_TEST_COLOR_OUTPUT=no[0;m [32;1m$ i_am_a_failure=0[0;m [32;1m$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1[0;m Site: r1i6n29 Build name: Linux-icpc Create new tag: 20220804-1005 - Experimental Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P68123/J311859/spack-build/spack-stage-coreneuron-develop-h52pf3c2lilm4gduccor4xbhtyuglcao/spack-build-h52pf3c Start 1: cmd_interface_test Start 2: interleave_info_constructor_test Start 3: alignment_test Start 4: queuing_test Start 5: test-solver Start 6: lfp_test Start 7: ring_TEST 1/18 Test #5: test-solver ........................ Passed 0.63 sec Start 18: reporting_1 2/18 Test #7: ring_TEST .......................... Passed 2.07 sec Start 8: ring_binqueue_TEST 3/18 Test #1: cmd_interface_test ................. Passed 2.29 sec 4/18 Test #3: alignment_test ..................... Passed 2.56 sec Start 9: ring_multisend_TEST 5/18 Test #4: queuing_test ....................... Passed 2.75 sec 6/18 Test #2: interleave_info_constructor_test ... Passed 2.77 sec Start 10: ring_spike_buffer_TEST 7/18 Test #6: lfp_test ........................... Passed 2.91 sec 8/18 Test #8: ring_binqueue_TEST ................. Passed 1.36 sec Start 11: ring_permute1_TEST 9/18 Test #9: ring_multisend_TEST ................ Passed 0.97 sec Start 12: ring_permute2_TEST 10/18 Test #10: ring_spike_buffer_TEST ............. Passed 0.82 sec Start 13: ring_gap_TEST 11/18 Test #11: ring_permute1_TEST ................. Passed 0.77 sec Start 14: ring_gap_binqueue_TEST 12/18 Test #13: ring_gap_TEST ...................... Passed 0.82 sec Start 15: ring_gap_multisend_TEST 13/18 Test #12: ring_permute2_TEST ................. Passed 0.92 sec Start 16: ring_gap_permute1_TEST 14/18 Test #14: ring_gap_binqueue_TEST ............. Passed 0.78 sec Start 17: ring_gap_permute2_TEST 15/18 Test #15: ring_gap_multisend_TEST ............ Passed 0.75 sec 16/18 Test #16: ring_gap_permute1_TEST ............. Passed 0.78 sec 17/18 Test #18: reporting_1 ........................***Failed 4.77 sec num_mpi=2 Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020 Version : 9.0.0 74640ab6 (2022-08-04 11:57:49 +0200) Additional mechanisms from files exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod Memory (MBs) : After mk_mech : Max 12.4883, Min 12.2969, Avg 12.3926 Memory (MBs) : After MPI_Init : Max 12.7461, Min 12.5547, Avg 12.6504 Memory (MBs) : Before nrn_setup : Max 12.8555, Min 12.6719, Avg 12.7637 no chkpnt line for 31 ../spack-src/coreneuron/io/nrn_filehandler.cpp:96: Assertion 'n_scan == 1' failed. MPT ERROR: Rank 1(g:1) received signal SIGABRT/SIGIOT(6). Process ID: 238524, Host: r1i5n17, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P68123/J311859/spack-build/spack-stage-coreneuron-develop-h52pf3c2lilm4gduccor4xbhtyuglcao/spack-build-h52pf3c/bin/x86_64/special-core MPT Version: HPE HMPT 2.25 10/22/21 03:18:39 MPT: --------stack traceback------- no chkpnt line for 33 ../spack-src/coreneuron/io/nrn_filehandler.cpp:96: Assertion 'n_scan == 1' failed. MPT: ImportError: No module named site MPT: -----stack traceback ends----- MPT: On host r1i5n17, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P68123/J311859/spack-build/spack-stage-coreneuron-develop-h52pf3c2lilm4gduccor4xbhtyuglcao/spack-build-h52pf3c/bin/x86_64/special-core, Rank 1, Process 238524: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P68123/J311859/spack-build/spack-stage-coreneuron-develop-h52pf3c2lilm4gduccor4xbhtyuglcao/spack-build-h52pf3c/tests/integration/reporting_1 srun: error: r1i5n17: task 1: Aborted (core dumped) srun: launch/slurm: _step_signal: Terminating StepId=687419.10 slurmstepd: error: *** STEP 687419.10 ON r1i5n17 CANCELLED AT 2022-08-04T12:05:42 *** srun: error: r1i5n17: task 0: Terminated srun: Force Terminated StepId=687419.10 18/18 Test #17: ring_gap_permute2_TEST ............. Passed 0.90 sec 94% tests passed, 1 tests failed out of 18 Total Test time (real) = 5.93 sec The following tests FAILED: 18 - reporting_1 (Failed) Errors while running CTest [32;1m$ cp -r Testing/ ${CI_PROJECT_DIR}/[0;m [32;1m$ module load unstable unit-test-translator[0;m Autoloading python/3.9.7 [32;1m$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml[0;m [32;1m$ exit ${i_am_a_failure}[0;m srun: error: r1i5n17: task 0: Exited with exit code 1 section_end:1659607543:step_script [0Ksection_start:1659607543:upload_artifacts_on_failure [0K[0K[36;1mUploading artifacts for failed job[0;m[0;m [32;1mUploading artifacts...[0;m Runtime platform [0;m arch[0;m=amd64 os[0;m=linux pid[0;m=239234 revision[0;m=58ba2b95 version[0;m=14.2.0 initial_environment.env: found 1 matching files and directories[0;m Testing/: found 8 matching files and directories [0;m Uploading artifacts as "archive" to coordinator... ok[0;m id[0;m=311870 responseStatus[0;m=201 Created token[0;m=Kx4k9Vkz [32;1mUploading artifacts...[0;m Runtime platform [0;m arch[0;m=amd64 os[0;m=linux pid[0;m=239264 revision[0;m=58ba2b95 version[0;m=14.2.0 ctest.xml: found 1 matching files and directories [0;m Uploading artifacts as "junit" to coordinator... ok[0;m id[0;m=311870 responseStatus[0;m=201 Created token[0;m=Kx4k9Vkz section_end:1659607545:upload_artifacts_on_failure [0Ksection_start:1659607545:cleanup_file_variables [0K[0K[36;1mCleaning up project directory and file based variables[0;m[0;m section_end:1659607546:cleanup_file_variables [0K[31;1mERROR: Job failed: exit status 1 [0;m