| Model | Average | AGIEval | GPT4All | TruthfulQA | Bigbench |
|---|---:|---:|---:|---:|---:|
| [mlabonne/OmniTruthyBeagle-7B-v0](https://huggingface.co/mlabonne/OmniTruthyBeagle-7B-v0) [📄](https://gist.github.com/mlabonne/12f5501fb66fb28f0ba6190cb6936f18) | 57.8 | 45.72 | 77.49 | 76.16 | 50.18 |
| [mlabonne/NeuralOmniBeagle-7B-v2](https://huggingface.co/mlabonne/NeuralOmniBeagle-7B-v2) [📄](https://gist.github.com/mlabonne/070610dae38fe691ca64f57f6d10b248) | 57.75 | 45.86 | 77.31 | 75.34 | 50.09 |
| [mlabonne/OmniBeagle-7B](https://huggingface.co/mlabonne/OmniBeagle-7B) [📄](https://gist.github.com/mlabonne/e3feb4747e41e17060862ae2d542786c) | 57.72 | 45.64 | 77.48 | 75.03 | 50.03 |
| [mlabonne/NeuralOmniBeagle-7B](https://huggingface.co/mlabonne/NeuralOmniBeagle-7B) [📄](https://gist.github.com/mlabonne/0e49d591787185fa5ae92ca5d9d4a1fd) | 57.71 | 45.85 | 77.26 | 76.06 | 50.03 |
| [mlabonne/NeuralOmni-7B](https://huggingface.co/mlabonne/NeuralOmni-7B) [📄](https://gist.github.com/mlabonne/4b5ecee86d0fd3714ba0cbd6918c889e) | 57.7 | 45.8 | 77.5 | 74.51 | 49.8 |
| [mlabonne/OmniTruthyBeagle-7B](https://huggingface.co/mlabonne/OmniTruthyBeagle-7B) [📄](https://gist.github.com/mlabonne/b8de6b025796f1dc23c18fe0b1ac4f80) | 57.69 | 45.65 | 77.22 | 75.77 | 50.21 |
| [mlabonne/Omnarch-7B](https://huggingface.co/mlabonne/Omnarch-7B) [📄](https://gist.github.com/mlabonne/e8c99f1d522d40aebb99766cdbd272a9) | 57.64 | 45.88 | 77.28 | 74.07 | 49.76 |
| [mlabonne/BeagleB-7B](https://huggingface.co/mlabonne/BeagleB-7B) [📄](https://gist.github.com/mlabonne/f0d88ec4cc2b13fc46c31975232a6ecf) | 57.61 | 45.19 | 77.75 | 73.19 | 49.88 |
| [mlabonne/Monarch-7B](https://huggingface.co/mlabonne/Monarch-7B) [📄](https://gist.github.com/mlabonne/0b8d057c5ece41e0290580a108c7a093) | 57.56 | 45.48 | 77.07 | 78.04 | 50.14 |
| [mlabonne/Beyonder-4x7B-v3](https://huggingface.co/mlabonne/Beyonder-4x7B-v3) [📄](https://gist.github.com/mlabonne/3740020807e559f7057c32e85ce42d92) | 57.55 | 45.85 | 76.67 | 74.98 | 50.12 |
| [abideen/AlphaMonarch-daser](https://huggingface.co/abideen/AlphaMonarch-daser) [📄](https://gist.github.com/mlabonne/87216aac2a56e71cbdf94ba982cca279) | 57.55 | 45.48 | 76.95 | 78.46 | 50.21 |
| [mlabonne/AlphaMonarch-7B](https://huggingface.co/mlabonne/AlphaMonarch-7B) [📄](https://gist.github.com/mlabonne/1d33c86824b3a11d2308e36db1ba41c1) | 57.53 | 45.37 | 77.01 | 78.39 | 50.2 |
| [mlabonne/NeuralMonarch-7B](https://huggingface.co/mlabonne/NeuralMonarch-7B) [📄](https://gist.github.com/mlabonne/64050c96c6aa261a8f5b403190c8dee4) | 57.53 | 45.31 | 76.99 | 78.35 | 50.28 |
| [mlabonne/Beagle4](https://huggingface.co/mlabonne/Beagle4) [📄](https://gist.github.com/mlabonne/7b228a841a2e14b61f132a4ce857856b) | 57.53 | 45.5 | 77.38 | 73.84 | 49.7 |
| [shadowml/BeagSake-7B](https://huggingface.co/shadowml/BeagSake-7B) [📄](https://gist.github.com/mlabonne/58fe8e72dce5e1c337569ff84e7ec693) | 57.53 | 45.9 | 77.36 | 72.82 | 49.32 |
| [shadowml/WestBeagle-7B](https://huggingface.co/shadowml/WestBeagle-7B) [📄](https://gist.github.com/mlabonne/33bb0b2fd158455b3a74be6f6ca00da0) | 57.52 | 46.19 | 77.23 | 72.25 | 49.15 |
| [abideen/AlphaMonarch-dora](https://huggingface.co/abideen/AlphaMonarch-dora) [📄](https://gist.github.com/mlabonne/4e5bdae046f8cb5216062229cec55461) | 57.51 | 45.42 | 76.93 | 78.48 | 50.18 |
| [abideen/AlphaMonarch-laser](https://huggingface.co/abideen/AlphaMonarch-laser) [📄](https://gist.github.com/mlabonne/82d1da03d8454496f492e34314770daa) | 57.51 | 45.39 | 77.0 | 78.4 | 50.15 |
| [mlabonne/Monarch-7B-dare](https://huggingface.co/mlabonne/Monarch-7B-dare) [📄](https://gist.github.com/mlabonne/db537b861ee95192ab4c72e5a3010fac) | 57.44 | 45.16 | 77.22 | 77.98 | 49.95 |
| [shadowml/WestBeagle-7B-gen3](https://huggingface.co/shadowml/WestBeagle-7B-gen3) [📄](https://gist.github.com/mlabonne/c063d94a567e553a8bd8fca5f4928a65) | 57.42 | 45.74 | 77.28 | 72.29 | 49.23 |
| [mlabonne/ArchBeagle-7B](https://huggingface.co/mlabonne/ArchBeagle-7B) [📄](https://gist.github.com/mlabonne/f53abec3707c0d8cf604163c366293f3) | 57.41 | 45.56 | 77.32 | 73.36 | 49.36 |
| [shadowml/OmnixBeagle-7B](https://huggingface.co/shadowml/OmnixBeagle-7B) [📄](https://gist.github.com/mlabonne/d7028d0cd294bfc678c8d5b2178c07fb) | 57.38 | 45.3 | 77.64 | 75.24 | 49.2 |
| [shadowml/BeagleSempra-7B](https://huggingface.co/shadowml/BeagleSempra-7B) [📄](https://gist.github.com/mlabonne/0592627d77c52f2ff0112c51265060c3) | 57.38 | 45.56 | 77.44 | 73.35 | 49.15 |
| [mlabonne/Monarch-7B-slerp](https://huggingface.co/mlabonne/Monarch-7B-slerp) [📄](https://gist.github.com/mlabonne/f1fb8cf80819338fdad49ad395626040) | 57.26 | 45.13 | 77.09 | 78.63 | 49.56 |
| [shadowml/FoxBeagle-7B](https://huggingface.co/shadowml/FoxBeagle-7B) [📄](https://gist.github.com/mlabonne/f6fc7fcbaf2a194cf4d334e2ccc45007) | 57.26 | 45.46 | 77.42 | 72.08 | 48.91 |
| [shadowml/BeagleX-7B](https://huggingface.co/shadowml/BeagleX-7B) [📄](https://gist.github.com/mlabonne/f3c863570a587afe7b0f003eab7695d6) | 57.18 | 45.39 | 77.52 | 72.91 | 48.63 |
| [flemmingmiguel/MBX-7B-v3](https://huggingface.co/flemmingmiguel/MBX-7B-v3) [📄](https://gist.github.com/mlabonne/214a32581af289f15d1f2f3e36285967) | 57.14 | 45.08 | 77.72 | 72.61 | 48.63 |
| [mlabonne/Zebrafish-7B](https://huggingface.co/mlabonne/Zebrafish-7B) [📄](https://gist.github.com/mlabonne/719d5e106eefbcffb951b65616dcbec4) | 57.13 | 44.92 | 77.18 | 78.25 | 49.28 |
| [shadowml/Beaglake-7B](https://huggingface.co/shadowml/Beaglake-7B) [📄](https://gist.github.com/mlabonne/d53faa3b28b74a099186b00ee1e65314) | 57.1 | 45.03 | 77.8 | 72.58 | 48.48 |
| [shadowml/TurdusBeagle-7B-gen3](https://huggingface.co/shadowml/TurdusBeagle-7B-gen3) [📄](https://gist.github.com/mlabonne/4cfb0b95602d5076f10c40a6ce3833b4) | 57.1 | 45.08 | 77.52 | 70.36 | 48.69 |
| [shadowml/TurdusBeagle-7B](https://huggingface.co/shadowml/TurdusBeagle-7B) [📄](https://gist.github.com/mlabonne/44c31495c948f857eeb2d1de6068e81c) | 57.1 | 45.08 | 77.52 | 70.36 | 48.69 |
| [shadowml/MBTrix-7B](https://huggingface.co/shadowml/MBTrix-7B) [📄](https://gist.github.com/mlabonne/d4adf67745415068c1956326067badc1) | 57.08 | 44.92 | 77.14 | 77.26 | 49.18 |
| [mlabonne/Zebrafish-slerp-7B](https://huggingface.co/mlabonne/Zebrafish-slerp-7B) [📄](https://gist.github.com/mlabonne/569cec03a3fd254034dd7c091398ccee) | 57.07 | 44.83 | 77.13 | 78.27 | 49.25 |
| [shadowml/Beagwake-7B](https://huggingface.co/shadowml/Beagwake-7B) [📄](https://gist.github.com/mlabonne/23d1b2389b7d5eac6fa0c2981655e259) | 57.04 | 45.03 | 77.54 | 72.37 | 48.56 |
| [shadowml/MBeagleX-7B](https://huggingface.co/shadowml/MBeagleX-7B) [📄](https://gist.github.com/mlabonne/cbe9bd08c94c8e0034634d474ca37f7b) | 57.02 | 45.02 | 76.87 | 78.04 | 49.18 |
| [mlabonne/Zebrafish-linear-7B](https://huggingface.co/mlabonne/Zebrafish-linear-7B) [📄](https://gist.github.com/mlabonne/90b2873a7c8a0002bf1665f71e09de67) | 56.98 | 44.58 | 77.12 | 78.25 | 49.24 |
| [mlabonne/Zebrafish-dare-7B](https://huggingface.co/mlabonne/Zebrafish-dare-7B) [📄](https://gist.github.com/mlabonne/84f165e6c6e355e75df7c54ccc47a3b5) | 56.96 | 44.68 | 77.0 | 78.28 | 49.21 |
| [mlabonne/UltraMerge-7B](https://huggingface.co/mlabonne/UltraMerge-7B) [📄](https://gist.github.com/mlabonne/e7ef034968c58c666493d9236473ceee) | 56.95 | 44.36 | 77.15 | 78.47 | 49.35 |
| [mlabonne/NeuralBeagle14-7B](https://huggingface.co/mlabonne/NeuralBeagle14-7B) [📄](https://gist.github.com/mlabonne/ad0c665bbe581c8420136c3b52b3c15c) | 56.9 | 46.06 | 76.77 | 70.32 | 47.86 |
| [mlabonne/FrankenMonarch-11b](https://huggingface.co/mlabonne/FrankenMonarch-11b) [📄](https://gist.github.com/mlabonne/1c5701a83767214e7bb358d47cc286f1) | 56.89 | 44.01 | 76.45 | 76.7 | 50.22 |
| [yam-peleg/Experiment26-7B](https://huggingface.co/yam-peleg/Experiment26-7B) [📄](https://gist.github.com/mlabonne/d390a342a57665eeab54e1eb9cd5c4cb) | 56.85 | 44.49 | 77.06 | 78.58 | 49.0 |
| [mlabonne/NeuBeagle-7B](https://huggingface.co/mlabonne/NeuBeagle-7B) [📄](https://gist.github.com/mlabonne/f8c474f36381d227457ac4f17cfea024) | 56.81 | 44.43 | 76.62 | 79.13 | 49.38 |
| [bardsai/jaskier-7b-dpo-v3.3](https://huggingface.co/bardsai/jaskier-7b-dpo-v3.3) [📄](https://gist.github.com/mlabonne/4d0bd47ed3d13919abce2db30961d347) | 56.77 | 44.57 | 76.53 | 80.0 | 49.22 |
| [mlabonne/DareBeagle-7B-v2](https://huggingface.co/mlabonne/DareBeagle-7B-v2) [📄](https://gist.github.com/mlabonne/f6604b15a6fc07ba5be3ed634bc9cfc8) | 56.75 | 45.6 | 76.58 | 69.48 | 48.07 |
| [CultriX/NeuralTrix-7B-dpo](https://huggingface.co/CultriX/NeuralTrix-7B-dpo) [📄](https://gist.github.com/mlabonne/fb6a501579ef593809d3209bedb68ef3) | 56.73 | 44.61 | 76.33 | 79.8 | 49.24 |
| [shadowml/DareBeagle-7B](https://huggingface.co/shadowml/DareBeagle-7B) [📄](https://gist.github.com/mlabonne/8624ee889f0a33b8a74a75cefc3c8064) | 56.72 | 45.47 | 76.63 | 69.48 | 48.05 |
| [CultriX/NeuralTrix-bf16](https://huggingface.co/CultriX/NeuralTrix-bf16) [📄](https://gist.github.com/mlabonne/1e7d6f17fbd2fd5ce34079b25edcc06f) | 56.7 | 44.43 | 76.43 | 80.18 | 49.23 |
| [mlabonne/UltraMerge-v2-7B](https://huggingface.co/mlabonne/UltraMerge-v2-7B) [📄](https://gist.github.com/mlabonne/78784cb3e1c338a63b99b0f7cfea913b) | 56.69 | 44.16 | 76.72 | 79.58 | 49.2 |
| [argilla/distilabeled-Marcoro14-7B-slerp](https://huggingface.co/argilla/distilabeled-Marcoro14-7B-slerp) [📄](https://gist.github.com/mlabonne/9082c4e59f4d3f3543c5eda3f4807040) | 56.68 | 45.38 | 76.48 | 65.68 | 48.18 |
| [flemmingmiguel/MBX-7B-v2](https://huggingface.co/flemmingmiguel/MBX-7B-v2) [📄](https://gist.github.com/mlabonne/14b6289a65e1241f63c52cf5998bcacc) | 56.66 | 44.23 | 77.27 | 71.04 | 48.47 |
| [mlabonne/NeuralDaredevil-7B](https://huggingface.co/mlabonne/NeuralDaredevil-7B) [📄](https://gist.github.com/mlabonne/cbeb077d1df71cb81c78f742f19f4155) | 56.65 | 45.23 | 76.2 | 67.61 | 48.52 |
| [shadowml/DareBeagel-2x7B](https://huggingface.co/shadowml/DareBeagel-2x7B) [📄](https://gist.github.com/mlabonne/74a8be317a88b11d5ffa6ee92f5c1851) | 56.63 | 45.51 | 76.56 | 69.45 | 47.82 |
| [mlabonne/FrakenBeagle14-11B](https://huggingface.co/mlabonne/FrakenBeagle14-11B) [📄](https://gist.github.com/mlabonne/0e57f3baecfbe2ed973d866b3be2990c) | 56.58 | 45.08 | 76.08 | 70.93 | 48.58 |
| [occultml/CatMarcoro14-7B-slerp](https://huggingface.co/occultml/CatMarcoro14-7B-slerp) [📄](https://gist.github.com/mlabonne/64891517f7026cfc84107021859b5a5f) | 56.14 | 45.21 | 75.91 | 63.81 | 47.31 |
| [shadowml/mibe-7B](https://huggingface.co/shadowml/mibe-7B) [📄](https://gist.github.com/mlabonne/6cc8c5d88075076125b5d339ad013c2c) | 56.13 | 44.22 | 76.9 | 71.25 | 47.27 |
| [mlabonne/NeuralDarewin-7B](https://huggingface.co/mlabonne/NeuralDarewin-7B) [📄](https://gist.github.com/mlabonne/b09acc668b5e03fc7af19cb01d9fd4af) | 56.08 | 45.6 | 74.29 | 63.15 | 48.35 |
| [mlabonne/Beagle14-7B](https://huggingface.co/mlabonne/Beagle14-7B) [📄](https://gist.github.com/mlabonne/f5a5bf8c0827bbec2f05b97cc62d642c) | 56.05 | 44.38 | 76.53 | 69.44 | 47.25 |
| [shadowml/Daredevil-7B](https://huggingface.co/shadowml/Daredevil-7B) [📄](https://gist.github.com/mlabonne/cd03d60f7428450a87ca270b5c467324) | 56.0 | 44.85 | 76.07 | 64.89 | 47.07 |
| [mlabonne/Darewin-7B](https://huggingface.co/mlabonne/Darewin-7B) [📄](https://gist.github.com/mlabonne/0e6417a6a145c2ad1c36568287a3734e) | 55.96 | 45.08 | 75.36 | 60.94 | 47.44 |
| [mlabonne/NeuralMarcoro14-7B](https://huggingface.co/mlabonne/NeuralMarcoro14-7B) [📄](https://gist.github.com/mlabonne/b31572a4711c945a4827e7242cfc4b9d) | 55.89 | 44.59 | 76.17 | 65.94 | 46.9 |
| [mlabonne/Beyonder-4x7B-v2](https://huggingface.co/mlabonne/Beyonder-4x7B-v2) [📄](https://gist.github.com/mlabonne/f73baa140a510a676242f8a4496d05ca) | 55.88 | 45.29 | 75.95 | 60.86 | 46.4 |
| [OpenPipe/mistral-ft-optimized-1218](https://huggingface.co/OpenPipe/mistral-ft-optimized-1218) [📄](https://gist.github.com/mlabonne/36c412889c4acfad7061f269a31f9055) | 55.84 | 44.74 | 75.6 | 59.89 | 47.17 |
| [SanjiWatsuki/Kunoichi-DPO-v2-7B](https://huggingface.co/SanjiWatsuki/Kunoichi-DPO-v2-7B) [📄](https://gist.github.com/mlabonne/895ff5171e998abfdf2a41a4f9c84450) | 55.83 | 44.79 | 75.05 | 65.68 | 47.65 |
| [mlabonne/FrankenMonarch-7B](https://huggingface.co/mlabonne/FrankenMonarch-7B) [📄](https://gist.github.com/mlabonne/c4df101fd10b6389cbc33bede2bd92bf) | 55.81 | 45.1 | 75.53 | 73.86 | 46.79 |
| [mlabonne/Marcoro14-7B-slerp](https://huggingface.co/mlabonne/Marcoro14-7B-slerp) [📄](https://gist.github.com/mlabonne/e2fac9c2ad659500da0f8447482a4b03) | 55.51 | 44.66 | 76.24 | 64.15 | 45.64 |
| [Weyaxi/OpenHermes-2.5-neural-chat-v3-3-Slerp](https://huggingface.co/Weyaxi/OpenHermes-2.5-neural-chat-v3-3-Slerp) [📄](https://gist.github.com/mlabonne/3496feedcb6dffac3799f1a019e609bf) | 55.29 | 43.5 | 74.88 | 63.22 | 47.5 |
| [fblgit/una-cybertron-7b-v2-bf16](https://huggingface.co/fblgit/una-cybertron-7b-v2-bf16) [📄](https://gist.github.com/mlabonne/a6d34d316b24902d4ee769eaacccbb12) | 55.24 | 43.29 | 74.98 | 65.32 | 47.45 |
| [mlabonne/Daredevil-8B](https://huggingface.co/mlabonne/Daredevil-8B) [📄](https://gist.github.com/mlabonne/080f9c5f153ea57a7ab7d932cf896f21) | 54.81 | 44.13 | 73.52 | 59.05 | 46.77 |
| [openchat/openchat-3.6-8b-20240522](https://huggingface.co/openchat/openchat-3.6-8b-20240522) [📄](https://gist.github.com/mlabonne/95eef8e8d26b7b17910dcb78e1c95f4a) | 54.73 | 44.03 | 73.67 | 49.78 | 46.48 |
| [mlabonne/NeuralDaredevil-8B-abliterated](https://huggingface.co/mlabonne/NeuralDaredevil-8B-abliterated) [📄](https://gist.github.com/mlabonne/ae0bf16936cef900b72964b33c99edbc) | 54.71 | 43.73 | 73.6 | 59.36 | 46.8 |
| [mlabonne/Daredevil-8B-abliterated](https://huggingface.co/mlabonne/Daredevil-8B-abliterated) [📄](https://gist.github.com/mlabonne/32cdd8460804662c856bcb2a20acd49e) | 54.26 | 43.29 | 73.33 | 57.47 | 46.17 |
| [Nexusflow/Starling-LM-7B-beta](https://huggingface.co/Nexusflow/Starling-LM-7B-beta) [📄](https://gist.github.com/mlabonne/475c3e04d7034a18fd45bb5ee1cc9664) | 54.17 | 44.21 | 73.7 | 56.45 | 44.6 |
| [openchat/openchat-3.5-0106](https://huggingface.co/openchat/openchat-3.5-0106) [📄](https://gist.github.com/mlabonne/1afab87b543b0717ec08722cf086dcc3) | 54.1 | 44.17 | 73.72 | 52.53 | 44.4 |
| [NousResearch/Hermes-2-Theta-Llama-3-8B](https://huggingface.co/NousResearch/Hermes-2-Theta-Llama-3-8B) [📄](https://gist.github.com/mlabonne/5df2a3051dd6eb3368a77b684635dc05) | 53.58 | 43.9 | 72.62 | 56.36 | 44.23 |
| [openchat/openchat-3.5-1210](https://huggingface.co/openchat/openchat-3.5-1210) [📄](https://gist.github.com/mlabonne/130361e61e65dcfb981288c695cbbfc7) | 53.11 | 42.62 | 72.84 | 53.21 | 43.88 |
| [mlabonne/NeuralHermes-2.5-Mistral-7B-laser](https://huggingface.co/mlabonne/NeuralHermes-2.5-Mistral-7B-laser) [📄](https://gist.github.com/mlabonne/c44fb6ace576407abd782ca836a7ffae) | 53.07 | 43.54 | 73.44 | 55.26 | 42.24 |
| [NousResearch/Hermes-2-Pro-Llama-3-8B](https://huggingface.co/NousResearch/Hermes-2-Pro-Llama-3-8B) [📄](https://gist.github.com/mlabonne/d3c42ee53c8853e634d105f2190c9d7f) | 52.9 | 42.52 | 72.64 | 57.8 | 43.53 |
| [mlabonne/NeuralHermes-2.5-Mistral-7B](https://huggingface.co/mlabonne/NeuralHermes-2.5-Mistral-7B) [📄](https://gist.github.com/mlabonne/14687f1eb3425b166db511f31f8e66f6) | 52.89 | 43.67 | 73.24 | 55.37 | 41.76 |
| [microsoft/Phi-3-mini-4k-instruct](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct) [📄](https://gist.github.com/mlabonne/2f8c2dd887dd06b1b229b974b88c124b) | 52.74 | 44.44 | 71.88 | 57.77 | 41.9 |
| [openchat/openchat_3.5](https://huggingface.co/openchat/openchat_3.5) [📄](https://gist.github.com/mlabonne/56d28ebd0f8c0de0a4e81bd8659c7cfa) | 52.7 | 42.67 | 72.92 | 47.27 | 42.51 |
| [NousResearch/Hermes-2-Pro-Mistral-7B](https://huggingface.co/NousResearch/Hermes-2-Pro-Mistral-7B) [📄](https://gist.github.com/mlabonne/0764acc369300da73bc7f5d248720f03) | 52.55 | 44.54 | 71.2 | 59.12 | 41.9 |
| [mlabonne/ChimeraLlama-3-8B-v3](https://huggingface.co/mlabonne/ChimeraLlama-3-8B-v3) [📄](https://gist.github.com/mlabonne/895f5a0574bb2eff94f54bb586bfcbb9) | 52.49 | 42.11 | 71.48 | 55.03 | 43.87 |
| [berkeley-nest/Starling-LM-7B-alpha](https://huggingface.co/berkeley-nest/Starling-LM-7B-alpha) [📄](https://gist.github.com/mlabonne/c31cc46169ef3004c0df250017d5cac9) | 52.44 | 42.06 | 72.72 | 47.33 | 42.53 |
| [FuseAI/FuseChat-7B-VaRM](https://huggingface.co/FuseAI/FuseChat-7B-VaRM) [📄](https://gist.github.com/mlabonne/a8290164a67379c33374baa9e8f37f08) | 52.3 | 41.91 | 72.02 | 46.76 | 42.96 |
| [teknium/OpenHermes-2.5-Mistral-7B](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B) [📄](https://gist.github.com/mlabonne/88b21dd9698ffed75d6163ebdc2f6cc8) | 52.23 | 42.75 | 72.99 | 52.99 | 40.94 |
| [FuseAI/OpenChat-3.5-7B-Mixtral](https://huggingface.co/FuseAI/OpenChat-3.5-7B-Mixtral) [📄](https://gist.github.com/mlabonne/5015aabf06818f9176ba2ec358b33017) | 52.22 | 41.97 | 71.95 | 46.81 | 42.73 |
| [FuseAI/OpenChat-3.5-7B-Solar](https://huggingface.co/FuseAI/OpenChat-3.5-7B-Solar) [📄](https://gist.github.com/mlabonne/3ed0014d2e50657730f4f2c8dd109413) | 52.2 | 41.61 | 71.99 | 46.7 | 43.01 |
| [FuseAI/FuseChat-7B-Slerp](https://huggingface.co/FuseAI/FuseChat-7B-Slerp) [📄](https://gist.github.com/mlabonne/10c4ff53250fc44667b474c89c3e054c) | 52.16 | 41.73 | 72.03 | 46.72 | 42.71 |
| [mlabonne/ChimeraLlama-3-8B-v2](https://huggingface.co/mlabonne/ChimeraLlama-3-8B-v2) [📄](https://gist.github.com/mlabonne/8b33a2aac443864e58a7f5ba28d2ea9f) | 52.13 | 41.01 | 71.11 | 55.48 | 44.26 |
| [mlabonne/NeuralLlama-3-8B-Instruct-abliterated](https://huggingface.co/mlabonne/NeuralLlama-3-8B-Instruct-abliterated) [📄](https://gist.github.com/mlabonne/d711548df70e2c04771cc68ab33fe2b9) | 51.6 | 41.6 | 69.95 | 54.22 | 43.26 |
| [cognitivecomputations/dolphin-2.6-mistral-7b-dpo-laser](https://huggingface.co/cognitivecomputations/dolphin-2.6-mistral-7b-dpo-laser) [📄](https://gist.github.com/mlabonne/72edd6413291be6d7c22a1cd689d78d4) | 51.56 | 38.32 | 73.77 | 61.03 | 42.58 |
| [mlabonne/ChimeraLlama-3-8B](https://huggingface.co/mlabonne/ChimeraLlama-3-8B) [📄](https://gist.github.com/mlabonne/28d31153628dccf781b74f8071c7c7e4) | 51.3 | 39.12 | 71.81 | 52.4 | 42.98 |
| [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) [📄](https://gist.github.com/mlabonne/8329284d86035e6019edb11eb0933628) | 51.24 | 41.22 | 69.86 | 51.65 | 42.64 |
| [Open-Orca/Mistral-7B-OpenOrca](https://huggingface.co/Open-Orca/Mistral-7B-OpenOrca) [📄](https://gist.github.com/mlabonne/731e3e55f3cc482dd51efab0bb7cc96e) | 51.09 | 39.24 | 72.39 | 52.27 | 41.65 |
| [beowolx/CodeNinja-1.0-OpenChat-7B](https://huggingface.co/beowolx/CodeNinja-1.0-OpenChat-7B) [📄](https://gist.github.com/mlabonne/08b5280c221fbd7f98eb27561ae902a3) | 50.89 | 39.98 | 71.77 | 48.73 | 40.92 |
| [failspy/Meta-Llama-3-8B-Instruct-abliterated-v3](https://huggingface.co/failspy/Meta-Llama-3-8B-Instruct-abliterated-v3) [📄](https://gist.github.com/mlabonne/f46cce0262443365e4cce2b6fa7507fc) | 50.81 | 40.23 | 69.5 | 52.44 | 42.69 |
| [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) [📄](https://gist.github.com/mlabonne/05d358e17dffdf9eee7c2322380c9da6) | 50.81 | 38.5 | 71.64 | 66.82 | 42.29 |
| [cognitivecomputations/dolphin-2.9-llama3-8b](https://huggingface.co/cognitivecomputations/dolphin-2.9-llama3-8b) [📄](https://gist.github.com/mlabonne/44b9fd969972392b797683ebaaec437a) | 50.8 | 39.59 | 69.96 | 55.66 | 42.84 |
| [mlabonne/Darewin-7B-v2](https://huggingface.co/mlabonne/Darewin-7B-v2) [📄](https://gist.github.com/mlabonne/8acffabb84410c26f60538e24d519008) | 50.61 | 37.67 | 73.16 | 49.5 | 41.01 |
| [cognitivecomputations/dolphin-2.8-mistral-7b-v02](https://huggingface.co/cognitivecomputations/dolphin-2.8-mistral-7b-v02) [📄](https://gist.github.com/mlabonne/18db0cc177da4d6692b312419156028d) | 50.54 | 38.99 | 72.22 | 51.96 | 40.41 |
| [mlabonne/Llama-3-DARE-8B](https://huggingface.co/mlabonne/Llama-3-DARE-8B) [📄](https://gist.github.com/mlabonne/8c0d730e33e2c62f856f58dbe497a165) | 50.42 | 38.2 | 71.38 | 50.15 | 41.69 |
| [HuggingFaceH4/zephyr-7b-alpha](https://huggingface.co/HuggingFaceH4/zephyr-7b-alpha) [📄](https://gist.github.com/mlabonne/22ee2f0b6f4dc8b129f98d88bdb73741) | 50.27 | 38.0 | 72.24 | 56.06 | 40.57 |
| [mlabonne/zephusion-2x7b](https://huggingface.co/mlabonne/zephusion-2x7b) [📄](https://gist.github.com/mlabonne/790d37851976ff2fb60968ef8a218bd5) | 50.22 | 37.82 | 72.14 | 55.96 | 40.71 |
| [dreamgen/opus-v1.2-llama-3-8b](https://huggingface.co/dreamgen/opus-v1.2-llama-3-8b) [📄](https://gist.github.com/mlabonne/aae3b2c1309b22abcb3a253465a1a329) | 50.2 | 37.9 | 70.55 | 50.45 | 42.16 |
| [Weyaxi/Einstein-v6.1-Llama3-8B](https://huggingface.co/Weyaxi/Einstein-v6.1-Llama3-8B) [📄](https://gist.github.com/mlabonne/73770c428e28efa0ba6b348bbd9e7f93) | 50.17 | 36.33 | 73.08 | 55.07 | 41.11 |
| [cognitivecomputations/dolphin-2.2.1-mistral-7b](https://huggingface.co/cognitivecomputations/dolphin-2.2.1-mistral-7b) [📄](https://gist.github.com/mlabonne/3334da3ce7784293ef7f16ad94bdeb7b) | 50.03 | 38.64 | 72.24 | 54.09 | 39.22 |
| [mlabonne/Meta-Llama-3-12B-Instruct](https://huggingface.co/mlabonne/Meta-Llama-3-12B-Instruct) [📄](https://gist.github.com/mlabonne/46503ab0738eb87b70044b460629902f) | 50.0 | 41.7 | 67.71 | 52.75 | 40.58 |
| [mlabonne/Llama-3-SLERP-8B](https://huggingface.co/mlabonne/Llama-3-SLERP-8B) [📄](https://gist.github.com/mlabonne/651e07cbffafcdba89fa240c4864d7bd) | 49.91 | 36.82 | 72.03 | 49.52 | 40.88 |
| [HuggingFaceH4/zephyr-7b-beta](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta) [📄](https://gist.github.com/mlabonne/dd8780036f6b55c9fa4c3d49db002bbc) | 49.62 | 37.33 | 71.83 | 55.1 | 39.7 |
| [abacusai/Llama-3-Smaug-8B](https://huggingface.co/abacusai/Llama-3-Smaug-8B) [📄](https://gist.github.com/mlabonne/91369d9c372f80b6a42a978b454d3b5e) | 48.98 | 37.15 | 69.12 | 51.66 | 40.67 |
| [mlabonne/Llama-3-linear-8B](https://huggingface.co/mlabonne/Llama-3-linear-8B) [📄](https://gist.github.com/mlabonne/03faebc8c4f3d854b38428bd82ec8971) | 48.41 | 39.89 | 70.88 | 43.01 | 34.46 |
| [asharsha30/LLAMA_Harsha_8_B_ORDP_10k](https://huggingface.co/asharsha30/LLAMA_Harsha_8_B_ORDP_10k) [📄](https://gist.github.com/mlabonne/da222a4a4781a89ccba690ecd9f7fade) | 48.22 | 35.54 | 71.15 | 55.39 | 37.96 |
| [AetherResearch/Cerebrum-1.0-7b](https://huggingface.co/AetherResearch/Cerebrum-1.0-7b) [📄](https://gist.github.com/mlabonne/9d98b166c1a26eb964337707543bd7da) | 48.2 | 35.25 | 71.93 | 46.99 | 37.43 |
| [Weyaxi/Einstein-v4-7B](https://huggingface.co/Weyaxi/Einstein-v4-7B) [📄](https://gist.github.com/mlabonne/a74da7cef8480100d1f62bc312698c1b) | 48.04 | 37.83 | 67.52 | 55.56 | 38.78 |
| [shadowml/phixtral-4x2_8odd](https://huggingface.co/shadowml/phixtral-4x2_8odd) [📄](https://gist.github.com/mlabonne/97e28c3bf256fef1bdf5173362c2d701) | 48.03 | 34.46 | 72.34 | 49.56 | 37.3 |
| [Venkman42/Phiter](https://huggingface.co/Venkman42/Phiter) [📄](https://gist.github.com/mlabonne/739cfa4c35d35a0fe9806ce228d39ff3) | 48.01 | 34.62 | 71.23 | 48.93 | 38.18 |
| [mlabonne/Llama-3-12B-Instruct](https://huggingface.co/mlabonne/Llama-3-12B-Instruct) [📄](https://gist.github.com/mlabonne/88ca3054713a720519d63c2a0673a7ec) | 48.0 | 36.04 | 67.53 | 51.36 | 40.44 |
| [Venkman42/PhiPhiter](https://huggingface.co/Venkman42/PhiPhiter) [📄](https://gist.github.com/mlabonne/155b27de276195949d5517d02a880d63) | 47.93 | 34.65 | 71.14 | 48.54 | 37.99 |
| [rhysjones/phi-2-orange-v2](https://huggingface.co/rhysjones/phi-2-orange-v2) [📄](https://gist.github.com/mlabonne/70dc278b76bdadffef9efcb7a096b0a3) | 47.89 | 34.55 | 70.96 | 54.87 | 38.17 |
| [Venkman42/ReversePhiter](https://huggingface.co/Venkman42/ReversePhiter) [📄](https://gist.github.com/mlabonne/91f68dafff9a89a62a02daec767d2383) | 47.87 | 35.0 | 70.64 | 48.31 | 37.97 |
| [shadowml/phixtral-4x2_8odo](https://huggingface.co/shadowml/phixtral-4x2_8odo) [📄](https://gist.github.com/mlabonne/e2147bd99a4f10a1033b50506e8afd23) | 47.87 | 33.74 | 71.93 | 48.68 | 37.95 |
| [mlabonne/phixtral-3x2_8](https://huggingface.co/mlabonne/phixtral-3x2_8) [📄](https://gist.github.com/mlabonne/801ddad0b53e468561bbdb852bcc1dcb) | 47.78 | 33.58 | 72.1 | 49.59 | 37.67 |
| [Muhammad2003/OrpoLlama3-8B](https://huggingface.co/Muhammad2003/OrpoLlama3-8B) [📄](https://gist.github.com/mlabonne/8dc0a5c398f14711701f51c538a4de5c) | 47.59 | 34.26 | 70.91 | 55.4 | 37.59 |
| [Lumpen1/Orpo-Mad-Max-Mistral-7B-v0.3](https://huggingface.co/Lumpen1/Orpo-Mad-Max-Mistral-7B-v0.3) [📄](https://gist.github.com/mlabonne/c12d3225ed3ca351012e218ec49c3095) | 47.58 | 35.4 | 71.26 | 50.74 | 36.07 |
| [microsoft/WizardLM-2-7B](https://huggingface.co/microsoft/WizardLM-2-7B) [📄](https://gist.github.com/mlabonne/0e96c31edb47c8e8555bbb5a02e474a3) | 47.52 | 35.76 | 68.56 | 56.46 | 38.24 |
| [mlabonne/phixtral-2x2_8](https://huggingface.co/mlabonne/phixtral-2x2_8) [📄](https://gist.github.com/mlabonne/33e500df0f017540d1b6de342c0e7c76) | 47.45 | 34.1 | 70.44 | 48.78 | 37.82 |
| [mlabonne/OrpoLlama-3-8B](https://huggingface.co/mlabonne/OrpoLlama-3-8B) [📄](https://gist.github.com/mlabonne/22896a1ae164859931cc8f4858c97f6f) | 47.37 | 34.17 | 70.59 | 52.39 | 37.36 |
| [mlabonne/phixtral-4x2_8](https://huggingface.co/mlabonne/phixtral-4x2_8) [📄](https://gist.github.com/mlabonne/edd3ea05e0cf541bc05c0fc8baa2d392) | 47.34 | 33.91 | 70.44 | 48.78 | 37.68 |
| [rhysjones/phi-2-orange](https://huggingface.co/rhysjones/phi-2-orange) [📄](https://gist.github.com/mlabonne/adae32f42fa6bace057f92c9d52ad62b) | 47.33 | 33.37 | 71.33 | 49.87 | 37.3 |
| [meta-math/MetaMath-Mistral-7B](https://huggingface.co/meta-math/MetaMath-Mistral-7B) [📄](https://gist.github.com/mlabonne/3ec72f4804c08cb7c681c7a3b1f09c1b) | 47.25 | 33.91 | 70.12 | 44.83 | 37.71 |
| [cognitivecomputations/dolphin-phi-2-kensho](https://huggingface.co/cognitivecomputations/dolphin-phi-2-kensho) [📄](https://gist.github.com/mlabonne/548580d9ae99203e715ed7f0d27da19d) | 47.14 | 34.05 | 69.25 | 50.2 | 38.11 |
| [Locutusque/Llama-3-Orca-1.0-8B](https://huggingface.co/Locutusque/Llama-3-Orca-1.0-8B) [📄](https://gist.github.com/mlabonne/5a043c3575916c6a30f1bd27a5313ba2) | 47.13 | 34.37 | 69.34 | 49.95 | 37.69 |
| [mlabonne/Mistralpaca-7B](https://huggingface.co/mlabonne/Mistralpaca-7B) [📄](https://gist.github.com/mlabonne/dbe774857fc977b44d39c35cbfd6945a) | 47.08 | 33.48 | 70.71 | 52.89 | 37.06 |
| [mistralai/Mistral-7B-Instruct-v0.1](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1) [📄](https://gist.github.com/mlabonne/7a0446c3d30dfce72834ef780491c4b2) | 46.9 | 33.36 | 67.87 | 55.89 | 39.48 |
| [meetkai/functionary-small-v2.2](https://huggingface.co/meetkai/functionary-small-v2.2) [📄](https://gist.github.com/mlabonne/59e885173061ec5d94aeb00c539bf903) | 46.82 | 33.15 | 70.35 | 51.5 | 36.97 |
| [abacaj/phi-2-super](https://huggingface.co/abacaj/phi-2-super) [📄](https://gist.github.com/mlabonne/703dd671089f529fb767202ebc90fafe) | 46.75 | 31.95 | 70.81 | 48.39 | 37.49 |
| [cognitivecomputations/dolphin-2_6-phi-2](https://huggingface.co/cognitivecomputations/dolphin-2_6-phi-2) [📄](https://gist.github.com/mlabonne/5e52b7deb6d18f9f53082ae4a10bb9d9) | 46.72 | 33.12 | 69.85 | 47.39 | 37.2 |
| [marcel/phixtral-4x2_8-gates-poc](https://huggingface.co/marcel/phixtral-4x2_8-gates-poc) [📄](https://gist.github.com/mlabonne/5266df71633f982dd7fe3a085e9c8829) | 46.34 | 31.78 | 70.22 | 47.01 | 37.02 |
| [macadeliccc/Mistral-7B-v0.2-OpenHermes](https://huggingface.co/macadeliccc/Mistral-7B-v0.2-OpenHermes) [📄](https://gist.github.com/mlabonne/1f67f93b7fc4c4a5d24550e021d30820) | 46.33 | 35.57 | 67.15 | 42.06 | 36.27 |
| [Lumpen1/MadWizardOrpoMistral-7b-v0.3](https://huggingface.co/Lumpen1/MadWizardOrpoMistral-7b-v0.3) [📄](https://gist.github.com/mlabonne/746b9beccf4a44488377668eed07aca0) | 46.18 | 32.47 | 71.75 | 47.45 | 34.33 |
| [meta-llama/Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B) [📄](https://gist.github.com/mlabonne/616b6245137a9cfc4ea80e4c6e55d847) | 45.92 | 31.1 | 69.95 | 43.91 | 36.7 |
| [g-ronimo/phi-2-OpenHermes-2.5](https://huggingface.co/g-ronimo/phi-2-OpenHermes-2.5) [📄](https://gist.github.com/mlabonne/2fe7474af3667c658df755b348b408f7) | 45.78 | 30.27 | 71.18 | 43.87 | 35.9 |
| [Yhyu13/phi-2-sft-dpo-gpt4_en-ep1](https://huggingface.co/Yhyu13/phi-2-sft-dpo-gpt4_en-ep1) [📄](https://gist.github.com/mlabonne/7151ee5c60c301469562201d5eda0c1e) | 45.66 | 30.61 | 71.13 | 48.74 | 35.23 |
| [lxuechen/phi-2-dpo](https://huggingface.co/lxuechen/phi-2-dpo) [📄](https://gist.github.com/mlabonne/14a90ec8d0d865ae209eef420f46105e) | 45.66 | 30.39 | 71.68 | 50.75 | 34.9 |
| [deepseek-ai/deepseek-moe-16b-chat](https://huggingface.co/deepseek-ai/deepseek-moe-16b-chat) [📄](https://gist.github.com/mlabonne/3045faf78e0261be3417642f9c88acc0) | 44.72 | 30.42 | 68.72 | 48.73 | 35.02 |
| [microsoft/phi-2](https://huggingface.co/microsoft/phi-2) [📄](https://gist.github.com/mlabonne/99735641e5ed5a86907e617a2cc86b0c) | 44.66 | 27.98 | 70.8 | 44.43 | 35.21 |
| [mlabonne/Meta-Llama-3-12B](https://huggingface.co/mlabonne/Meta-Llama-3-12B) [📄](https://gist.github.com/mlabonne/42cc0aa21418b2c04606bdec24174e31) | 44.35 | 29.46 | 68.01 | 41.02 | 35.57 |
| [stabilityai/stablelm-zephyr-3b](https://huggingface.co/stabilityai/stablelm-zephyr-3b) [📄](https://gist.github.com/mlabonne/4f87a66c55f454c44c8d3311c356d6b6) | 43.74 | 34.04 | 62.07 | 46.46 | 35.11 |
| [mlabonne/Llama-3-12B](https://huggingface.co/mlabonne/Llama-3-12B) [📄](https://gist.github.com/mlabonne/0fbe20066d8bb7d51ed0c2a063c79b54) | 43.73 | 28.11 | 68.75 | 43.02 | 34.34 |
| [venkycs/phi-2-instruct](https://huggingface.co/venkycs/phi-2-instruct) [📄](https://gist.github.com/mlabonne/9446c95d3681a3aa7e644a876b0e2af9) | 43.54 | 25.8 | 67.93 | 44.82 | 36.88 |
| [Qwen/CodeQwen1.5-7B-Chat](https://huggingface.co/Qwen/CodeQwen1.5-7B-Chat) [📄](https://gist.github.com/mlabonne/6457a3b452a28a421f297524b568a246) | 38.28 | 27.42 | 53.72 | 44.71 | 33.71 |
| [Qwen/CodeQwen1.5-7B](https://huggingface.co/Qwen/CodeQwen1.5-7B) [📄](https://gist.github.com/mlabonne/7a8c3a2c16fd967dd1d825e875e6c918) | 37.72 | 24.84 | 54.76 | 42.36 | 33.55 |
| [mlabonne/Gemmalpaca-2B](https://huggingface.co/mlabonne/Gemmalpaca-2B) [📄](https://gist.github.com/mlabonne/4b638752fc3227df566f9562064cb864) | 35.52 | 24.48 | 51.22 | 47.02 | 30.85 |
| [google/gemma-2b](https://huggingface.co/google/gemma-2b) [📄](https://gist.github.com/mlabonne/7df1f238c515a5f63a750c8792cef59e) | 32.36 | 22.7 | 43.35 | 39.96 | 31.03 |
| [google/gemma-2b-it](https://huggingface.co/google/gemma-2b-it) [📄](https://gist.github.com/mlabonne/db0761e74175573292acf497da9e5d95) | 32.26 | 23.76 | 43.6 | 47.64 | 29.41 |
| [mlabonne/OrcaGemma-2B](https://huggingface.co/mlabonne/OrcaGemma-2B) [📄](https://gist.github.com/mlabonne/c8c0914945f9c189cca74120bc834c3e) | 32.23 | 24.44 | 42.49 | 45.84 | 29.76 |
| [mlabonne/OrcaGemma-2B-v2](https://huggingface.co/mlabonne/OrcaGemma-2B-v2) [📄](https://gist.github.com/mlabonne/fa8b9b8041bd308884d7f761af269493) | 31.79 | 24.22 | 42.24 | 44.51 | 28.9 |
| [mlabonne/Gemmalpaca-7B](https://huggingface.co/mlabonne/Gemmalpaca-7B) [📄](https://gist.github.com/mlabonne/8852e0dfb67790dc44169fd1383f5496) | 31.0 | 21.68 | 40.93 | 44.76 | 30.38 |
| [google/gemma-7b-it](https://huggingface.co/google/gemma-7b-it) [📄](https://gist.github.com/mlabonne/0fb752dc3c5b578fff87a73c56a16d7a) | 30.81 | 21.33 | 40.84 | 41.7 | 30.25 |
| [VAGOsolutions/SauerkrautLM-Gemma-7b](https://huggingface.co/VAGOsolutions/SauerkrautLM-Gemma-7b) [📄](https://gist.github.com/mlabonne/841ba9fd7ad50143af14b9b7b456b028) | 29.64 | 20.75 | 39.29 | 46.2 | 28.88 |
| [alpindale/gemma-7b](https://huggingface.co/alpindale/gemma-7b) [📄](https://gist.github.com/mlabonne/b78848140a81104f2e607169be467f73) | 29.24 | 20.67 | 38.48 | 46.66 | 28.58 |
| [google/gemma-7b](https://huggingface.co/google/gemma-7b) [📄](https://gist.github.com/mlabonne/5f9855d341c3b11f775348ecb4fd8cf1) | 29.21 | 20.64 | 38.49 | 46.61 | 28.51 |