Hermes 3 Llama 3.1 8B GGUF EU AI Act Compliance Profile

Hermes 3 - Llama-3.1 8B

Model Description

Hermes 3 is the latest version of our flagship Hermes series of LLMs by Nous Research.

For more details on new capabilities, training results, and more, see the Hermes 3 Technical Report.

This is the GGUF quantized version of Hermes 8B, for use with llama.cpp. For the Full HF BF16 Model, click here

Hermes 3 is a generalist language model with many improvements over Hermes 2, including advanced agentic capabilities, much better roleplaying, reasoning, multi-turn conversation, long context coherence, and improvements across the board.

The ethos of the Hermes series of models is focused on aligning LLMs to the user, with powerful steering capabilities and control given to the end user.

The Hermes 3 series builds and expands on the Hermes 2 set of capabilities, including more powerful and reliable function calling and structured output capabilities, generalist assistant capabilities, and improved code generation skills.

Benchmarks

Hermes 3 is competitive, if not superior, to Llama-3.1 Instruct models at general capabilities, with varying strengths and weaknesses attributable between the two.

Full benchmark comparisons below:

Prompt Format

Hermes 3 uses ChatML as the prompt format, opening up a much more structured system for engaging the LLM in multi-turn chat dialogue.

System prompts allow steerability and interesting new ways to interact with an LLM, guiding rules, roles, and stylistic choices of the model.

This is a more complex format than alpaca or sharegpt, where special tokens were added to denote the beginning and

Your obligations as a Hermes 3 Llama 3.1 8B GGUF deployer

Track your progress

Sign up to track obligations, receive deadline reminders, and generate audit packages.

Tags

Languages

Base Model