Meta-Llama-3-8B-Instruct-GGUF EU AI Act Compliance Profile

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

• Model creator: meta-llama
• Original model: meta-llama/Meta-Llama-3-8B-Instruct

The GGUF and quantized models here are based on meta-llama/Meta-Llama-3-8B-Instruct model

How to download

You can download only the quants you need instead of cloning the entire repository as follows:

Load GGUF models

You MUST follow the prompt template provided by Llama-3:

./llama.cpp/main -m Meta-Llama-3-8B-Instruct.Q2_K.gguf -r '<|eot_id|>' --in-prefix "\n<|start_header_id|>user<|end_header_id|>\n\n" --in-suffix "<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n" -p "<|begin_of_text|><|start_header_id|>system<|end_header_id|>\n\nYou are a helpful, smart, kind, and efficient AI assistant. You always fulfill the user's requests to the best of your ability.<|eot_id|>\n<|start_header_id|>user<|end_header_id|>\n\nHi! How are you?<|eot_id|>\n<|start_header_id|>assistant<|end_header_id|>\n\n" -n 1024

Original README

Model Details

Meta developed and released the Meta Llama 3 family of large language models (LLMs), a collection of pretrained and instruction tuned generative text models in 8 and 70B sizes. The Llama 3 instruction tuned models are optimized for dialogue use cases and outperform many of the available open source chat models on common industry benchmarks. Further, in developing these models, we took great care to optimize helpfulness and safety.

Model developers Meta

Variations Llama 3 comes in two sizes — 8B and 70B parameters — in pre-trained and instruction tuned variants.

Input Models input text only.

Output Models generat

Your obligations as a Meta-Llama-3-8B-Instruct-GGUF deployer

Track your progress

Sign up to track obligations, receive deadline reminders, and generate audit packages.

Tags

Languages

Library

Base Model