GMeshNet OSS 8B GGUF EU AI Act Compliance Profile

GMeshNet-OSS-8B

GMeshNet-OSS-8B is an open-source, dense, decoder-only 8B parameter large language model optimized for chain-of-thought reasoning, designed to produce structured analyses and generate robust Gmsh meshing scripts.

Quickstart

Install Dependencies

Run Inference

from llama_cpp import Llama

# Input your prompt here
USER_INPUT = """
Generate a GMSH script to create a 2D rectangular mesh with a circular hole at the center, applying finer mesh refinement near the hole and coarser mesh at the boundaries.
"""

def load_model(model_path):
    llm = Llama(
        model_path=model_path,
        n_ctx=10000,  
        n_gpu_layers=27, 
        verbose=False
    )
    return llm

def generate_response(llm, user_input):
    
    formatted_input = f"<gmsh_instruction>{user_input.strip()}</gmsh_instruction>"
    
    messages = [{"role": "user", "content": formatted_input}]
    
    response = llm.create_chat_completion(
        messages=messages,
        max_tokens=2000,
        temperature=0.7,
        stream=False
    )
    
    return response['choices'][0]['message']['content']

def run_inference():
    model_path = "./" # Path to your model weights
    
    llm = load_model(model_path)
    result = generate_response(llm, USER_INPUT)
    
    print(result)

if __name__ == "__main__":
    run_inference()

Example Output

Your obligations as a GMeshNet OSS 8B GGUF deployer

Track your progress

Sign up to track obligations, receive deadline reminders, and generate audit packages.

Tags

Languages