Hugging Face's logo

mlabonne
/
AlphaMonarch-7B

Text Generation
Transformers
Safetensors
English
mistral
Merge
lazymergekit
dpo
rlhf
conversational
Eval Results (legacy)
text-generation-inference
Model card Files
xet
 Community
7

Low quality responses compared to NeuralBeagle14 on KCPP using q8

#4
by deleted - opened
Discussion
deleted

I don't know how to make this model work as it should, for me it's far from being as good as neuralbeagle14 for conversation AND roleplay, did anybody else notice that and managed to find a fix please? I'd like to use the intended potential of the model...
mlabonne
 Owner

Not the fix you're looking for, but can you try Monarch-7B? I made GGUFs for you: https://huggingface.co/mlabonne/Monarch-7B-GGUF/tree/main

In my tests, NeuralBeagle14 was terrible at conversation and RP but maybe it depends on the use case.
NoThankYou1

Not the fix you're looking for, but can you try Monarch-7B? I made GGUFs for you: https://huggingface.co/mlabonne/Monarch-7B-GGUF/tree/main

In my tests, NeuralBeagle14 was terrible at conversation and RP but maybe it depends on the use case.

What's the prompt format for AlphaMonarch 7b?
mlabonne
 Owner

What's the prompt format for AlphaMonarch 7b?

Mistral Instruct.

Sign up or log in to comment