Lama 3.23b performs great when I download and use using ollama but when I manually download the model or if I use the gguf model by unsloth, it gives me irrelevant response. Please help me out

[John6666]

It seems that Ollama internally loads the Instruct model instead of Base.

How to Configure LLaMA-3:8B on HuggingFace to Generate Responses Similar to Ollama?

Hi HuggingFace Community, I have been experimenting with the LLaMA-3:8B model using the following code: import transformers import torch model_id = "meta-llama/Meta-Llama-3-8B" pipeline = transformers.pipeline( "text-generation", model=model_id, model_kwargs={"torch_dtype": torch.bfloat16}, device_map="auto" ) pipeline("Hey how are you doing today?") This code generates the following response: [{'generated_text': 'Hey how are you doing today? My name is David and I’m a photographer bas…