How to use from
vLLM
Install from pip and serve model
# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "luohy/SAIL-7b"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "luohy/SAIL-7b",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'
Use Docker
docker model run hf.co/luohy/SAIL-7b
Quick Links

Search Augmented Instruction Learning (SAIL-7b) LLM

The language model is fine-tuned to use retrieval model and search engines.

Downloads last month
876
Inference Providers NEW

Paper for luohy/SAIL-7b