Advanced settings Connection, model and generation
Defaults are ready to use. Change these only when connecting a different backend.
Connection
Gateway reachability, not GPU readiness
idle
Streaming
Streams via SSE
curl -X POST https://llm-serving-gateway.onrender.com/v1/chat/completions \
-H 'Content-Type: application/json' \
-d '{
"model": "qwen2.5-7b-instruct",
"messages": [
{
"role": "system",
"content": "You are a helpful assistant for debugging infrastructure and system design questions."
},
{
"role": "user",
"content": ""
}
],
"temperature": 0.7,
"stream": true,
"max_tokens": 256
}'
Chat with your model
Ask a question. Watch the GPU-powered response arrive.
Model: qwen2.5-7b-instructStream on
YOUR INFERENCE PLAYGROUND
What would you like to explore?
No setup needed for the default connection. Choose an example or type below.
Live GPU demo: availability depends on the inference server being online.
Enter to send · Shift + Enter for a new line