Skip to content

server: remove default "gpt-3.5-turbo" model name - #17668

Merged
ngxson merged 4 commits into
ggml-org:masterfrom
ngxson:xsn/server_remove_gpt_3_name
Dec 2, 2025
Merged

server: remove default "gpt-3.5-turbo" model name#17668
ngxson merged 4 commits into
ggml-org:masterfrom
ngxson:xsn/server_remove_gpt_3_name

Conversation

@ngxson

@ngxson ngxson commented Dec 1, 2025

Copy link
Copy Markdown
Collaborator

Fix #17666

Important

This PR changes the way how model name is handle (see below).
In addition to that, the "model" field from input request no longer be reflected back to the response. If you need to use a custom model name, set it via --model-alias argument instead

Remove the default gpt-3.5-turbo model name as was useful in the past, but no longer be the case.

The model name is now decided based on this priority:

  • If model_alias is set, use it
  • Otherwise, use registry format <user>/<model>:<tag> if available (for cached models)
  • Fallback to file name if none is found

After the change, web UI display the model name correctly:

llama-server -m ../models/DeepSeek-R1-Distill-Llama-8B-Q4_K_M.gguf
image

@ngxson
ngxson requested a review from pwilkin December 1, 2025 22:02
@ngxson
ngxson requested a review from ggerganov as a code owner December 1, 2025 22:02

@pwilkin pwilkin left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, should be a generally safer approach anyway.

@pwilkin

pwilkin commented Dec 1, 2025

Copy link
Copy Markdown
Member

You might want to also check the stats under the assistant response, I think that's where it bugged out for me (if you have 'show statistics' and 'show model name' checked in settings).

@ngxson

ngxson commented Dec 1, 2025

Copy link
Copy Markdown
Collaborator Author

Hmm yeah, it reflects back the input model name from the request. I think it's also time to remove this behavior as it doesn't make much sense.

@ngxson

ngxson commented Dec 1, 2025

Copy link
Copy Markdown
Collaborator Author

@pwilkin could you confirm if the latest commit resolves the problem on your side? (maybe there are cases that I haven't tested)

@pwilkin

pwilkin commented Dec 1, 2025

Copy link
Copy Markdown
Member

Okay, pulling and will check.

@pwilkin

pwilkin commented Dec 1, 2025

Copy link
Copy Markdown
Member

@ngxson can confirm, works good now.
image

@github-actions github-actions Bot added examples python python script changes server labels Dec 1, 2025
@ngxson

ngxson commented Dec 2, 2025

Copy link
Copy Markdown
Collaborator Author

Merging this once most workflows passed on the mirrored PR: ngxson#46

@ngxson
ngxson merged commit 5d6bd84 into ggml-org:master Dec 2, 2025
62 of 67 checks passed
Anico2 added a commit to Anico2/llama.cpp that referenced this pull request Jan 15, 2026
* server: remove default "gpt-3.5-turbo" model name

* do not reflect back model name from request

* fix test
blime4 referenced this pull request in blime4/llama.cpp Feb 5, 2026
* server: remove default "gpt-3.5-turbo" model name

* do not reflect back model name from request

* fix test
flkikee-collab

This comment was marked as spam.

Seunghhon pushed a commit to Seunghhon/llama.cpp that referenced this pull request Apr 26, 2026
* server: remove default "gpt-3.5-turbo" model name

* do not reflect back model name from request

* fix test
ljubomirj pushed a commit to ljubomirj/llama.cpp that referenced this pull request May 6, 2026
* server: remove default "gpt-3.5-turbo" model name

* do not reflect back model name from request

* fix test
my-other-github-account pushed a commit to my-other-github-account/llama.cpp that referenced this pull request May 15, 2026
* server: remove default "gpt-3.5-turbo" model name

* do not reflect back model name from request

* fix test
my-other-github-account pushed a commit to my-other-github-account/llama.cpp that referenced this pull request May 15, 2026
* server: remove default "gpt-3.5-turbo" model name

* do not reflect back model name from request

* fix test
phibya pushed a commit to ziee-ai/llama.cpp that referenced this pull request May 29, 2026
* server: remove default "gpt-3.5-turbo" model name

* do not reflect back model name from request

* fix test
fewtarius pushed a commit to fewtarius/CachyLLama that referenced this pull request May 30, 2026
* server: remove default "gpt-3.5-turbo" model name

* do not reflect back model name from request

* fix test
fukuro-kun pushed a commit to fukuro-kun/fukuro-llama-cpp-turboquant that referenced this pull request Jul 5, 2026
* server: remove default "gpt-3.5-turbo" model name

* do not reflect back model name from request

* fix test
MrLordCat referenced this pull request in MrLordCat/llama.cpp-rdna-lab Jul 16, 2026
* server: remove default "gpt-3.5-turbo" model name

* do not reflect back model name from request

* fix test
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

examples python python script changes server

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Misc. bug: Incorrect model name in web chat

4 participants