Skip to content

server : add more test cases - #10569

Merged
ngxson merged 4 commits into
ggml-org:masterfrom
ngxson:xsn/server_more_tests
Nov 29, 2024
Merged

server : add more test cases#10569
ngxson merged 4 commits into
ggml-org:masterfrom
ngxson:xsn/server_more_tests

Conversation

@ngxson

@ngxson ngxson commented Nov 28, 2024

Copy link
Copy Markdown
Collaborator

Cont #10416

These test cases are being added:

  • test with incorrect input for various endpoints (embd, completions, rerank, etc). example for incorrect cases are: empty string, null, incorrect type, etc
  • loading split model
  • speculative, related to server : add speculative decoding support #10455

@github-actions github-actions Bot added examples python python script changes server labels Nov 28, 2024
@ngxson ngxson changed the title Xsn/server more tests server : add more test cases Nov 28, 2024
@ngxson
ngxson requested a review from ggerganov November 29, 2024 13:03
@ngxson
ngxson merged commit b782e5c into ggml-org:master Nov 29, 2024
arthw pushed a commit to arthw/llama.cpp that referenced this pull request Dec 20, 2024
* server : add split model test

* add test speculative

* add invalid cases
Seunghhon pushed a commit to Seunghhon/llama.cpp that referenced this pull request Apr 26, 2026
* server : add split model test

* add test speculative

* add invalid cases
ljubomirj pushed a commit to ljubomirj/llama.cpp that referenced this pull request May 6, 2026
* server : add split model test

* add test speculative

* add invalid cases
my-other-github-account pushed a commit to my-other-github-account/llama.cpp that referenced this pull request May 15, 2026
* server : add split model test

* add test speculative

* add invalid cases
my-other-github-account pushed a commit to my-other-github-account/llama.cpp that referenced this pull request May 15, 2026
* server : add split model test

* add test speculative

* add invalid cases
phibya pushed a commit to ziee-ai/llama.cpp that referenced this pull request May 29, 2026
* server : add split model test

* add test speculative

* add invalid cases
AlexiAlp pushed a commit to minghaop/llama.cpp that referenced this pull request Jun 2, 2026
* server : add split model test

* add test speculative

* add invalid cases
AlexiAlp pushed a commit to minghaop/llama.cpp that referenced this pull request Jun 2, 2026
* server : add split model test

* add test speculative

* add invalid cases
fukuro-kun pushed a commit to fukuro-kun/fukuro-llama-cpp-turboquant that referenced this pull request Jul 5, 2026
* server : add split model test

* add test speculative

* add invalid cases
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

examples python python script changes server

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants