WARNING: THIS SITE IS A MIRROR OF GITHUB.COM / IT CANNOT LOGIN OR REGISTER ACCOUNTS / THE CONTENTS ARE PROVIDED AS-IS / THIS SITE ASSUMES NO RESPONSIBILITY FOR ANY DISPLAYED CONTENT OR LINKS / IF YOU FOUND SOMETHING MAY NOT GOOD FOR EVERYONE, CONTACT ADMIN AT ilovescratch@foxmail.com
Skip to content

[Bug] The values for completion_tokens and prompt_tokens appear to be reversed, differing from those returned in vllm. #4403

@fit2cloud-mahaoyu

Description

@fit2cloud-mahaoyu

Contact Information

[email protected]

MaxKB Version

v2.1.0 pro

Problem Description

Request VLLM, set max tokens to 1000:

Image

Request maxkb, set max token to 1000:

Image

Steps to Reproduce

Interfacing with VLLM, Q&A

The expected correct result

No response

Related log output

Additional Information

No response

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions