WARNING: THIS SITE IS A MIRROR OF GITHUB.COM / IT CANNOT LOGIN OR REGISTER ACCOUNTS / THE CONTENTS ARE PROVIDED AS-IS / THIS SITE ASSUMES NO RESPONSIBILITY FOR ANY DISPLAYED CONTENT OR LINKS / IF YOU FOUND SOMETHING MAY NOT GOOD FOR EVERYONE, CONTACT ADMIN AT ilovescratch@foxmail.com
Skip to content

tiktokenizer 1.0.10 Latest

Tokenizer for OpenAI large language models.

Install from the command line:
Learn more about npm packages
$ npm install @microsoft/tiktokenizer@1.0.10
Install via package.json:
"@microsoft/tiktokenizer": "1.0.10"

Recent Versions

  • 1.0.10
    Latest
    Published 8 months ago
    0
  • 1.0.9
    Published about 1 year ago
    1
  • 1.0.8
    Published over 1 year ago
    1
  • 1.0.7
    Published over 1 year ago
    0
  • 1.0.6
    Published over 1 year ago
    87
View all versions

Loading

Details

Last published

8 months ago

Discussions

2

Issues

5

Total downloads

6.75K

Contributors 15