Skip to content

Deploy Tokenizer to Microsoft Intune

Published by Microsoft in Developer Tools

Tokenizer

Contains Typescript and C# implementation of byte pair encoding (BPE) tokenizer for OpenAI LLMs, it is based on open sourced rust implementation in the OpenAI tiktoken.

Publisher
Microsoft
License
MIT

Deployment details

Latest version
1.3.3
Installer type
zip
App source
win32

Values come from the WinGet community manifest. This app has not completed an IntuneGet QA run yet.

Recent versions

  1. 1.3.3

How deployment works

IntuneGet packages Tokenizer as a Win32 app and uploads it directly to your Microsoft Intune tenant. You review the package settings, configure assignments, and start the deployment from one guided workflow.

Deploy Tokenizer to your tenant

Sign in with your Microsoft work account, choose your apps, and let IntuneGet prepare the deployment.

Start deploying free