Home

Welcome to the optillm wiki! You will find more details here, including running examples, code samples and other documentation.

Code samples

• Build your own plugin
• Using the privacy plugin

Detailed running examples

• MCTS

Integrations with existing tools

• Patchwork

Building on NVIDIA Jetson

When installing on Jetson you may need to build some dependencies from sources as wheels for them may not be available on PYPI. Installing the following dependencies separately before running pip install -r requirements.txt is known to work on a NVIDIA Jetson Orin 64B development kit.

pip install 'z3-solver<4.12'
pip install spacy --no-binary blis