Skip to content
Read the original: Simon Willison·Published· 3h agoAI score22

ttok 0.4 Adds --list-models Command for Counting Tokens with tiktoken

ttok 0.4

AISummary

Simon Willison has released ttok 0.4, a command-line tool for counting tokens built on OpenAI's open source tiktoken library. The update adds a --list-models command, fixes a Click warning, and updates CI, and the tool can run through uvx, for example with cat file.txt | uvx ttok.

Read the original simonwillison.net

Source: Simon Willison · simonwillison.net