Package: rtiktoken
Title: A Byte-Pair-Encoding (BPE) Tokenizer for OpenAI's Large Language
        Models
Version: 0.11.0-1
Authors@R: c(
    person("David", "Zimmermann-Kollenda", , "david_j_zimmermann@hotmail.com", role = c("aut", "cre")),
    person("Roger Zurawicki", role = "aut", comment = "tiktoken-rs Rust library"),
    person("Authors of the dependent Rust crates", role = "aut", comment = "see AUTHORS file")
  )
Description: A thin wrapper around the tiktoken-rs crate, allowing to
        encode text into Byte-Pair-Encoding (BPE) tokens and decode
        tokens back to text. This is useful to understand how Large
        Language Models (LLMs) perceive text.
License: MIT + file LICENSE
URL: https://davzim.github.io/rtiktoken/,
        https://github.com/DavZim/rtiktoken/
BugReports: https://github.com/DavZim/rtiktoken/issues
Suggests: testthat (>= 3.0.0)
SystemRequirements: Cargo (Rust's package manager), rustc >= 1.65.0
Encoding: UTF-8
Roxygen: list(markdown = TRUE)
RoxygenNote: 7.3.3
Config/rextendr/version: 0.5.0
Config/testthat/edition: 3
Config/rtiktoken/MSRV: 1.65.0
Depends: R (>= 4.2)
Config/pak/sysreqs: libclang-dev
Repository: https://davzim.r-universe.dev
Date/Publication: 2026-04-23 14:06:54 UTC
RemoteUrl: https://github.com/davzim/rtiktoken
RemoteRef: HEAD
RemoteSha: 52e7f16a924bdfa255f02670b73452b8af422dcd
NeedsCompilation: yes
Packaged: 2026-05-29 19:33:35 UTC; root
Author: David Zimmermann-Kollenda [aut, cre],
  Roger Zurawicki [aut] (tiktoken-rs Rust library),
  Authors of the dependent Rust crates [aut] (see AUTHORS file)
Maintainer: David Zimmermann-Kollenda <david_j_zimmermann@hotmail.com>