How to add a dependency to Maven
Add the following ai.djl.huggingface : tokenizers maven dependency to the pom.xml file with your favorite IDE (IntelliJ / Eclipse / Netbeans):
<dependency>
<groupId>ai.djl.huggingface</groupId>
<artifactId>tokenizers</artifactId>
<version>0.23.0</version>
</dependency>
How to add a dependency to Gradle
Gradle Groovy DSL: Add the following ai.djl.huggingface : tokenizers gradle dependency to your build.gradle file:
implementation 'ai.djl.huggingface:tokenizers:0.23.0'Gradle Kotlin DSL: Add the following ai.djl.huggingface : tokenizers gradle kotlin dependency to your build.gradle.kts file:
implementation("ai.djl.huggingface:tokenizers:0.23.0")How to add a dependency to SBT Scala
SBT Scala: Add the following ai.djl.huggingface : tokenizers sbt scala dependency to your build.sbt file:
libraryDependencies += "ai.djl.huggingface" % "tokenizers" % "0.23.0"
