jar

ai.djl.huggingface : tokenizers

Maven & Gradle

Jul 11, 2023

1 usages

3.8k stars

DJL NLP utilities for Huggingface tokenizers · Deep Java Library (DJL) NLP utilities for Huggingface tokenizers

Homepage Documentation Readme Maven Central

Table Of Contents

Latest Version
All Versions
View Java Class Source Code in JAR file

Latest Version

Download ai.djl.huggingface : tokenizers JAR file - Latest Versions:

Latest Stable: 0.23.0.jar

All Versions

Download ai.djl.huggingface : tokenizers JAR file - All Versions:

Version	Vulnerabilities	Size	Updated
0.23.x	tokenizers-0.23.0.jar		22.08 MB	Jul 11, 2023
0.22.x	tokenizers-0.22.1.jar		20.35 MB	Apr 17, 2023
tokenizers-0.22.0.jar		20.35 MB	Apr 12, 2023
0.21.x	tokenizers-0.21.0.jar		20.35 MB	Feb 16, 2023
0.20.x	tokenizers-0.20.0.jar		19.95 MB	Nov 29, 2022
0.19.x	tokenizers-0.19.0.jar		19.61 MB	Sep 13, 2022
0.18.x	tokenizers-0.18.0.jar		11.58 MB	Jul 09, 2022
0.17.x	tokenizers-0.17.0.jar		11.03 MB	May 10, 2022
0.16.x	tokenizers-0.16.0.jar		15.62 MB	Mar 20, 2022
0.15.x	tokenizers-0.15.0.jar		15.62 MB	Jan 18, 2022

Version

Vulnerabilities

Size

Updated

0.23.x

tokenizers-0.23.0.jar

22.08 MB

Jul 11, 2023

0.22.x

tokenizers-0.22.1.jar

20.35 MB

Apr 17, 2023

tokenizers-0.22.0.jar

20.35 MB

Apr 12, 2023

0.21.x

tokenizers-0.21.0.jar

20.35 MB

Feb 16, 2023

0.20.x

tokenizers-0.20.0.jar

19.95 MB

Nov 29, 2022

0.19.x

tokenizers-0.19.0.jar

19.61 MB

Sep 13, 2022

0.18.x

tokenizers-0.18.0.jar

11.58 MB

Jul 09, 2022

0.17.x

tokenizers-0.17.0.jar

11.03 MB

May 10, 2022

0.16.x

tokenizers-0.16.0.jar

15.62 MB

Mar 20, 2022

0.15.x

tokenizers-0.15.0.jar

15.62 MB

Jan 18, 2022

View Java Class Source Code in JAR file

Download JD-GUI to open JAR file and explore Java source code file (.class .java)
Click menu "File → Open File..." or just drag-and-drop the JAR file in the JD-GUI window tokenizers-0.23.0.jar file.
Once you open a JAR file, all the java classes in the JAR file will be displayed.

ai.djl.huggingface.tokenizers.jni

├─ ai.djl.huggingface.tokenizers.jni.CharSpan.class - [JAR]

├─ ai.djl.huggingface.tokenizers.jni.LibUtils.class - [JAR]

├─ ai.djl.huggingface.tokenizers.jni.TokenizersLibrary.class - [JAR]

ai.djl.huggingface.tokenizers

├─ ai.djl.huggingface.tokenizers.Encoding.class - [JAR]

├─ ai.djl.huggingface.tokenizers.HuggingFaceTokenizer.class - [JAR]

Dependencies from Group

tokenizers