diff --git a/README.md b/README.md index 58294b9..357a148 100644 --- a/README.md +++ b/README.md @@ -1,4 +1,33 @@ -# AI21 Labs Tokenizer +

+

AI21 Labs Tokenizer

+

+ +

+ A SentencePiece based tokenizer for production uses +

+

+ + Test + + + Package version + + + Supported Python versions + + + Poetry + + + Supported Python versions + + + License + +

+ +--- + ## Installation