diff --git a/README.md b/README.md index 58294b9..357a148 100644 --- a/README.md +++ b/README.md @@ -1,4 +1,33 @@ -# AI21 Labs Tokenizer +
+ AI21 Labs Tokenizer +
+ A SentencePiece based tokenizer for production uses +
+ + + + + + + + + + + + + + + + + + +