Skip to content

Commit

Permalink
chore(release): v0.7.0 [skip ci]
Browse files Browse the repository at this point in the history
  • Loading branch information
actions-user committed Jan 2, 2024
1 parent dcb73a7 commit 26f34b2
Show file tree
Hide file tree
Showing 3 changed files with 30 additions and 2 deletions.
27 changes: 27 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,10 +2,37 @@



## v0.7.0 (2024-01-02)

### Feature

* feat: Init tokenizer from filehandle (#76)

* feat: allow creating JurassicTokenizer from model file handle

* fix: Add default for model_path and model_file_handle

* feat: Add JurassicTokenizer.from_file_path classmethod

* fix: remove model_path=None in JurassicTokenizer.from_file_handle

* fix: rename _assert_exactly_one to _validate_init and make it not static

* refactor: semantics

* test: Added tests

---------

Co-authored-by: Asaf Gardin <asafg@ai21.com> ([`dcb73a7`](https://github.com/AI21Labs/ai21-tokenizer/commit/dcb73a72348e576b06cd4a066e06141ceae37a44))


## v0.6.0 (2023-12-28)

### Chore

* chore(release): v0.6.0 [skip ci] ([`7b8348d`](https://github.com/AI21Labs/ai21-tokenizer/commit/7b8348d303eb54c4a75ca1c58be5c08c35ec3de8))

* chore: add test case for encode with is_start=False (#74)

* chore: add test case for encode with is_start=False
Expand Down
2 changes: 1 addition & 1 deletion ai21_tokenizer/version.py
Original file line number Diff line number Diff line change
@@ -1 +1 @@
VERSION = "0.6.0"
VERSION = "0.7.0"
3 changes: 2 additions & 1 deletion pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -59,7 +59,7 @@ schema_pattern = "(build|ci|docs|feat|fix|perf|refactor|style|test|chore|revert|

[tool.poetry]
name = "ai21-tokenizer"
version = "0.6.0"
version = "0.7.0"
description = ""
authors = ["AI21 Labs"]
readme = "README.md"
Expand Down Expand Up @@ -111,6 +111,7 @@ newline_sequence = "\n"




[tool.poetry.group.test.dependencies]
coverage = "^7.1.0"
pytest = "7.2.1"
Expand Down

0 comments on commit 26f34b2

Please sign in to comment.