Skip to content

Releases: AI21Labs/ai21-tokenizer

v0.3.6

22 Nov 15:18
Compare
Choose a tag to compare

v0.3.6 (2023-11-22)

Ci

Documentation

Fix

  • fix: support ai21_tokenizer.version (#52) (13944eb)

v0.3.5

22 Nov 12:24
Compare
Choose a tag to compare

v0.3.5 (2023-11-22)

Fix

  • fix: newline n and prettier (#47)

  • fix: newline n and prettier

  • fix: exclude

  • fix: exclude from pretty (f5c9204)

v0.3.4

22 Nov 11:39
Compare
Choose a tag to compare

v0.3.4 (2023-11-22)

Fix

v0.3.3

22 Nov 10:01
Compare
Choose a tag to compare

v0.3.3 (2023-11-22)

Ci

Documentation

Fix

v0.3.2

21 Nov 16:16
Compare
Choose a tag to compare

v0.3.2 (2023-11-21)

Ci

Fix

  • fix: Version path (#42)

  • fix: version

  • fix: version variables

  • fix: name (ee4d744)

v0.3.1

21 Nov 15:41
Compare
Choose a tag to compare

v0.3.1 (2023-11-21)

Fix

v0.3.0

21 Nov 15:08
Compare
Choose a tag to compare

v0.3.0 (2023-11-21)

Documentation

  • docs: Release md update before publish (#36)

  • fix: Added support for both str and path

  • fix: rename package

  • fix: updated pre commits and added new one

  • docs: Updated docs

  • ci: down grade

  • docs: Added another example (18ccbeb)

  • docs: CONTRIBUTING.md (#35)

  • docs: CONTRIBUTING.md

  • ci: end_of_line fix

  • docs: inv test (e282440)

Feature

Fix

v0.2.0

21 Nov 11:35
Compare
Choose a tag to compare

v0.2.0 (2023-11-21)

Chore

  • chore(deps-dev): bump black from 22.12.0 to 23.3.0 (#32)

Bumps black from 22.12.0 to 23.3.0.


updated-dependencies:

  • dependency-name: black
    dependency-type: direct:development
    update-type: version-update:semver-major
    ...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: asafgardin <147075902+asafgardin@users.noreply.github.com> (bb4986e)

Feature

  • feat: Tokenizer factory (#31)

  • feat: Added tokenizer abc and factory

  • fix: api to receive default and none

  • fix: example

  • fix: factory and tests

  • fix: rename base

  • fix: rename base class

  • fix: rename package

  • fix: example

  • fix: readme and tasks

  • docs: factory class

  • docs: renames

  • fix: directory hierarchy in tests

  • fix: rename package

  • chore(release): v0.1.2 [skip ci]

  • fix: rename package

  • ci: example

  • fix: assert in example

  • fix: src_path


Co-authored-by: github-actions <github-actions@github.com> (e55cd1d)

Fix

v0.1.2

21 Nov 09:28
Compare
Choose a tag to compare

v0.1.2 (2023-11-21)

Chore

  • chore(deps-dev): bump safety from 2.3.4 to 2.3.5 (#28)

Bumps safety from 2.3.4 to 2.3.5.


updated-dependencies:

  • dependency-name: safety
    dependency-type: direct:development
    update-type: version-update:semver-patch
    ...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> (28118ac)

  • chore(deps-dev): bump pytest-mock from 3.10.0 to 3.11.1 (#24)

Bumps pytest-mock from 3.10.0 to 3.11.1.


updated-dependencies:

  • dependency-name: pytest-mock
    dependency-type: direct:development
    update-type: version-update:semver-minor
    ...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: asafgardin <147075902+asafgardin@users.noreply.github.com> (0a36f21)

Ci

  • ci: Remove install from publish (#29)

  • ci: Removed install dependency

  • ci: changlog changes (f8e8392)

  • ci: dependabot pr limit (#27)

  • ci: dependabot pr limit

  • ci: dependabot pr limit (9b2c4f8)

Fix

  • fix: workflow dispatch for release action (#33) (f81b4ab)

v0.1.1

20 Nov 11:40
Compare
Choose a tag to compare

v0.1.1 (2023-11-20)

Fix

  • fix: used PAT (#26)

  • test: write to main

  • fix: token

  • test: debug

  • test: debugging tokens

  • test: uncomment

  • test: write to main

  • fix: token

  • test: debug

  • test: debugging tokens

  • test: uncomment

  • fix: Changed to main (2ff12c9)