v0.5.0
v0.5.0 (2023-12-28)
Feature
-
feat: Add more special tokens (#71)
-
fix: commitizen tag starts with "v"
-
feat: add eos_id
-
feat: Add newline_id
-
fix: typo "_newline_piece" instead of "newline_piece"
-
fix: newline_id already existed as "private". Just make it "public"
-
fix: forgot to rename everywhere (
9a9e1a8
)