Popular repositories Loading

1. LCKV LCKV Public

   Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance. Accepted to ACL 2024.

   Python 147 10

2. Conic10K Conic10K Public

   Conic10K: A large-scale dataset for closed-vocabulary math problem understanding. Accepted to EMNLP2023 Findings.

   Python 25 2

3. Probabilistic-Transformer Probabilistic-Transformer Public

   A probabilitic model for contextual word representation. Accepted to ACL2023 Findings.

   Python 23 2

4. tinyllama tinyllama Public

   A side project that follows all the acceleration tricks in tinyllama, with the minimal modification to the huggingface transformers code.

   Python 13 1

5. nni-slurm nni-slurm Public

   Forked from microsoft/nni

   A patch for NNI with slurm and W&B.

   Python 8

6. tinyllama-zh tinyllama-zh Public

   A side project that pretrains a tinyllama on Chinese corpora, with the minimal modification to the huggingface transformers code.

   Python 7 1