Code

Keras 3, Kaggle, CLI, Streaming#295

Code

Draft

nglehuy wants to merge 118 commits intomainTensorSpeech/TensorFlowASR:mainfrom feat-streamingTensorSpeech/TensorFlowASR:feat-streamingCopy head branch name to clipboard

Commits

Commits on Jun 16, 2024

• feat(streaming): training, inference, gradient accumulation

  nglehuy

  committed
  232a80c

  Copy full SHA for 232a80c

Commits on Jun 19, 2024

• fix: remove ds2 dropout on conv module

  nglehuy

  committed
  9ea9b87

  Copy full SHA for 9ea9b87

Commits on Jun 24, 2024

• fix: add sync batch norm, remove wrong bn in ds2

  nglehuy

  committed
  7c21c1d

  Copy full SHA for 7c21c1d

• fix: only wrap tf.function in jit compile

  nglehuy

  committed
  4e0e8f5

  Copy full SHA for 4e0e8f5

Commits on Jun 30, 2024

• fix: use autograph do_not_convert for batchnorm sync to work

  nglehuy

  committed
  de38407

  Copy full SHA for de38407

Commits on Jul 2, 2024

• chore: config

  nglehuy

  committed
  43d6054

  Copy full SHA for 43d6054

• fix: update train/test step

  nglehuy

  committed
  d55fd40

  Copy full SHA for d55fd40

• fix: nan to num

  nglehuy

  committed
  2f502bb

  Copy full SHA for 2f502bb

• fix: update compute mask ds2

  nglehuy

  committed
  7441c95

  Copy full SHA for 7441c95

• fix: nan to num

  nglehuy

  committed
  f2241cf

  Copy full SHA for f2241cf

Commits on Jul 3, 2024

• fix: ctc loss

  nglehuy

  committed
  ebb6930

  Copy full SHA for ebb6930

• fix: update train step

  nglehuy

  committed
  305ddab

  Copy full SHA for 305ddab

• chore: config

  nglehuy

  committed
  8268afe

  Copy full SHA for 8268afe

• chore: config

  nglehuy

  committed
  c9e4d38

  Copy full SHA for c9e4d38

Commits on Jul 4, 2024

• fix: ctc

  nglehuy

  committed
  9b46cbe

  Copy full SHA for 9b46cbe

• fix: add custom batch norm to avoid tf.cond

  nglehuy

  committed
  b5bfe92

  Copy full SHA for b5bfe92

• fix: env utils

  nglehuy

  committed
  dc08e6a

  Copy full SHA for dc08e6a

• fix: log batch that cause invalid loss

  nglehuy

  committed
  cf37206

  Copy full SHA for cf37206

• chore: buffer size

  nglehuy

  committed
  4596609

  Copy full SHA for 4596609

Commits on Jul 6, 2024

• fix: handle unknown dataset size with no metadata provided

  nglehuy

  committed
  ba9d6b2

  Copy full SHA for ba9d6b2

• chore: add option use loss scale

  nglehuy

  committed
  fe594ad

  Copy full SHA for fe594ad

• fix: support log debug

  nglehuy

  committed
  7aed458

  Copy full SHA for 7aed458

Commits on Jul 12, 2024

• fix: update gradient accumulation

  nglehuy

  committed
  4330dec

  Copy full SHA for 4330dec

Commits on Jul 14, 2024

• fix: ga

  nglehuy

  committed
  522f080

  Copy full SHA for 522f080

• feat: tf2.16 with keras 3

  nglehuy

  committed
  90cabc2

  Copy full SHA for 90cabc2

Commits on Jul 15, 2024

• fix: ga

  nglehuy

  committed
  8285f6d

  Copy full SHA for 8285f6d

• Merge branch 'tf2.16' into feat-streaming

  nglehuy

  committed
  fd446d6

  Copy full SHA for fd446d6

• feat: fix layers, models to tf2.16 with keras 3

  nglehuy

  committed
  5037896

  Copy full SHA for 5037896

Commits on Jul 28, 2024

• feat: update models to compatible with keras 3

  nglehuy

  committed
  a853eba

  Copy full SHA for a853eba

• fix: loss compute using add_loss, loss tracking

  nglehuy

  committed
  f8a7b91

  Copy full SHA for f8a7b91

• fix: output shapes of models to log to summary

  nglehuy

  committed
  03f0d60

  Copy full SHA for 03f0d60

• fix: contextnet

  nglehuy

  committed
  8b0ed02

  Copy full SHA for 8b0ed02

• fix: ds2

  nglehuy

  committed
  77baaa5

  Copy full SHA for 77baaa5

• fix: jasper

  nglehuy

  committed
  3768878

  Copy full SHA for 3768878

• fix: rnnt

  nglehuy

  committed
  f3cb239

  Copy full SHA for f3cb239

• fix: transformer

  nglehuy

  committed
  1d7e3a6

  Copy full SHA for 1d7e3a6

Commits on Jul 29, 2024

• fix: update deps

  nglehuy

  committed
  7be3eda

  Copy full SHA for 7be3eda

Commits on Aug 25, 2024

• fix: requirements

  nglehuy

  committed
  9b03b31

  Copy full SHA for 9b03b31

• fix: super init

  nglehuy

  committed
  401180b

  Copy full SHA for 401180b

• fix: update regularizers

  nglehuy

  committed
  786f5d4

  Copy full SHA for 786f5d4

• fix: update regularizers

  nglehuy

  committed
  a9d1733

  Copy full SHA for a9d1733

Commits on Nov 24, 2024

• fix: print shapes

  nglehuy

  committed
  689b366

  Copy full SHA for 689b366

• fix: conformer ctc

  nglehuy

  committed
  4e75c0f

  Copy full SHA for 4e75c0f

Commits on Nov 25, 2024

• fix: add ctc tpu impl

  nglehuy

  committed
  82d91c8

  Copy full SHA for 82d91c8

• fix: ctc tpu impl

  nglehuy

  committed
  c915be3

  Copy full SHA for c915be3

Commits on Nov 28, 2024

• fix: save weights, tpu connect

  nglehuy

  committed
  dda33b7

  Copy full SHA for dda33b7

• fix: save weights, tpu connect

  nglehuy

  committed
  c667984

  Copy full SHA for c667984

Commits on Dec 3, 2024

• fix: update req

  nglehuy

  committed
  dc77b84

  Copy full SHA for dc77b84

• fix: update req

  nglehuy

  committed
  d455ae1

  Copy full SHA for d455ae1

• fix: update req

  nglehuy

  committed
  33394a2

  Copy full SHA for 33394a2

• fix: update req

  nglehuy

  committed
  35160ce

  Copy full SHA for 35160ce

• fix: update req

  nglehuy

  committed
  6ffb3b8

  Copy full SHA for 6ffb3b8

Commits on Dec 4, 2024

• fix: update req

  nglehuy

  committed
  bb732a7

  Copy full SHA for bb732a7

• fix: strategy scope

  nglehuy

  committed
  9179425

  Copy full SHA for 9179425

• fix: requirements

  nglehuy

  committed
  ace3887

  Copy full SHA for ace3887

Commits on Dec 7, 2024

• fix: update savings

  nglehuy

  committed
  67a8470

  Copy full SHA for 67a8470

Commits on Dec 31, 2024

• feat: bundle scripts inside package

  nglehuy

  committed
  9824819

  Copy full SHA for 9824819

• feat: introduce chunk-wise masking for mha layer

  nglehuy

  committed
  05b068b

  Copy full SHA for 05b068b

• feat: introduce chunk-wise masking to conformer & transformer

  nglehuy

  committed
  1edf16a

  Copy full SHA for 1edf16a

Commits on Jan 1, 2025

• chore: update install script

  nglehuy

  committed
  6338f55

  Copy full SHA for 6338f55

• chore: add conformer small streaming

  nglehuy

  committed
  e844f77

  Copy full SHA for e844f77

• chore: add conformer small streaming

  nglehuy

  committed
  0543c31

  Copy full SHA for 0543c31

• fix: use history size instead of memory length

  nglehuy

  committed
  a2e2022

  Copy full SHA for a2e2022

• chore: update logging

  nglehuy

  committed
  4824929

  Copy full SHA for 4824929

• fix: streaming masking mha

  nglehuy

  committed
  eca664c

  Copy full SHA for eca664c

Commits on Jan 7, 2025

• fix: conformer ctc configs

  nglehuy

  committed
  a302962

  Copy full SHA for a302962

Commits on Jan 12, 2025

• feat: add kaggle backup and restore callback

  nglehuy

  committed
  ab83d87

  Copy full SHA for ab83d87

• fix: support flash attention, update deps

  nglehuy

  committed
  52de4c0

  Copy full SHA for 52de4c0

• chore: add conformer-ctc-small-streaming-kaggle

  nglehuy

  committed
  aaa06a5

  Copy full SHA for aaa06a5

• fix: restore from kaggle model

  nglehuy

  committed
  2fd4f2b

  Copy full SHA for 2fd4f2b

• fix: restore from kaggle model

  nglehuy

  committed
  6e5c3b9

  Copy full SHA for 6e5c3b9

• fix: ignore backup kaggle when nan loss occurs

  nglehuy

  committed
  f62fdf9

  Copy full SHA for f62fdf9

• fix: only use tqdm when needed

  nglehuy

  committed
  2947160

  Copy full SHA for 2947160

Commits on Jan 24, 2025

• fix: deps

  nglehuy

  committed
  c532d5c

  Copy full SHA for c532d5c

• fix: support static shape

  nglehuy

  committed
  0e5e826

  Copy full SHA for 0e5e826

• fix: mha streaming mask

  nglehuy

  committed
  eb55a4b

  Copy full SHA for eb55a4b

Commits on Jan 25, 2025

• fix: feature extraction mixed precision, configs

  nglehuy

  committed
  12fbb85

  Copy full SHA for 12fbb85

• fix: expose relmha_causal, flash attention

  nglehuy

  committed
  2100d75

  Copy full SHA for 2100d75

• fix: allow ctc to force use native tf impl

  nglehuy

  committed
  a5d1e84

  Copy full SHA for a5d1e84

• chore: list devices

  nglehuy

  committed
  5ff3163

  Copy full SHA for 5ff3163

Commits on Feb 9, 2025

• fix: attention mask

  nglehuy

  committed
  3dbab33

  Copy full SHA for 3dbab33

Commits on Feb 15, 2025

• fix: general layers to show outputshape, invalid loss show outputs

  nglehuy

  committed
  1545543

  Copy full SHA for 1545543

• fix: models configs

  nglehuy

  committed
  5f784b7

  Copy full SHA for 5f784b7

Commits on Feb 20, 2025

• fix: config streaming

  nglehuy

  committed
  70ac41e

  Copy full SHA for 70ac41e

Commits on Feb 23, 2025

• fix: configs

  nglehuy

  committed
  eebc361

  Copy full SHA for eebc361

• fix: configs

  nglehuy

  committed
  6b0bec4

  Copy full SHA for 6b0bec4

Commits on Mar 9, 2025

• Merge branch 'main' into feat-streaming

  nglehuy

  committed
  2ac8e7f

  Copy full SHA for 2ac8e7f

• fix: streaming masking mha

  nglehuy

  committed
  7dcd145

  Copy full SHA for 7dcd145

• fix: streaming masking mha

  nglehuy

  committed
  e209040

  Copy full SHA for e209040

Commits on Mar 13, 2025

• fix: update mha attention mask

  nglehuy

  committed
  5649fdd

  Copy full SHA for 5649fdd

• feat: add support for layer norm in conformer conv module

  nglehuy

  committed
  26c4a5f

  Copy full SHA for 26c4a5f

• chore: update configs

  nglehuy

  committed
  4f77a52

  Copy full SHA for 4f77a52

Commits on Mar 17, 2025

• fix: feature extraction layer dtype tf.float32 to ensure loss convergence

  nglehuy

  committed
  c3ab865

  Copy full SHA for c3ab865

• fix: ctc loss tpu - case logits to float32

  nglehuy

  committed
  778c1a2

  Copy full SHA for 778c1a2

Commits on Mar 19, 2025

• fix: use auto mask

  nglehuy

  committed
  e68ceee

  Copy full SHA for e68ceee

Commits on Mar 20, 2025

• fix: pad logits length to label length

  nglehuy

  committed
  f1e2a88

  Copy full SHA for f1e2a88

• fix: ctc loss tpu

  nglehuy

  committed
  f1a0ed6

  Copy full SHA for f1a0ed6

Commits on Mar 21, 2025

• chore: config

  nglehuy

  committed
  6f7f246

  Copy full SHA for 6f7f246

• fix: disable bias/activity regularizer as not needed

  nglehuy

  committed
  d538e69

  Copy full SHA for d538e69

Commits on Mar 23, 2025

• chore: config

  nglehuy

  committed
  7611ff8

  Copy full SHA for 7611ff8

Commits on Mar 24, 2025

• chore: setup mxp

  nglehuy

  committed
  0c8e7c1

  Copy full SHA for 0c8e7c1

• chore: setup mxp

  nglehuy

  committed
  56d2afa

  Copy full SHA for 56d2afa

Commits on Mar 25, 2025

• fix: small kaggle

  nglehuy

  committed
  454163c

  Copy full SHA for 454163c

• chore: transformer-ctc streaming

  nglehuy

  committed
  a333bfc

  Copy full SHA for a333bfc

Commits on Mar 27, 2025

• chore: config

  nglehuy

  committed
  cf435a3

  Copy full SHA for cf435a3

Commits on Mar 30, 2025

• fix: ctc-tpu clean label

  nglehuy

  committed
  c35af45

  Copy full SHA for c35af45

• chore: configs

  nglehuy

  committed
  0556481

  Copy full SHA for 0556481

• chore: configs

  nglehuy

  committed
  3e88f65

  Copy full SHA for 3e88f65

• chore: configs

  nglehuy

  committed
  111f3ac

  Copy full SHA for 111f3ac

• fix: train step

  nglehuy

  committed
  8ee9813

  Copy full SHA for 8ee9813

• fix: apply ga loss division before loss scaling

  nglehuy

  committed
  dde7760

  Copy full SHA for dde7760

• fix: update train function with ga steps

  nglehuy

  committed
  aade071

  Copy full SHA for aade071

• fix: update train step ga

  nglehuy

  committed
  dc0c304

  Copy full SHA for dc0c304

• chore: configs

  nglehuy

  committed
  d541928

  Copy full SHA for d541928

• chore: configs

  nglehuy

  committed
  91a39a2

  Copy full SHA for 91a39a2

• chore: configs

  nglehuy

  committed
  2a40da6

  Copy full SHA for 2a40da6

• chore: configs

  nglehuy

  committed
  8bcf0f3

  Copy full SHA for 8bcf0f3

• fix: rnn kwargs

  nglehuy

  committed
  de58fed

  Copy full SHA for de58fed