Code

Flexllm#83

Code

Draft

goliaro wants to merge 78 commits intoinferenceflexflow/flexflow-serve:inferencefrom flexllmflexflow/flexflow-serve:flexllmCopy head branch name to clipboard

+5,850-1,531

Commits

Commits on Nov 22, 2024

• first commit

  goliaro

  committed
  e3b7e79

  Copy full SHA for e3b7e79

Commits on Nov 23, 2024

• rename

  goliaro

  committed
  bd93585

  Copy full SHA for bd93585

• helpers

  goliaro

  committed
  00d1a1b

  Copy full SHA for 00d1a1b

• backup

  goliaro

  committed
  82284f2

  Copy full SHA for 82284f2

Commits on Nov 24, 2024

• backup

  goliaro

  committed
  6266ec7

  Copy full SHA for 6266ec7

Commits on Nov 25, 2024

• finished impl

  goliaro

  committed
  4fcdf79

  Copy full SHA for 4fcdf79

• add benchmarking scripts

  goliaro

  committed
  6d7aa57

  Copy full SHA for 6d7aa57

• fix

  goliaro

  committed
  09aa5af

  Copy full SHA for 09aa5af

• fix

  goliaro

  committed
  9c0d827

  Copy full SHA for 9c0d827

• build fix

  goliaro

  committed
  784c8d9

  Copy full SHA for 784c8d9

Commits on Nov 26, 2024

• fix bugs

  goliaro

  committed
  ee48def

  Copy full SHA for ee48def

Commits on Nov 27, 2024

• update

  goliaro

  committed
  450c98f

  Copy full SHA for 450c98f

• fix

  goliaro

  committed
  98e025c

  Copy full SHA for 98e025c

• fixes

  goliaro

  committed
  d963933

  Copy full SHA for d963933

• fix

  goliaro

  committed
  287dadb

  Copy full SHA for 287dadb

Commits on Nov 28, 2024

• update

  goliaro

  committed
  6a1544d

  Copy full SHA for 6a1544d

Commits on Nov 29, 2024

• use one bc only

  goliaro

  committed
  10e1596

  Copy full SHA for 10e1596

• fix

  goliaro

  committed
  89a6287

  Copy full SHA for 89a6287

• fix

  goliaro

  committed
  caa4880

  Copy full SHA for caa4880

Commits on Nov 30, 2024

• fix

  goliaro

  committed
  f27a224

  Copy full SHA for f27a224

• fix

  goliaro

  committed
  68dfa8c

  Copy full SHA for 68dfa8c

• fix

  goliaro

  committed
  529d9f1

  Copy full SHA for 529d9f1

• fix

  goliaro

  committed
  6cb9266

  Copy full SHA for 6cb9266

• fix

  goliaro

  committed
  03498c1

  Copy full SHA for 03498c1

• update

  goliaro

  committed
  9fcf6a3

  Copy full SHA for 9fcf6a3

Commits on Dec 1, 2024

• Merge branch 'inference' into flexllm

  goliaro

  committed
  7fba224

  Copy full SHA for 7fba224

• add file to get dolly

  goliaro

  committed
  07e8e62

  Copy full SHA for 07e8e62

• update

  goliaro

  committed
  bbde408

  Copy full SHA for bbde408

• update

  goliaro

  committed
  de2fcd9

  Copy full SHA for de2fcd9

Commits on Dec 2, 2024

• add warmup requests

  goliaro

  committed
  c8dc468

  Copy full SHA for c8dc468

Commits on Dec 3, 2024

• update

  goliaro

  committed
  0b150e3

  Copy full SHA for 0b150e3

• update

  goliaro

  committed
  4ec561e

  Copy full SHA for 4ec561e

Commits on Dec 4, 2024

• fix

  goliaro

  committed
  07b9e50

  Copy full SHA for 07b9e50

• update

  goliaro

  committed
  b077d27

  Copy full SHA for b077d27

• add scripts

  goliaro

  committed
  3939025

  Copy full SHA for 3939025

• fix

  goliaro

  committed
  943c06b

  Copy full SHA for 943c06b

Commits on Dec 5, 2024

• gqa fwd

  goliaro

  committed
  9516e59

  Copy full SHA for 9516e59

• bwd gqa

  goliaro

  committed
  bf1ff34

  Copy full SHA for bf1ff34

Commits on Dec 6, 2024

• fix

  goliaro

  committed
  b3a393a

  Copy full SHA for b3a393a

• fix

  goliaro

  committed
  04c6857

  Copy full SHA for 04c6857

• add overhead test

  goliaro

  committed
  ec500d2

  Copy full SHA for ec500d2

Commits on Dec 7, 2024

• update script

  goliaro

  committed
  16b3a99

  Copy full SHA for 16b3a99

• update script

  goliaro

  committed
  c65cf0d

  Copy full SHA for c65cf0d

• fixes

  goliaro

  committed
  bc30870

  Copy full SHA for bc30870

Commits on Dec 8, 2024

• fix

  goliaro

  committed
  2cc42d1

  Copy full SHA for 2cc42d1

• add plot script

  goliaro

  committed
  b094c12

  Copy full SHA for b094c12

• fixes, add data

  goliaro

  committed
  2d7910b

  Copy full SHA for 2d7910b

• update

  goliaro

  committed
  ab0b209

  Copy full SHA for ab0b209

Commits on Dec 9, 2024

• add results and plots

  goliaro

  committed
  066d9e8

  Copy full SHA for 066d9e8

Commits on Dec 10, 2024

• update

  goliaro

  committed
  5cc5535

  Copy full SHA for 5cc5535

• add new files

  goliaro

  committed
  770b5a9

  Copy full SHA for 770b5a9

• update

  goliaro

  committed
  8cddc22

  Copy full SHA for 8cddc22

Commits on Jan 10, 2025

• update

  goliaro

  committed
  97678e8

  Copy full SHA for 97678e8

• update

  goliaro

  committed
  c38a70f

  Copy full SHA for c38a70f

• update

  goliaro

  committed
  a33837b

  Copy full SHA for a33837b

• add flashinfer

  goliaro

  committed
  3c7bbc4

  Copy full SHA for 3c7bbc4

• update

  goliaro

  committed
  f3b7cab

  Copy full SHA for f3b7cab

Commits on Jan 14, 2025

• add flashinfer w recompute

  goliaro

  committed
  302d470

  Copy full SHA for 302d470

Commits on Jan 15, 2025

• fix

  goliaro

  committed
  3ab9b4e

  Copy full SHA for 3ab9b4e

Commits on Feb 5, 2025

• Merge branch 'inference' into flexllm

  goliaro

  committed
  8f52547

  Copy full SHA for 8f52547

Commits on Feb 7, 2025

• remove exp data

  goliaro

  committed
  87b5403

  Copy full SHA for 87b5403

• fix gqa, comment out flashinfer

  goliaro

  committed
  85227c0

  Copy full SHA for 85227c0

Commits on Feb 9, 2025

• Merge branch 'inference' into flexllm

  goliaro

  committed
  e4d8c2c

  Copy full SHA for e4d8c2c

• fix

  goliaro

  committed
  6f26214

  Copy full SHA for 6f26214

Commits on Feb 10, 2025

• fix

  goliaro

  committed
  32b526a

  Copy full SHA for 32b526a

• fix

  goliaro

  committed
  2a7b1d0

  Copy full SHA for 2a7b1d0

• fix

  goliaro

  committed
  2176c6b

  Copy full SHA for 2176c6b

• fix test

  goliaro

  committed
  b2d8c8b

  Copy full SHA for b2d8c8b

• format

  goliaro

  committed
  8de1a14

  Copy full SHA for 8de1a14

• cleanup

  goliaro

  committed
  64d6275

  Copy full SHA for 64d6275

• clean

  goliaro

  committed
  a0117e0

  Copy full SHA for a0117e0

Commits on Feb 17, 2025

• update

  goliaro

  committed
  f8d3886

  Copy full SHA for f8d3886

• Merge branch 'inference' into flexllm

  goliaro

  authored
  8f2d8dd

  Copy full SHA for 8f2d8dd

• update

  goliaro

  committed
  6d38983

  Copy full SHA for 6d38983

Commits on Feb 18, 2025

• fix

  goliaro

  committed
  6256118

  Copy full SHA for 6256118

Commits on Feb 21, 2025

• update

  goliaro

  committed
  40a0a53

  Copy full SHA for 40a0a53

Commits on Feb 23, 2025

• Merge branch 'inference' into flexllm

  goliaro

  committed
  a575b0a

  Copy full SHA for a575b0a

• cleanup

  goliaro

  committed
  20488db

  Copy full SHA for 20488db