Skip to content

Commit

Permalink
fix format
Browse files Browse the repository at this point in the history
  • Loading branch information
guocuimi committed Feb 12, 2025
1 parent fac9dcd commit 35ee21a
Showing 1 changed file with 4 additions and 2 deletions.
6 changes: 4 additions & 2 deletions src/kernels/attention/mla_kernel_sm80.cuh
Original file line number Diff line number Diff line change
Expand Up @@ -84,8 +84,10 @@ __global__ __launch_bounds__(Traits::kThreadNum) void mla_kernel_sm80(

// Gmem
// (BLK_M, BLK_K, STAGES)
Tensor gQ = local_tile(Q, Shape<_BLK_M, _BLK_K>{}, make_coord(m_block_idx, _));
Tensor gO = local_tile(O, Shape<_BLK_M, _BLK_K>{}, make_coord(m_block_idx, _));
Tensor gQ =
local_tile(Q, Shape<_BLK_M, _BLK_K>{}, make_coord(m_block_idx, _));
Tensor gO =
local_tile(O, Shape<_BLK_M, _BLK_K>{}, make_coord(m_block_idx, _));
// (BLK_N, BLK_K, n, STAGES)
Tensor gKV = local_tile(KV, Shape<_BLK_N, _BLK_K>{}, make_coord(_, _));

Expand Down

0 comments on commit 35ee21a

Please sign in to comment.