Skip to content

Commit

Permalink
cleanup
Browse files Browse the repository at this point in the history
  • Loading branch information
goliaro committed Oct 9, 2024
1 parent 6ebd2e9 commit 214b6bc
Showing 1 changed file with 0 additions and 4 deletions.
4 changes: 0 additions & 4 deletions src/runtime/file_loader.cc
Original file line number Diff line number Diff line change
Expand Up @@ -239,10 +239,6 @@ void load_attention_weights_to_dense_v2(DT *ptr,
size_t one_weight_file_size =
num_heads * single_proj_size; // size of each of Q/K/V/O for all heads

std::cout << "hidden_dim: " << hidden_dim
<< ", qkv_inner_dim: " << qkv_inner_dim
<< ", num_heads: " << num_heads << std::endl;

size_t q_size = one_weight_file_size, o_size = one_weight_file_size;
size_t k_size = single_proj_size * num_kv_heads,
v_size = single_proj_size * num_kv_heads;
Expand Down

0 comments on commit 214b6bc

Please sign in to comment.