n/futokb
1
0
Fork 0
mirror of https://gitlab.futo.org/keyboard/latinime.git synced 2024-09-28 14:54:30 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity

Fix problem with n_tokens==0

Browse Source
This commit is contained in:
Aleksandras Kostarevas 2023-11-28 16:20:33 +00:00
parent ca9c9d5a9a
commit 854e1295cc
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
native/jni/src/ggml/context.cpp
View File

@ -15,7 +15,7 @@ std::pair<token_sequence, token_sequence::size_type> transformer_context_fastfor
// Handle the case when we have a shorter input than active context, requiring the last
// token to be recomputed to get up-to-date logits
if((npast == next_context.size()) && (next_context.size() < ctx.active_context.size())) {
if((npast == next_context.size()) && (next_context.size() <= ctx.active_context.size())) {
npast -= 1;
}