Commit Graph

1456 Commits

Author SHA1 Message Date
Aleksandras Kostarevas
7aea41eede Add decomposeTapPosition fallback for nonintersecting cases 2024-01-22 08:21:27 +02:00
Aleksandras Kostarevas
5e0722c984 Fix issue with apostrophe token being banned 2024-01-22 08:20:55 +02:00
Aleksandras Kostarevas
dbad61d2e6 Fix non-English dictionary prediction 2024-01-16 21:02:55 +02:00
Aleksandras Kostarevas
55d5959f54 Skip non-alphabetic characters during mixing 2024-01-09 18:25:14 +02:00
Aleksandras Kostarevas
ebb70b9c12 Fix build, disable gesture input pending model update 2023-12-19 20:28:58 +02:00
Aleksandras Kostarevas
4e9e86d871 Implement multimodal position encoder 2023-12-19 20:02:20 +02:00
Aleksandras Kostarevas
314cf8c84c Type out whisper.cpp result 2023-12-05 18:06:12 +00:00
Aleksandras Kostarevas
7075c22179 Add key embedding mixing 2023-12-04 20:09:51 +00:00
Aleksandras Kostarevas
4f15ff4a73 Add experimental swipe typing 2023-11-28 17:01:58 +00:00
Aleksandras Kostarevas
854e1295cc Fix problem with n_tokens==0 2023-11-28 16:20:33 +00:00
abb128
ca9c9d5a9a ggml backend v2 2023-11-25 09:39:04 +02:00
abb128
f31db527d6 Add whisper.cpp 2023-11-25 09:13:50 +02:00
Aleksandras Kostarevas
001f1eb442 Disable debug flag 2023-11-21 20:33:21 +02:00
Aleksandras Kostarevas
cb2edca601 Update training hyperparameters 2023-11-21 17:07:43 +02:00
Aleksandras Kostarevas
14fcb55565 Save LoRA-merged model after training 2023-11-14 20:40:00 +02:00
Aleksandras Kostarevas
2409eecef5 Loss/progress training callbacks 2023-11-14 18:11:00 +02:00
Aleksandras Kostarevas
b53a46b18d Move training to CoroutineWorker 2023-11-14 17:23:08 +02:00
Aleksandras Kostarevas
38b06d7909 History logging and training based on log 2023-11-14 11:43:36 +02:00
Aleksandras Kostarevas
0e0876f06c Revise training 2023-11-13 16:42:01 +02:00
Aleksandras Kostarevas
ee8a81f12c Initial fine-tuning 2023-11-07 16:48:48 +02:00
Aleksandras Kostarevas
5778cd15a0 Update ggml and llama.cpp 2023-11-06 13:41:25 +02:00
Aleksandras Kostarevas
7c4531e32d Fix crashes related to too large context 2023-10-16 18:24:00 +03:00
Aleksandras Kostarevas
c73fe16ddc Add q8 model 2023-10-16 17:31:43 +03:00
Aleksandras Kostarevas
92480fd460 Adjust space probability and mustNotAutocorrect 2023-10-13 18:44:38 +03:00
Aleksandras Kostarevas
c34a411989 Fix infinite prediction loop 2023-10-13 18:34:49 +03:00
Aleksandras Kostarevas
b8539ce88a Initial batched inference using llama_batch 2023-10-10 22:34:04 +03:00
Aleksandras Kostarevas
6d17f00296 Update llama.cpp 2023-10-10 22:32:25 +03:00
Aleksandras Kostarevas
16fdb3629d Add LanguageModel class 2023-09-28 19:42:29 +03:00
Aleksandras Kostarevas
ea0af67ecc Add ggml, sentencepiece and dependencies 2023-09-28 19:41:05 +03:00
abb128
434f8b6b27 Initial working build of fork 2023-07-06 21:57:49 +03:00
Jing Mike
03eef94a8d Remove unused variables
Since some variables with module LatinIME are defined but not used,
when compiled with build combination "sdk_pc_x86_64-userdebug" and
build command "mmm packages/inputmethods/LatinIME", the following
code lines will be reported that "variable 'XXX' set but not used".
(should be similar for all the other build combinations)

Repeated 10 times for each:
terminal_position_lookup_table.cpp:74:9 removedEntryCount
terminal_position_lookup_table.cpp:85:9 removedEntryCount
proximity_info_state_utils.cpp:493:9 tempTime
trie_map.cpp:56:9 unusedRegionSize
suggestion_results.cpp💯9 index

Repeated 80+ times:
proximity_info_utils.h:75:25 proximityChar

With this patch we are removing some of the unused variables and
putting the C++ 17 attribute [[maybe_unused]] to the others which
are used for logging. Then all the related build warnings have been
eliminated.

Test: mmm packages/inputmethods/LatinIME, presubmit check.

Change-Id: Ia66766322d6ae8a010b1cb55cc22993fbc6d012c
Signed-off-by: Jing Mike <jingyangliu@eswincomputing.com>
2023-03-19 10:00:01 +00:00
Bob Badour
f3d9532a32 [LSC] Add LOCAL_LICENSE_KINDS to packages/inputmethods/LatinIME
Added SPDX-license-identifier-Apache-2.0 to:
  Android.bp
  common/Android.bp
  java/Android.bp
  native/dicttoolkit/Android.bp
  native/jni/Android.bp
  tests/Android.bp
  tools/EditTextVariations/Android.bp
  tools/dicttool/Android.bp
  tools/make-keyboard-text/Android.bp

Bug: 68860345
Bug: 151177513
Bug: 151953481

Test: m all

Exempt-From-Owner-Approval: janitorial work
Change-Id: I440008bffac5c97a2497970af377a9d03262b6d8
2021-02-17 09:46:27 -08:00
Treehugger Robot
e04480b68b Merge "Mark liblatinime_unittests as unit_test:true to run in presubmit in CI" 2021-02-17 10:24:20 +00:00
Julien Desprez
b19114e93b Mark liblatinime_unittests as unit_test:true to run in presubmit in CI
This will ensure that the target stays green.
Note: we will clean up the explicit unit_tests:true once cc_test default is changed.

Change-Id: I5153ca918e94b370b1f08289118877d209385ba2
Test: presubmit
Bug: 180014759
2021-02-16 18:31:04 +00:00
Adrian Roos
8b3d8f48e1 Fix broken liblatinime_unittests
Change-Id: I95021965ecc2699fbce01ed0552dd28fed7f8fe4
Merged-In: I95021965ecc2699fbce01ed0552dd28fed7f8fe4
Fixes: 180014759
Test: atest liblatinime_unittests --host
2021-02-16 17:49:08 +00:00
Seigo Nonaka
0c549e7424 Update language to comply with Android’s inclusive language guidance
See https://source.android.com/setup/contribute/respectful-code for reference

Bug: 161896447
Test: tapas LatinIME && m
Change-Id: Ic06f948c023a091e1532db826a78dd01031d7205
2020-07-31 11:28:59 -07:00
Jeff Sharkey
1d9bf42009 Update language to comply with Android's inclusive language guidance
See https://source.android.com/setup/contribute/respectful-code for reference

Bug: 161896447
Change-Id: I171bc299e660f96f20041a67a3052bd8a2ed781c
2020-07-31 09:33:35 -06:00
Orion Hodson
54c4f2afb5 Add explicit dependencies on jni_headers
Preparation for removing implicit include paths for jni.h from soong.

Bug: 152482542
Test: lunch aosp_x86_64 && m checkbuild
Change-Id: Ib36e679819a3309ccbf12fd592309b16c8bbd6c8
2020-04-13 17:15:59 +01:00
Anton Hansson
575340c674 Merge "Move LatinIME and its lib to /product" am: 149b9d4f6e am: 84d156b1e6
am: d894eec1ee

Change-Id: Ib7cdb0007c22934f7736cd02c02e0f9358f889d4
2019-01-14 02:11:11 -08:00
Anton Hansson
1c429e3a09 Move LatinIME and its lib to /product
This app is frequently overriden by proprietary apps
on shipping devices, so move it to /product along with
its jni library.

Bug: 122353713
Test: launch keyboard on aosp_arm64 emulator
Change-Id: Ied8c1e6133b67e28da76b0e48254e2e2e0ed15bf
2019-01-11 15:20:31 +00:00
Chih-Hung Hsieh
f7b80bb317 Merge "Fix performance-for-range-copy warnings" am: db2e4888f8 am: 947f8ee063
am: 535cd61e63

Change-Id: Ic8ee8523a644b283ef0c9592bb66bf09ca541485
2018-12-11 16:36:28 -08:00
Chih-Hung Hsieh
895bf97d22 Fix performance-for-range-copy warnings
Bug: 30413223
Test: make with WITH_TIDY=1 DEFAULT_GLOBAL_TIDY_CHECKS=-*,performance*
Change-Id: I06021a6597705515dc7a3cb81a7fbbac7ba344a1
2018-12-11 10:40:46 -08:00
Dan Willemsen
a23407bf62 Convert to Android.bp
See build/soong/README.md for more information.

Test: cd packages/inputmethods/LatinIME; mma
Change-Id: Ib8867d3b74f09fc1d9f95adc9a49a81ac0f7f054
Merged-In: Ib8867d3b74f09fc1d9f95adc9a49a81ac0f7f054
2018-11-01 23:09:33 +00:00
Dan Willemsen
22ebec6e2e Convert to Android.bp
See build/soong/README.md for more information.

Test: cd packages/inputmethods/LatinIME; mma
Change-Id: Ib8867d3b74f09fc1d9f95adc9a49a81ac0f7f054
2018-10-31 21:49:02 -07:00
Chih-Hung Hsieh
17116a6ce8 Merge "Add noexcept to move constructors and assignment operators." am: 61d3a1d39b am: 587239f195
am: 9c58fe67f0

Change-Id: I926433188e61eef7f4947167e51b1afae407d9fc
2018-10-05 12:43:33 -07:00
Chih-Hung Hsieh
66a88a5eae Add noexcept to move constructors and assignment operators.
Bug: 116614593
Test: build with WITH_TIDY=1
Change-Id: Ic2a04f82f36c2f7fe43109a7a74270044d227789
2018-09-25 14:32:36 -07:00
Yohei Yukawa
3d74fc73a8 Fix lint warnings in LatinIME JNI code
This CL addresses compiler warnings when building libjni_latinime.so
with NDK from Android Studio.

There should be no behavior change.

Bug: 110741422
Bug: 110757803
Test: tapas LatinIME LatinIMETests arm64 userdebug && make -j
Change-Id: Icc711dd46511a167b1fd90028552def5b2f9941f
2018-07-25 17:11:00 -07:00
Yohei Yukawa
f4131e3f53 Deprecate host-side C++ test in LatinIME
Host-side C++ test in LatinIME is no longer actively used and is
actually not compatible with Android Studio build.

Let's just remove this for now.

Bug: 13754552
Bug: 110741422
Test: compile
Change-Id: I3e81285fe559022e1a296051036e74d2f2afbf9c
2018-07-25 14:38:58 -07:00
Chih-Hung Hsieh
fab2c3c0ea Use -Werror in packages/inputmethods/LatinIME/native/jni
Bug: 66996870
Test: build with WITH_TIDY=1
Change-Id: I6b91302908e147077bb4fd0a8718c39357337133
2017-11-02 10:18:54 -07:00
Chih-Hung Hsieh
1da7b0c5bb Use -Werror in packages/inputmethods/LatinIME/native/jni
* Suppress warning on unused loop index variable.

Bug: 66996870
Test: build with WITH_TIDY=1
Change-Id: Ia3f0f9cc4cb0ebeeac9b1ff51955597a725c87ef
2017-10-20 15:19:55 -07:00