Alex Terentowicz | 5f752443f9a | 1.4.3 tag increment | | |
Alex Terentowicz | 822aff9309a | fix loading nb in training | | |
Alex Terentowicz | 1a70d58c7db | Pull request #14: Master
Merge in EOSC-RS/nearest-neighbor-finder-training-module from master to dev
* commit '8865... | | |
Alex Terentowicz | 886568c128d | add SBOM.spdx.json | | |
Alex Terentowicz | 402bd166781 | add SBOM | | |
Alex Terentowicz | 28839818f70 | docs update: performance & monitoring | | |
Alex Terentowicz | c3ec8f920ea | Pull request #12: Master
Merge in EOSC-RS/nearest-neighbor-finder-training-module from master to dev
* commit '9179... | | |
Alex Terentowicz | 91795198d2a | code style improvements | | |
Alex Terentowicz | 5517960cb79 | test coverage update - omit exceptions | | |
Alex Terentowicz | 18d585e2144 | test tweaks | | |
Alex Terentowicz | e69ed6f60c3 | test update | | |
Alex Terentowicz | 984c6d47be3 | tests update:
- test async functions (added pytest-async)
- changed README test steps
- omit unneeded files in pytest... | | |
Alex Terentowicz | 2cb0023673f | docs update | | |
Alex Terentowicz | 8dfe31d5a06 | docs update | | |
Alex Terentowicz | dc486636843 | Pull request #11: Dev
Merge in EOSC-RS/nearest-neighbor-finder-training-module from dev to master
* commit '5c11669... | | |
Alex Terentowicz | 5c11669e6d7 | index training bug fix | | |
Paweł Sierota | e65d3da5f40 | Jenkinsfile changes | | |
Alex Terentowicz | 34f9924e1e8 | Pull request #10: Merge Dev
Merge in EOSC-RS/nearest-neighbor-finder-training-module from dev to master
* commit 'e... | | |
Alex Terentowicz | eb13cdd2443 | tag increment 1.4.2 | | |
Alex Terentowicz | b390314803a | docs update | | |
Alex Terentowicz | 1d4baea32ca | changed RESOURCE_LANGUAGES to list | | |
Alex Terentowicz | 10ca8ac0c34 | Pull request #9: Documentation
Merge in EOSC-RS/nearest-neighbor-finder-training-module from documentation to master... | | |
Alex Terentowicz | e3deb94f719 | Pull request #8: Master
Merge in EOSC-RS/nearest-neighbor-finder-training-module from master to documentation
* com... | | |
Alex Terentowicz | 1a5f5f168f7 | docs update | | |
Alex Terentowicz | 11ed3f742a1 | docs update | | |
Alex Terentowicz | bbfae06a6e0 | Pull request #7: Documentation
Merge in EOSC-RS/nearest-neighbor-finder-training-module from documentation to master... | | |
Alex Terentowicz | f8c688bcf40 | docs update | | |
Alex Terentowicz | 1e544bad6f1 | remove unfinished files | | |
Alex Terentowicz | 9537e93ce70 | Pull request #6: 1.4.0 english filter
Merge in EOSC-RS/nearest-neighbor-finder-training-module from 1.4.0-english-fi... | | |
Alex Terentowicz | 7c9f5897c01 | Added details flag to /diag endpoint | | |
Alex Terentowicz | 0c2a37c63ee | Updated Python version to 3.8 | | |
Alex Terentowicz | 8b43c49b04b | added docs | | |
Paweł Sierota | d9804c98ff6 | Switch to the new registry | | |
Alex Terentowicz | d1bdc58cdef | default settings fix | | |
Alex Terentowicz | 7f4e5499886 | Pull request #5: 1.4.0 english filter
Merge in EOSC-RS/nearest-neighbor-finder-training-module from 1.4.0-english-fi... | | |
Alex Terentowicz | fb58cb726ea | 1.4.1 index tag increment | | |
Alex Terentowicz | 003ba57c7dd | fixed resource language filtering | | |
Alex Terentowicz | 51f46469454 | added resource language filtering | | |
Alex Terentowicz | babf8a82ee3 | (1.4.0) new unit tests | | |
Alex Terentowicz | 46520ff186d | (1.4.0) removed unused function in connection | | |
Alex Terentowicz | 27853988893 | (1.4.0) lowered diag log level on incomplete data to info | | |
Alex Terentowicz | b59e5e74297 | (1.4.0) one line logs for unhandled exceptions | | |
Alex Terentowicz | 6748bdaa5da | 1.4.0 tag increment | | |
Alex Terentowicz | f9a31adea11 | exceptions refactor | | |
Alex Terentowicz | 1811e943dcb | Indexer - return to previous default parameters | | |
Alex Terentowicz | 141e7138ab0 | Increased nlist and nbits in indexer | | |
Alex Terentowicz | d849b4a14a0 | bugfix | | |
Alex Terentowicz | 9f49567864f | indexer nlist tweak | | |
Alex Terentowicz | ff1e4bbd886 | Extended debug logging ,removed /test-celery-task | | |
Alex Terentowicz | 77ab75147ae | Celery is down makes NNFTM also down | | |
Alex Terentowicz | b6b3ba1f0ae | Index tag in README | | |
Alex Terentowicz | f29f52f7f65 | Fixed dependencies description in README | | |
Alex Terentowicz | bf4ffd1322a | added data_sources to users_resources | | |
Alex Terentowicz | 0eed48028fc | Removed HDFS data source in training | | |
Alex Terentowicz | c5de2aae0da | - Tables rename (index tag 1.4.0)
- Added table data_sources | | |
Alex Terentowicz | ef087af1268 | - added celery worker check to diag
- minor refactor in worker checks | | |
Alex Terentowicz | 8bf188ccf73 | fixed celery worker availability check | | |
Alex Terentowicz | 37f5f20fc73 | minor change in worker | | |
Alex Terentowicz | bdf6dad4b37 | minor change in worker | | |
Alex Terentowicz | 620fdcc89a1 | Checks if the worker is on before sending the train task | | |
Alex Terentowicz | 72455d192ff | 1.3.2 version tag increment + changes
- style & docstrings | | |
Alex Terentowicz | e91004a1dd7 | exceptions consistent with NNF | | |
Alex Terentowicz | 8bf070c2a78 | fixed logging in worker and on startup of main api | | |
Paweł Sierota | 5b501b2512f | Jenkinsfile - push tagged Docker image to release registry if current commit is tagged | | |
Alex Terentowicz | b3d078d6b8d | expanded diag status INCOMPLETE_DATA checks to postgres | | |
Alex Terentowicz | 8da94d43113 | major rework
- added JSON configuration
- added utils.py
- new HDFS folders
- index tag increment
- several indexer c... | | |
Alex Terentowicz | d21b1bfebe2 | typing fix | | |
Alex Terentowicz | eb2ffd3c176 | LOAD_NEW_DATA.md edited online with Bitbucket | | |
Alex Terentowicz | 38e73d54113 | documentation | | |
Alex Terentowicz | 91a417cebbf | users metadata query fix (no isvalid column) | | |
Alex Terentowicz | 5467f27e440 | users tables config bug fix | | |
Alex Terentowicz | f39ac1f7253 | remove empty emb records from batch in hdfs train | | |
Alex Terentowicz | 5c025243293 | remove empty emb records from batch in pg train | | |
Alex Terentowicz | e0128d5bb3c | 1.3.1 version tag increment | | |
Alex Terentowicz | 3101ce341a7 | HDFS training on parquet files instead of csv | | |
Alex Terentowicz | c65a680517f | Dynamic interval env variable changed to minutes | | |
Alex Terentowicz | 5efb27abea3 | Filtering of invalid resources | | |
Alex Terentowicz | a51781bf941 | LOAD_NEW_DATA.md edited online with Bitbucket | | |
Alex Terentowicz | b38e34ea7a4 | README fix | | |
Alex Terentowicz | 7506f958e02 | minor changes | | |
Alex Terentowicz | 21c4d448173 | added load new data file | | |
Alex Terentowicz | 0a71dac0159 | 1.3.0 tag increment | | |
Alex Terentowicz | 2dffb72b44e | mdlint style fix | | |
Alex Terentowicz | ae4f6d2f3e1 | fixed STRUCTURE.md view | | |
Alex Terentowicz | e467085c41d | updated DEVELOPERS_GUIDE.md | | |
Alex Terentowicz | 10b4f585520 | exceptions update | | |
Alex Terentowicz | a590ad220ab | remove TODO.md | | |
Alex Terentowicz | 8eb21cb3f42 | changelog fix | | |
Alex Terentowicz | 541fe80ce79 | flake8 fix | | |
Alex Terentowicz | c262e741410 | added parent init call to ApiException | | |
Alex Terentowicz | ddeeed4e72e | SQaaS: pylin & flake8 config & style fixes | | |
Alex Terentowicz | beb305c6f72 | - New indexer version:
-- one bidirectional mapping
-- faster sid-iid mapping
-- faster embedding reconst... | | |
Alex Terentowicz | cacf43f47bd | - fixed celery worker error logging | | |
Alex Terentowicz | 54ddd65215a | worker startup updated for new package version | | |
Alex Terentowicz | 1abf770b84f | added tree to STRUCTURE.md | | |
Alex Terentowicz | 4786bc870ad | training fixes
- separate env vars for removing zeroed vectors in users & resources
- HDFS training binary format de... | | |
Alex Terentowicz | 5d910065cfc | changed requirements and test setup | | |
Alex Terentowicz | 89202f4866a | changelog fix | | |
Alex Terentowicz | 9b94b6abd46 | 1.2.3 tag increment | | |
Alex Terentowicz | 5eab5f5e605 | - mdl style fixes
- better logging format
- added max_retries and expiration time to training task | | |
Alex Terentowicz | 2cae46745c6 | mdl style improvements | | |
Alex Terentowicz | 9760d9e0902 | indexer deletion fix | | |
Alex Terentowicz | 91b39af53d9 | added version tag to diag endpoint | | |
Alex Terentowicz | 7b2aef94eb1 | slash removed in diag endpoint URL | | |
Alex Terentowicz | 5bdadfa7a44 | applied Markdownlint | | |
Alex Terentowicz | 5fbb85b0537 | added SQAaaS files:
- CONTRIBUTING
- DEVELOPERS_GUIDE (WIP)
- STRUCTURE (WIP)
- TODO (WIP) | | |
Alex Terentowicz | daf7a9cfef7 | 1.2.2 tag increment | | |
Alex Terentowicz | c49fc1d5076 | added train_all endpoint | | |
Alex Terentowicz | c6b20b37832 | docstrings in core functions | | |
Alex Terentowicz | 4e9db03e957 | added devutils in README | | |
Alex Terentowicz | adea410af83 | added pre-commit | | |
Alex Terentowicz | 91bf41c2c47 | Pull request #4: Temp branch
Merge in EOSC-RS/nearest-neighbor-finder-training-module from temp-branch to master
* ... | | |
Alex Terentowicz | 82e42cdae8d | Fixed training, added pg_count_tablesize function | | |
Alex Terentowicz | 44e817edf7e | docstring updates | | |
Alex Terentowicz | 8a94a9f02b6 | refactor + test setup
- added flake, pylint
- removed mysql support
- added basic test setup
- added basic docstrings... | | |
Alex Terentowicz | 2b2676d5f8b | added Citation, Code of conduct | | |
Alex Terentowicz | b1431e2e4f7 | worker fix | | |
Alex Terentowicz | 315bfd7673f | worker update | | |
Alex Terentowicz | eeea3c3ddc2 | added LICENSE.txt | | |
Alex Terentowicz | 73b89ea2585 | removed mysql support | | |
Alex Terentowicz | 69cad13f7e1 | added version tag log on startup | | |
Alex Terentowicz | 551bbea52f0 | Merge branch '1.2.0-refactor'
add pylint & docstrings | | |
Alex Terentowicz | 124e7ae7f46 | Revert "added nnfinder submodule, pylint & docstrings"
This reverts commit 42e99c25f7e695989c9bb0ca580e878194a26ada. | | |
Alex Terentowicz | 95681e8e6a7 | tag 1.2.1 | | |
Alex Terentowicz | c211bc9888f | added removal of zeroed out vectors when training | | |
Alex Terentowicz | 42e99c25f7e | added nnfinder submodule, pylint & docstrings | | |
Alex Terentowicz | 1491a6197a5 | added docstrings & pylint | | |
Alex Terentowicz | f05337d796f | minor fix, abstracted broker/backend url var name
celery backend url now described as both for redis and rabbitmq | | |
Alex Terentowicz | 95b63934d14 | Release 1.2.0 | | |
Alex Terentowicz | 2800803ff9e | fix to changes from commit e4321f8...788f7 | | |
Alex Terentowicz | 82369776f2c | Release 1.1.1 description, index tag set to 1.1.1 | | |
Alex Terentowicz | 787061bd3be | fastapi docs ui tags and descriptions | | |
Alex Terentowicz | e4321f88a15 | hdfs training metadata from postgres, not mysql | | |
Alex Terentowicz | 8377908a5b8 | dynamic training tables to env variable | | |
Alex Terentowicz | 820e425e8e6 | added dynamic users training | | |
Alex Terentowicz | 65617e1bbf2 | small changes
default logging level to warning
universal 706 error description | | |
Alex Terentowicz | 100c2e6ba74 | dependencies fix | | |
Alex Terentowicz | 0192ded3053 | changed GET /train to PUT /train | | |
Alex Terentowicz | 00e7799bd7c | fix index deletion in hdfs | | |
Alex Terentowicz | 37b7a2ddf31 | fixes
deletet user training from hdfs
fixed deleting old indexes | | |
Alex Terentowicz | 82900d1433f | Pull request #3: Users extended
Merge in EOSC-RS/nearest-neighbor-finder-training-module from users_extended to mast... | | |
Alex Terentowicz | ad9a81c971b | added training of users from pg
actions: ordered, visited
tables: users, users_aai, anon_users
resources: 'datasets'... | | |
Alex Terentowicz | 126dd49d5f1 | minor fixes | | |
Alex Terentowicz | cc2f9751f1d | Pull request #2: Dev
Merge in EOSC-RS/nearest-neighbor-finder-training-module from dev to master
* commit 'be2bf4dc... | | |
Alex Terentowicz | be2bf4dcefc | minor fixes | | |
Alex Terentowicz | b7e57397f97 | add postgres check to diag, pg timeout variable | | |
Alex Terentowicz | aa9b33ebe11 | add logging level | | |
Alex Terentowicz | 222a3812500 | worker & user table names fix | | |
Alex Terentowicz | 96e2399d18c | updated README | | |
Alex Terentowicz | 52fa1be8f45 | Revert "added multiple features:"
This reverts commit d0a8fc61d3c99627dfaa44425247ae38a268cd31. | | |
Alex Terentowicz | d778e084fa0 | Pull request #1: Postgres
Merge in EOSC-RS/nearest-neighbor-finder-training-module from postgres to master
* commit... | | |
Alex Terentowicz | 8848eb4b24b | fixes in postgres training | | |
Alex Terentowicz | 1a41f499101 | added psycopg2 to requirements | | |
Alex Terentowicz | cba22010c47 | moved table properties to config | | |
Alex Terentowicz | 7d2e63c7b7b | added training from postgresql | | |
Paweł Sierota | ee68cb243dc | Jenkinsfile fixes | | |
Paweł Sierota | c04e787a575 | Jenkinsfile - app name fix | | |
Alex Terentowicz | 5f1c8152c6a | added CHANGELOG.md | | |
Alex Terentowicz | 0a91c773aba | Merge branch 'master' of https://git.man.poznan.pl/stash/scm/eosc-rs/nearest-neighbor-finder-training-module | | |
Paweł Sierota | 9898adffffc | Jenkinsfile - some fixes | | |
Paweł Sierota | 6bafd54898e | Jenkinsfile syntax error fix | | |
Paweł Sierota | ffbcfa7d24d | PaaS deployment config for FastAPI added | | |
Paweł Sierota | 2f3628e7349 | Jenkinsfile cleanup | | |
Paweł Sierota | e40544e9220 | Jenkins file added | | |
Alex Terentowicz | d0a8fc61d3c | added multiple features:
- dynamic user training
- kafka index readiness message producer
- binary data read (to be t... | | |
Alex Terentowicz | c43e9a2b036 | several fixes
- Celery config URL parametrization (rabbit broker and redis backend)
- mysql training fix
- indexer m... | | |
Alex Terentowicz | 372ee2e45b1 | expanded diag, added connection timeouts | | |
Alex Terentowicz | 531f9c79b6e | minor fixes | | |
Alex Terentowicz | 268b417a68e | minor fixes of last commit | | |
Alex Terentowicz | 3fc9c175106 | multiple changes
- added training source choice
- updated core folder | | |
Alex Terentowicz | 4a46c01cd71 | added indexer file deletion after 3 latests | | |
Alex Terentowicz | 1f5908ac6d0 | updated README | | |
Alex Terentowicz | b26a6efdf2a | removed volumes in docker-compose | | |
Alex Terentowicz | a2a92a629f8 | code restructure, first deployable version
works with nn-finder v0.4 | | |
Alex Terentowicz | 72beca78e30 | removed poetry & local inst. of redis and rabbitmq | | |
Alex Terentowicz | c4b5376106e | Updated readme | | |
Alex Terentowicz | a1c71f60107 | Initial commit | | |
Done |