 Marcin Rochowiak | 38c79783136 | RS-403 verify new OAG dump | | |
Marcin Rochowiak | 187dc14f0ab | RS-403 verify new OAG dump | | |
Marcin Rochowiak | a98dba316b0 | Pull request #22: Develop
Merge in EOSC-RS/preprocessor from develop to master
* commit 'ef3b118535fd283c3f01d49438... | | |
Marcin Rochowiak | ef3b118535f | Pull request #21: Feature/publishing user changes
Merge in EOSC-RS/preprocessor from feature/publishing-user-changes... | | |
Marcin Rochowiak | 085ca7f8883 | RS-401 publishing users&services changes | | |
Maciej Łabędzki | 50b0397d724 | RS-402 empty commit to trigger a master build-n-deploy pipeline | | |
Maciej Łabędzki | d47d91feb80 | RS-402 Jenkinsfile-buildanddeploy updated - fixed building application.jar | | |
Marcin Rochowiak | b3a97b09101 | Merge remote-tracking branch 'origin/master' | | |
Marcin Rochowiak | 1134d1d6f9c | RS-329 update CHANGELOG | | |
Marcin Rochowiak | 991931fc83a | Pull request #20: Develop
Merge in EOSC-RS/preprocessor from develop to master
* commit '402b290bcf312996daed4d681b... | | |
Marcin Rochowiak | 6e5de54fe8c | RS-401 publishing User changes | | |
Marcin Rochowiak | 402b290bcf3 | RS-329 modify properties - Trainings Job | | |
Marcin Rochowiak | 2dea4edee3b | RS-329 add fields to Trainings | | |
Marcin Rochowiak | 4a05d6be4f9 | RS-329 add fields to Trainings | | |
Maciej Łabędzki | 8f09a0caedf | Pull request #19: Develop
Merge in EOSC-RS/preprocessor from develop to master
* commit '2179042ca85a79c58ae2120597... | | |
Maciej Łabędzki | 2179042ca85 | RS-392 fixed 'main-class' property in application.properties | | |
Maciej Łabędzki | dcb8b16be67 | RS-392 usage_counts_downloads and usage_counts_views supported by OagResourcesPreprocSparkJob.java | | |
Maciej Łabędzki | 07718549d82 | Pull request #18: Develop
Merge in EOSC-RS/preprocessor from develop to master
* commit 'cde4349c458db96486fa5b8073... | | |
Maciej Łabędzki | b0e214b2ce9 | RS-385 Spark applications' names with proper values | | |
Maciej Łabędzki | cde4349c458 | RS-385 new Maven module "commons-testing" | | |
Maciej Łabędzki | fe26d0f5448 | RS-385 OagResourcesPreprocSparkJob.java suppports a new JSONL data dumps format | | |
Maciej Łabędzki | f3afa469c0a | RS-385 fixed Dockerfile - Spatk TGZ file URL replaced with a permanent link | | |
Maciej Łabędzki | 86a4946b9be | RS-385 fixed TrainingsMappingTest.java and TrainingsTransformationTest.java | | |
Maciej Łabędzki | a38db05363d | RS-385 RandomUserPicker.java fixed to always have a non-empty collection of cached users | | |
Maciej Łabędzki | c545af6887b | RS-385 Jenkinsfile-onlybuild - java and maven version printing | | |
Maciej Łabędzki | a49ba8460d0 | RS-385 Jenkinsfile-onlybuild - `maven clean install -U` instead of `maven package` | | |
Marcin Rochowiak | d3dcdea3e60 | RS-385 fix Spark IP address - test | | |
Marcin Rochowiak | 63971d9fc1a | RS-385 fix SparkSession | | |
Marcin Rochowiak | 7ca7bfb3381 | RS-400 user interests removed from US | | |
Marcin Rochowiak | 8d8dd1d6699 | RS-385 renamed columns - trainings | | |
Marcin Rochowiak | e96d8a2f5fd | RS-385 update properties | | |
Marcin Rochowiak | 8dc771554f6 | RS-385 adjust trainings processing | | |
Maciej Łabędzki | 65c3ac2a20d | RS-385 extended tests for OARG processing | | |
Maciej Łabędzki | f4afc7a00c2 | RS-385:
- enabled OagResourcesPreprocSparkJobTest.java which has never been launched in maven builds because of pom.... | | |
Maciej Łabędzki | 1a60115b62a | RS-182 dumps-get-file.sh | | |
Maciej Łabędzki | a1cb53303ad | RS-182 fixed resource name param values in job-run-processing-*.sh scripts | | |
Maciej Łabędzki | 315a776d3ef | RS-382 CHANGELOG.md update | | |
Maciej Łabędzki | db2b1455b6b | RS-182 Operations.md and utility scripts added to the CHANGELOG.md | | |
Maciej Łabędzki | 2b9c6e8cec5 | RS-182 job-run-processing-TRAININGS.sh and job-run-processing-resources.sh do really call the REST API instead of jus... | | |
Maciej Łabędzki | cd10e7fab33 | RS-182 fix in job-run-transferring-dumps.sh | | |
Maciej Łabędzki | a693c88397e | Pull request #17: Develop
Merge in EOSC-RS/preprocessor from develop to master
* commit '4db8a19922c1882b29bd90a865... | | |
Maciej Łabędzki | 4db8a19922c | Pull request #16: Feature/hadoop ops
Merge in EOSC-RS/preprocessor from feature/hadoop-ops to develop
* commit 'f9e... | | |
Maciej Łabędzki | f9e519c2110 | RS-382 changed logging level of UserActionsPublisherImpl#publish from INFO to DEBUG | | |
Maciej Łabędzki | 1ac3a4fc878 | RS-182: job-run-processing-TRAININGS.sh | | |
Maciej Łabędzki | 2f16df175fc | RS-182: usage info in scripts | | |
Maciej Łabędzki | 5919fc1be82 | RS-182: scripts processing resources | | |
Maciej Łabędzki | 80db8aa5efe | RS-182: documentation more consistent | | |
Maciej Łabędzki | b9c4ed238ae | RS-182: dumps-size.sh and dumps-transfer.sh | | |
Maciej Łabędzki | 76371b974b9 | RS-182: dumps-ls.sh, Operations.md update, hadoop.sh refactored to print executed commands | | |
Maciej Łabędzki | aa076ea2e1b | RS-182:
- generating a web-view urls in jobfile-push-to-cluster.sh,
- Operations.md updated with utility script int... | | |
Maciej Łabędzki | dd55c6d184d | RS-182 Operations.md restructured, more todo-s | | |
Maciej Łabędzki | ec656622d6c | RS-182 jobfile-push-to-cluster.sh and Operations.md update | | |
Maciej Łabędzki | caaebdbf545 | RS-182 Operations.md and hadoop.sh wrapper utility as base for automating actions taken on Hadoop cluster | | |
Marcin Rochowiak | ac19473a888 | Merge remote-tracking branch 'origin/feature/sparkjob_processing' into feature/sparkjob_processing | | |
Marcin Rochowiak | 0b8d0518155 | RS-385 process JSON data | | |
Marcin Rochowiak | 803b3634f2d | RS-385 process JSON data | | |
Marcin Rochowiak | c164f6acdde | Merge remote-tracking branch 'origin/master' | | |
Marcin Rochowiak | 44b78236d62 | RS-385 modify properties - spark.job.oag-resources.jar-file | | |
Maciej Łabędzki | 735b2e153f8 | RS-382 renamed Maven modules | | |
Maciej Łabędzki | 309bb1f3bb9 | RS-382 extracted Mode.java and made "application" depend on "s3-to-hdfs-transfer-sparkjob" Maven dependency | | |
Maciej Łabędzki | 0ab6783f8c0 | RS-382 added logging messages in S3ToHdfsTransferSparkJob to improve traceability | | |
Maciej Łabędzki | 787dff4067f | RS-382 golden master test for S3ToHdfsTransferSparkJob | | |
Maciej Łabędzki | d49f777c9d4 | Pull request #15: RS-378 Jenkinsfile split into Jenkinsfile-buildanddeploy and Jenkinsfile-onlybuild
Merge in EOSC-R... | | |
Maciej Łabędzki | d947b945685 | RS-378 Jenkinsfile split into Jenkinsfile-buildanddeploy and Jenkinsfile-onlybuild | | |
Marcin Rochowiak | 31aee42c626 | Pull request #14: Develop
Merge in EOSC-RS/preprocessor from develop to master
* commit '432683d5a733aae43e8e79e724... | | |
Marcin Rochowiak | 432683d5a73 | RS-374 add JavaDocs | | |
Marcin Rochowiak | af2701df047 | RS-374 update CHANGELOG.md | | |
Marcin Rochowiak | 13392d29cd2 | RS-374 add User's interests to User Session | | |
Marcin Rochowiak | 7985e71ddb6 | RS-373 support for Other Research Products | | |
Marcin Rochowiak | b1a715f8c0b | RS-368 User Session simulator - DB optimization | | |
Marcin Rochowiak | bf081ed9f46 | RS-368 User Session simulator | | |
Marcin Rochowiak | 5ac474bc8be | RS-316 Sync Services | | |
Marcin Rochowiak | c9c0bf1f2fd | RS-315 Sync Users | | |
Marcin Rochowiak | 3680250943a | RS-315 Sync Users | | |
Marcin Rochowiak | a17a9da3e94 | RS-315 Sync Users | | |
Marcin Rochowiak | 32eb22c1775 | RS-329 message converter - new UA's format | | |
Maciej Łabędzki | 20284ff365b | RS-320 Introduction, links and implemented features in README.md | | |
Marcin Rochowiak | 3b01cacdf3e | Merge remote-tracking branch 'origin/master' | | |
Marcin Rochowiak | 894c0d4407c | RS-317 refactoring | | |
Marcin Rochowiak | 22b76f4d2fe | Pull request #13: RS-313 add resource - Software / update sql scripts
Merge in EOSC-RS/preprocessor from RS-141_User... | | |
Marcin Rochowiak | 6c23afafaab | RS-313 add resource - Software / update sql scripts | | |
Marcin Rochowiak | 49c5cbc32fa | Pull request #12: RS-141 User Action
Merge in EOSC-RS/preprocessor from RS-141_User_Action to master
* commit '17b7... | | |
Marcin Rochowiak | 17b77d4b437 | Pull request #11: RS-302 Postgres migration
Merge in EOSC-RS/preprocessor from RS-302_Postgres_migration to RS-141_U... | | |
Marcin Rochowiak | 127f364f01a | RS-310 up-to-date data | | |
Marcin Rochowiak | 432176b9129 | RS-312 partition search for resources | | |
Marcin Rochowiak | e7dc96690e8 | RS-311 procedure - refresh Materialized Views | | |
Marcin Rochowiak | 52ac3aee9ea | Pull request #10: RS-302 Postgres migration
Merge in EOSC-RS/preprocessor from RS-302_Postgres_migration to master
... | | |
Marcin Rochowiak | 034b2a06da3 | Merge branch 'master' into RS-302_Postgres_migration | | |
Marcin Rochowiak | 0d4f2f49d85 | Merge remote-tracking branch 'origin/RS-302_Postgres_migration' into RS-302_Postgres_migration | | |
Marcin Rochowiak | 7ecf106f3c7 | RS-302 migration - PostgreSQL | | |
Marcin Rochowiak | 6bc4d5bae47 | RS-302 add resource type to Postgres DB | | |
Marcin Rochowiak | 382c8b52bcf | Pull request #9: RS-303 add trainings - UA generator
Merge in EOSC-RS/preprocessor from RS-141_User_Action to master... | | |
Marcin Rochowiak | 2e49d3f52d1 | RS-303 add trainings - UA generator | | |
Paweł Dziubiński | 23cc74a5696 | Usunięto niepotrzebny argument w api diagnostycznym | | |
Paweł Dziubiński | 4b39866ad56 | dodano przetwarzanie treningów do diagnostycznego api | | |
Marcin Rochowiak | 52a1d44b611 | RS-302 add resource type to Postgres DB | | |
Paweł Dziubiński | 2adedd2ab11 | RS-301 OAG Resources Preprocessing refactored + json oag schema reading implemented | | |
Marcin Rochowiak | e54025e486f | Pull request #8: RS-141 User Action
Merge in EOSC-RS/preprocessor from RS-141_User_Action to master
* commit 'c36aa... | | |
Marcin Rochowiak | c36aa48bc6d | RS-297 fix duplicated config | | |
Marcin Rochowiak | a9dd8afbfec | Merge remote-tracking branch 'origin/master' into RS-141_User_Action | | |
Marcin Rochowiak | 0aed976bd52 | RS-262 RS-298 UA backup & profiles | | |
Paweł Dziubiński | 75784c7d844 | Merge branch 'master' of ssh://git.man.poznan.pl:7999/eosc-rs/preprocessor | | |
Paweł Dziubiński | 2ae23bcfc3d | RS-297 Training preprocessing implemented | | |
Marcin Rochowiak | 1d1ff9dd312 | Pull request #7: RS-141 User Action
Merge in EOSC-RS/preprocessor from RS-141_User_Action to master
* commit 'e3a35... | | |
Marcin Rochowiak | e3a35c7a107 | Merge remote-tracking branch 'origin/master' into RS-141_User_Action
# Conflicts:
# application/src/main/java/pl/psn... | | |
Marcin Rochowiak | e6d33cf7790 | RS-260 first part of UA generator | | |
Marcin Rochowiak | 79f04707cbd | RS-294 Update Spark - Docker | | |
Marcin Rochowiak | b1f5d6bbc2b | RS-261 fix date validation | | |
Marcin Rochowiak | 04c0fdd6787 | RS-261 fix date validation | | |
Marcin Rochowiak | 1da291d501e | RS-240 serviceId for stats | | |
Marcin Rochowiak | 3974ee25047 | RS-239 session remover | | |
Marcin Rochowiak | 27f0c24415d | RS-233 Data Bus - publish stats | | |
Marcin Rochowiak | 649ef0e8626 | Pull request #6: RS-232 Kafka
Merge in EOSC-RS/preprocessor from RS-232_Kafka to RS-141_User_Action
* commit 'c416e... | | |
Marcin Rochowiak | c416e4a1db8 | RS-232 add key to Kafka Msg 2 | | |
Marcin Rochowiak | 3c986337310 | RS-232 add key to Kafka Msg | | |
Marcin Rochowiak | 2b62000f5de | Merge remote-tracking branch 'origin/master' | | |
Marcin Rochowiak | 3d91a77288c | RS-231 Dockerfile check certificate | | |
Marcin Rochowiak | 04fd99e44fc | RS-231 | | |
Marcin Rochowiak | e4f2977e272 | Pull request #5: RS-141 User Action - statistics
Merge in EOSC-RS/preprocessor from RS-141_User_Action to master
* ... | | |
Marcin Rochowiak | 08080b514ff | PR suggestions | | |
Marcin Rochowiak | 58721b752d0 | RS-227 change app port in test | | |
Marcin Rochowiak | 7b0266c2dda | RS-228 remove variables from test properties | | |
Marcin Rochowiak | 58e8d880fef | Merge remote-tracking branch 'origin/master' into RS-141_User_Action
# Conflicts:
# application/pom.xml
# applicatio... | | |
Marcin Rochowiak | f20e72114cf | RS-184 user recognition | | |
Marcin Rochowiak | 2b5cde9a84d | RS-229 Dockerfile - hadoop | | |
Marcin Rochowiak | 41ab6d772c3 | RS-227 clean up - remove Redis | | |
Marcin Rochowiak | 670ee52fc10 | RS-228 update env vars | | |
Marcin Rochowiak | 65faf7321e4 | RS-227 RS-183 UA statistics and tests | | |
Paweł Dziubiński | d3e5497a2da | Diagnostic Api extended | | |
Paweł Dziubiński | ec373c57ad4 | RS-226 urls and emails token substitution implemented | | |
Paweł Sierota | 5c70a486880 | Jrnkinsfile added | | |
Paweł Dziubiński | 4c5ec3e97a5 | RS-224 | | |
Paweł Dziubiński | d69ffe72544 | RS-224 fix "invalid null input: name" | | |
Paweł Dziubiński | b77ef5982cf | RS-224 fix "basedir must be absolute: ?/.ivy2/local" | | |
Paweł Dziubiński | 618a8bee1c7 | RS-223 run-s3-to-hdfs diagnostic endpoint added | | |
Paweł Dziubiński | 4ecbc0a783d | RS-211 hdfs driver initialization error fix | | |
Paweł Dziubiński | 9d12d532092 | Pull request #4: RS-214 yarn driver
Merge in EOSC-RS/preprocessor from RS-214-yarn-driver to master
* commit 'cd146... | | |
Paweł Dziubiński | cd1465ae337 | Fix after merge | | |
Paweł Dziubiński | 77ac7456371 | Merge branch 'master' of ssh://git.man.poznan.pl:7999/eosc-rs/preprocessor into RS-214-yarn-driver | | |
Paweł Dziubiński | 213b807226a | Build fix | | |
Marcin Rochowiak | 1fd8c3c7556 | Pull request #3: RS-141 User Action
Merge in EOSC-RS/preprocessor from RS-141_User_Action to master
* commit '58a7d... | | |
Marcin Rochowiak | 0d9d4e8038b | Merge remote-tracking branch 'origin/master' into RS-141_User_Action | | |
Marcin Rochowiak | 58a7d55c122 | move UAs | | |
Paweł Dziubiński | 355c90a1431 | Build fix | | |
Paweł Dziubiński | 49af583b1ac | RS-214 removed duplicated test | | |
Paweł Dziubiński | c0468af8c8a | RS-214 exception mapping | | |
Paweł Dziubiński | 49b9386dcb6 | RS-214 resource manager driver - yarn driver impl | | |
Marcin Rochowiak | dcdef16f5d6 | RS-210 validator | | |
Marcin Rochowiak | cfc64b40b0f | fix after merge | | |
Marcin Rochowiak | e9b41db7ecb | Merge remote-tracking branch 'origin/master' into RS-141_User_Action
# Conflicts:
# application/pom.xml
# applicatio... | | |
Marcin Rochowiak | 6cdb3a6d981 | RS-141 User Action properties | | |
Marcin Rochowiak | 5817a83e02b | Merge remote-tracking branch 'origin/RS-141_User_Action' into RS-141_User_Action
# Conflicts:
# application/pom.xml
... | | |
Marcin Rochowiak | 718496e47c9 | RS-141 RS-210 User Action refactor and comprehensive behavior change | | |
Paweł Dziubiński | 716c271a111 | RS-219 SparkJobFinalStatusForwardingListener refactored | | |
Paweł Dziubiński | 7573d890965 | RS-219 DatasetsPreprocJobLauncher fix | | |
Paweł Dziubiński | 3265ca79ef9 | RS-219 Spark Job Launchers Refactoring | | |
Paweł Dziubiński | 9bbcc1d593e | RS-215 Now 3sToHDFS Job can copy multiple files into multiple paths or into single directory | | |
Paweł Dziubiński | 0a8c3a4a8d1 | RS-211 hdfs driver impl - webhdfs | | |
Paweł Dziubiński | 939962142fd | RS-180 JVM memory params removed from run.sh | | |
Marcin Rochowiak | ed047d4adf0 | Rs-171 RS-172 Rs-177 | | |
Marcin Rochowiak | 6eb3413f83e | RS-144 modified processing of User Action | | |
Marcin Rochowiak | 226d5c98817 | RS-142 basic processing of User Action | | |
Marcin Rochowiak | 2ba400a0f40 | Rs-171 RS-172 Rs-177 | | |
Marcin Rochowiak | fa2e0c95a36 | RS-144 modified processing of User Action | | |
Marcin Rochowiak | b6a28e64bea | RS-142 basic processing of User Action | | |
Paweł Dziubiński | 4d135d91606 | Pull request #2: RS-194 searchservice api driver
Merge in EOSC-RS/preprocessor from RS-194_searchservice_api_driver ... | | |
Paweł Dziubiński | 9ba55f3ba2f | RS-194 package moved drivers/searchservice -> drivers/impl/searchservice | | |
Paweł Dziubiński | 31ce736e003 | RS-194 SearchService API Driver response extended | | |
Paweł Dziubiński | 1309399590b | RS-194 Search Service API Driver implemented | | |
Marcin Rochowiak | d4fd9feb0f1 | Pull request #1: Feature/dockerize
Merge in EOSC-RS/preprocessor from feature/dockerize to master
* commit 'f40db92... | | |
Marcin Rochowiak | f40db92c9c8 | RS-200 gitignore | | |
Marcin Rochowiak | 406d0b076e1 | RS-200 dockerignore | | |
Marcin Rochowiak | 4acd598f537 | Merge remote-tracking branch 'origin/master' into feature/dockerize | | |
Marcin Rochowiak | cb094aae41b | RS-200 docker Env Vars | | |
Paweł Dziubiński | 18758db36cf | RS-175 few small problems fixed | | |
Marcin Rochowiak | 4c424118c6e | RS-192 RS-193 docker-compose MySQL Kafka Kafdrop | | |
Marcin Rochowiak | fa2ef5ce3a0 | RS-180 reduced docker size | | |
Marcin Rochowiak | 23b6ea97922 | RS-180 docker remove Hadoop | | |
Marcin Rochowiak | 211c5d1bbf2 | RS-180 docker fat image | | |
Marcin Rochowiak | 6e5a86b0bcf | Rs-171 RS-172 Rs-177 | | |
Paweł Dziubiński | 5da268e0683 | RS-175 Datasets processing adapted to new csv format | | |
Paweł Dziubiński | 28205160705 | RS-170 S3toHdfsTransferSparkJob added | | |
Paweł Dziubiński | 83fc35e2040 | RS-169 Dataset Preproc Spark Job launcher added + packages organized | | |
Paweł Dziubiński | 31e5f4ac851 | RS-167 Dataset preproc spark job tests added + wordremover test added | | |
Paweł Dziubiński | 9c7bcb27dc7 | RS-167 Datasets processing separated into spark-job application | | |
Marcin Rochowiak | 23628b8d01a | RS-144 modified processing of User Action | | |
Marcin Rochowiak | a935d316b82 | RS-142 basic processing of User Action | | |
Paweł Dziubiński | 9c8f75f8963 | RS-139 dodano kolumne "languageCode" wyniku przetwarzania datasetow | | |
| Next → |
