Marcin Rochowiak ef5f3271ad0 RS-442 add empty arg - previousDumpDir 31 Jul 2023 RS-442 Marcin Rochowiak d4b3e720548 M Pull request #37: Feature/dump diff processing Merge in EOSC-RS/preprocessor from feature/dump-diff-processing to develop
* commit 'e4e7df4846594b88e8e89d93b9f54225322745d4':
RS-442 disable psql updater test
RS-442 disable psql updater test
RS-442 update psql test properties in psql updater job
RS-442 update psql test properties in psql updater job
RS-442 disable Training Job Test
RS-442 fix db updater
RS-442 update basic job... 31 Jul 2023 2 Jira issuesMarcin Rochowiak e4e7df48465 RS-442 disable psql updater test 31 Jul 2023 RS-442 Marcin Rochowiak 900d3b6ef26 RS-442 disable psql updater test 31 Jul 2023 RS-442 Marcin Rochowiak 8d2e2557f25 RS-442 update psql test properties in psql updater job 31 Jul 2023 RS-442 Marcin Rochowiak c086b8772b7 RS-442 update psql test properties in psql updater job 31 Jul 2023 RS-442 Marcin Rochowiak 4d828e56bf4 RS-442 disable Training Job Test 31 Jul 2023 RS-442 Marcin Rochowiak e640d2c6963 RS-442 fix db updater 31 Jul 2023 RS-442 Marcin Rochowiak 30ee714ac3d M Merge remote-tracking branch 'origin/develop' into feature/dump-diff-processing # Conflicts:
# marketplace-resources-preproc-sparkjob/src/main/java/pl/psnc/eosc/rs/preprocessor/job/marketplace/MarketplaceResourcesPreprocSparkJob.java
# oag-resources-preproc-sparkjob/src/main/java/pl/psnc/eosc/rs/preprocessor/oag/job/OagResourcesPreprocSparkJob.java
# spark-shared-processing/src/main/java/pl/psnc/eosc/rs/preprocessor/shared/SparkSharedResourcesPreprocessing.java
# trainings... 31 Jul 2023 Marcin Rochowiak ab70042eab0 M Merge remote-tracking branch 'origin/develop' into feature/dump-diff-processing # Conflicts:
# application/src/main/java/pl/psnc/eosc/rs/preprocessor/app/context/spark/processing/ProcessingBrokerImpl.java
# marketplace-resources-preproc-sparkjob/src/main/java/pl/psnc/eosc/rs/preprocessor/job/marketplace/MarketplaceResourcesPreprocSparkJob.java
# oag-resources-preproc-sparkjob/src/main/java/pl/psnc/eosc/rs/preprocessor/oag/job/OagResourcesPreprocSparkJob.java
# oag-resource... 31 Jul 2023 Marcin Rochowiak c3e9b445a8f RS-442 update basic job SummaryWriter 31 Jul 2023 RS-442 Marcin Rochowiak 5853334e086 RS-442 remove SparkSession chain 31 Jul 2023 RS-442 Marcin Rochowiak 6ac5efc6abd RS-451 detect language - loading model from hdfs 31 Jul 2023 RS-451 Marcin Rochowiak 4c707a384b7 RS-451 detect language - custom pipeline draft 31 Jul 2023 RS-451 Marcin Rochowiak 8093da0fb84 RS-456 handle DB update job 26 Jul 2023 RS-456 Marcin Rochowiak 1d01aaa8a86 RS-456 add CSV reader 26 Jul 2023 RS-456 Marcin Rochowiak 2a49c8cd0c8 RS-456 clean postgres Job 26 Jul 2023 RS-456 Marcin Rochowiak d2ec5348682 RS-456 26 Jul 2023 RS-456 Marcin Rochowiak 9bc20a33f17 RS-455 adjust spark shared processing 14 Jul 2023 RS-455 Marcin Rochowiak 8c8e375673a RS-454 remove non-alphanumeric filter 05 Jul 2023 RS-454 Marcin Rochowiak 482934bef32 RS-442 extract ds format 29 Jun 2023 RS-442 Marcin Rochowiak dbfe67914f4 RS-442 changed spark job interface, added previousDumpDir parameter 30 May 2023 RS-442 Marcin Rochowiak c06e069ef5f RS-453 operations for changing active jar's 29 Jun 2023 RS-453 Marcin Rochowiak 2f7b2a66f18 RS-452 remove HTML tags from dumps 29 Jun 2023 RS-452 Marcin Rochowiak a4b84f8a163 RS-451 language detection in dumps 29 Jun 2023 RS-451 Marcin Rochowiak 97f09cc297b RS-442 changed spark job interface, added previousDumpDir parameter 30 May 2023 RS-442 Marcin Rochowiak 708fede5010 RS-442 dump differential processing 25 May 2023 RS-442 Marcin Rochowiak 6f308641dcb RS-447 JMS message extractor 12 May 2023 RS-447 Marcin Rochowiak cb9be57e054 RS-447 Change listener type JMS recommendations_evaluations 12 May 2023 RS-447 Marcin Rochowiak ecd1effafd9 RS-446 preprocess dump 2023-05-08 12 May 2023 RS-446 Marcin Rochowiak fc39e4d46c2 RS-445 preprocess dump 2023-04-24 28 Apr 2023 RS-445 Marcin Rochowiak 57d92b8875a RS-419 extended diagnostics 27 Apr 2023 RS-419 Marcin Rochowiak 8cd17a3d8e5 M Pull request #32: Feature/recommendations Merge in EOSC-RS/preprocessor from feature/recommendations to develop
* commit 'b5dcc640e13182f81f151cd1a845232c81f13f7f':
RS-441 preprocessing recommendation evaluations test
RS-441 preprocessing recommendation evaluations
RS-444 preprocessing of recommendations 25 Apr 2023 2 Jira issuesMarcin Rochowiak b5dcc640e13 RS-441 preprocessing recommendation evaluations test 25 Apr 2023 RS-441 Marcin Rochowiak 9c33c9827a6 RS-441 preprocessing recommendation evaluations 25 Apr 2023 RS-441 Marcin Rochowiak 12f0d9cf361 RS-444 preprocessing of recommendations 25 Apr 2023 RS-444 Maciej Łabędzki 4035ad0c98b RS-443 log4j.properties added to Hadoop configurations 21 Apr 2023 RS-443 Maciej Łabędzki 9ca49148ef1 RS-443 hadoop.sh now support multiple Hadoop configurations 21 Apr 2023 RS-443 Maciej Łabędzki 64e58b09ebf RS-442 draft implementation for differential processing 14 Apr 2023 RS-442 Marcin Rochowiak 2415eaf06b1 RS-440 dump 2023-04-03 04 Apr 2023 RS-440 Marcin Rochowiak d0e6f09069e update TODO 27 Mar 2023 Marcin Rochowiak 2b6967d74e7 RS-437 unifying Spark jobs processing 27 Mar 2023 RS-437 Marcin Rochowiak 81d6a4f4246 RS-436 Service sync - add description 22 Mar 2023 RS-436 Maciej Łabędzki 68909e31dc9 updated TODO.md: evaluations + recommendations persistence 22 Mar 2023 Maciej Łabędzki dac9b4f2709 RS-423 hadolint configuration disabled 14 Mar 2023 RS-423 Maciej Łabędzki 1a582bb87bf RS-421 CHANGELOG.md updated 14 Mar 2023 RS-421 Maciej Łabędzki 6f5139568d5 RS-421 DEVELOPERS_GUIDE.md extended with new section 'Software Quality Assurance' 14 Mar 2023 RS-421 Maciej Łabędzki 2d8841c8ea8 RS-423 hadolit.sh updated to use 2.8.0-alpine version of hadolint 14 Mar 2023 RS-423 Maciej Łabędzki b2e5a10f3c4 RS-423 hadolit.sh + .hadolint.yaml + Dockerfile adjusted to pass the linting 14 Mar 2023 RS-423 Maciej Łabędzki a500dec2752 RS-423 .jsonlintrc with configuration for jsonlint-cli validations 14 Mar 2023 RS-423