summary |
shortlog | log |
commit |
commitdiff |
review |
tree
first ⋅ prev ⋅ next
Monosij Ghosh [Fri, 3 Jan 2025 09:17:59 +0000 (14:47 +0530)]
Data extraction module branch out for K release
Updated container tags to 3.0.0 for K release
Change-Id: I8c2f99a57076f61af954e01fcfc9379b2b731c8e
Signed-off-by: Monosij Ghosh <mono.ghosh@samsung.com>
Monosij Ghosh [Fri, 3 Jan 2025 09:14:26 +0000 (14:44 +0530)]
changes for K release
updated container tag
Change-Id: Ic7b6311d4bce4bc997b40f85f8251cefee8b6fe3
Signed-off-by: Monosij Ghosh <mono.ghosh@samsung.com>
subhash kumar singh [Tue, 17 Dec 2024 12:46:25 +0000 (12:46 +0000)]
Merge "Data extraction module docker file optimisation"
rajdeep11 [Tue, 3 Dec 2024 08:35:37 +0000 (14:05 +0530)]
changes to change table name to featuregroup_name + "_" + trainingjob_is and adding trainingjob_id in Task
Change-Id: I2b609d57d1cb43ff2e901bef9bd565177b8c7180
Signed-off-by: rajdeep11 <rajdeep.sin@samsung.com>
Monosij Ghosh [Wed, 27 Nov 2024 09:08:02 +0000 (14:38 +0530)]
Data extraction module docker file optimisation
Memmory optimisation for docker image
Change-Id: I2b0e5748973409b5357ac4147e418bba6267db01
Signed-off-by: Monosij Ghosh <mono.ghosh@samsung.com>
subhash kumar singh [Thu, 3 Oct 2024 17:45:24 +0000 (17:45 +0000)]
Merge "Add a Cassandra clustering key for data extraction"
Sungjin Lee [Tue, 1 Oct 2024 13:30:29 +0000 (13:30 +0000)]
Add a Cassandra clustering key for data extraction
- Add a partition key
- Use Cassandra key settings to enable data sorting and facilitate proper time-series model training
- Add _Id to the clustering key
- Unify the key column name
- Add lit for test_cassandrasink.py
Issue-ID: AIMLFW-148
Change-Id: Ia624d331fc625e126075a3766132bfc07bf1297a
Signed-off-by: Sungjin Lee <sodyn99@gmail.com>
Sungjin Lee [Tue, 1 Oct 2024 14:23:55 +0000 (14:23 +0000)]
Fix pandas and other package version compatibility
- Updated pyspark version from 3.1.2 to 3.5.3
- Updated influxdb-client version from 1.20.0 to 1.46.0
- Updated jdk version from 8 to 11
ISSUE-ID: AIMLFW-164
Change-Id: Ifc577b1ffd2821d27fa69d2ed4baae631b915068
Signed-off-by: Sungjin Lee <sodyn99@gmail.com>
subhash kumar singh [Fri, 6 Sep 2024 07:33:57 +0000 (07:33 +0000)]
Fix build error by updating pandas version
Fix build error by updating pandas version.
Change-Id: Ic8a7de6607308fdab30a075795a5f6d03ed56fd4
Signed-off-by: subhash kumar singh <subh.singh@samsung.com>
subhash kumar singh [Thu, 27 Jun 2024 11:21:59 +0000 (11:21 +0000)]
Release image
Release image.
Change-Id: Ic39217f22a71195898f83f359133d87bae09f617
Signed-off-by: subhash kumar singh <subh.singh@samsung.com>
subhash kumar singh [Thu, 27 Jun 2024 11:54:44 +0000 (11:54 +0000)]
Create new container tag
Create new container tag.
Change-Id: Iecff2cd33cc0d9bdc33882f66586bbf68fac9a74
Signed-off-by: subhash kumar singh <subh.singh@samsung.com>
subhash kumar singh [Thu, 25 Apr 2024 11:41:30 +0000 (11:41 +0000)]
PTL change
Change-Id: I472f8d48fcd0519644c10981bca0b9b00888ae67
Signed-off-by: subhash kumar singh <subh.singh@samsung.com>
subhash kumar singh [Mon, 29 Apr 2024 16:16:50 +0000 (16:16 +0000)]
Fix build error
Updated python version to 3.10 and fix build error.
Change-Id: I7168414526d889ac82f6a80de9f3686e6287389d
Signed-off-by: subhash kumar singh <subh.singh@samsung.com>
Jessica Wagantall [Wed, 24 Apr 2024 17:37:19 +0000 (10:37 -0700)]
Fix: Update tox python version to 3.8 to match Jenkins
Change-Id: I9e46c7ee583ef0d2beeaaac1700662ab6185e86e
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Wed, 10 Apr 2024 21:40:08 +0000 (14:40 -0700)]
CI: Migrate tox verify from Jenkins to GHA
Change-Id: I00a04d4f55d06ff5f5ce7134b57e7060479b6813
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Tue, 2 Apr 2024 20:55:21 +0000 (13:55 -0700)]
Fix: Update Python version to 3.10 and envs to only code
This matches what Jenkins is verifying
Change-Id: Ibb48be4fe91e8bd6b8d86b7ebf71ab8a717e9f87
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Wed, 14 Feb 2024 18:23:12 +0000 (10:23 -0800)]
CI: Add non voting tox verify GHA workflow call
This GitHub Action workflow call will replace tox-verify in
Jenkins.
This is added as a non-voting workflow for now until we confirm
it works as expected.
Change-Id: I093e91841dcc6d426dcbda445029313bf51b1eb4
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
SANDEEP KUMAR JAISAWAL [Wed, 13 Dec 2023 13:34:13 +0000 (19:04 +0530)]
Data extraction I release related changes
Issue-Id: AIMLFW-58
Change-Id: I42adbe51b91c3646a5f40e00ce76193fcaf3f1fc
Signed-off-by: SANDEEP KUMAR JAISAWAL <s.jaisawal@samsung.com>
rajdeep11 [Fri, 27 Oct 2023 05:34:42 +0000 (11:04 +0530)]
adding test cases
Issue-Id: AIMLFW-58
Change-Id: I51ef0a4be188107f105e0db7a2dd704ccad28275
Signed-off-by: rajdeep11 <rajdeep.sin@samsung.com>
rajdeep11 [Tue, 10 Oct 2023 11:35:09 +0000 (17:05 +0530)]
Support for dynamic change of data source(data-extraction)
Issue-Id: AIMLFW-58
Change-Id: Ic957198c11795db24e8b221590d497a024f516e2
Signed-off-by: rajdeep11 <rajdeep.sin@samsung.com>
josephthaliath [Thu, 25 May 2023 08:35:49 +0000 (14:05 +0530)]
Change due to PTL change
Change-Id: Ie7af8806259b15146ed045bf49d85dd20e1444eb
Signed-off-by: josephthaliath <jo.thaliath@samsung.com>
josephthaliath [Wed, 15 Feb 2023 11:09:04 +0000 (16:39 +0530)]
Committer addition
Signed-off-by: josephthaliath <jo.thaliath@samsung.com>
Change-Id: I812e63a8b2c7bc1afb09a89e9e73219261f7f950
SANDEEP KUMAR JAISAWAL [Wed, 14 Dec 2022 17:13:48 +0000 (22:43 +0530)]
Changing release tag
Issue-Id: AIMLFW-12
Signed-off-by: SANDEEP KUMAR JAISAWAL <s.jaisawal@samsung.com>
Change-Id: Ib5e04f8616be1db2049a94aec022afc60d3fad03
josephthaliath [Wed, 14 Dec 2022 05:26:28 +0000 (10:56 +0530)]
Release version updated for g-release
Issue-Id: AIMLFW-12
Signed-off-by: josephthaliath <jo.thaliath@samsung.com>
Change-Id: Id8fccbf21fe3b857e8ba02399d3898948fdc3741
ashishj1729 [Mon, 12 Dec 2022 08:32:40 +0000 (14:02 +0530)]
Resolving Code Smells
Issue-Id: AIMLFW-6
Signed-off-by: ashishj1729 <jain.ashish@samsung.com>
Change-Id: I91ac6cbaeca5c7fb9cf78b96965d45c935b19f40
SANDEEP KUMAR JAISAWAL [Thu, 8 Dec 2022 10:10:20 +0000 (15:40 +0530)]
Adding release tag file
Issue-Id: AIMLFW-6
Signed-off-by: SANDEEP KUMAR JAISAWAL <s.jaisawal@samsung.com>
Change-Id: Ia97420a0c1a9cec4adcd3c447c77d50890f59ce2
josephthaliath [Thu, 8 Dec 2022 09:03:12 +0000 (14:33 +0530)]
Documentation files added
Issue-Id: AIMLFW-12
Signed-off-by: josephthaliath <jo.thaliath@samsung.com>
Change-Id: I8dd2590a77eb0238eb518beac380349ed119b915
SANDEEP KUMAR JAISAWAL [Wed, 7 Dec 2022 09:47:13 +0000 (09:47 +0000)]
Merge "license file added to the repo."
SANDEEP KUMAR JAISAWAL [Wed, 7 Dec 2022 09:46:30 +0000 (09:46 +0000)]
Merge "Removing CLRF Issue-Id: AIMLFW-5"
smahana123 [Wed, 7 Dec 2022 09:33:37 +0000 (15:03 +0530)]
license file added to the repo.
Issue-id: AIMLWF-6
Signed-off-by: smahana123 <s.mahana@samsung.com>
Change-Id: I735235ea4f75ea44bf4a3eb3a4a3d9bc5ff8a286
ashishj1729 [Wed, 7 Dec 2022 08:46:32 +0000 (14:16 +0530)]
Removing CLRF
Issue-Id: AIMLFW-5
Signed-off-by: ashishj1729 <jain.ashish@samsung.com>
Change-Id: Iec08c64fe10c753f26445b7b2eb7213ae6693aca
SANDEEP KUMAR JAISAWAL [Wed, 7 Dec 2022 06:05:15 +0000 (06:05 +0000)]
Merge "License Headers Added."
ashishj1729 [Tue, 6 Dec 2022 08:56:19 +0000 (14:26 +0530)]
Addition of Tox.ini and License Headers
Issue-Id: AIMLFW-5
Signed-off-by: ashishj1729 <jain.ashish@samsung.com>
Change-Id: I3b4b7637bca27c83f2c0a8bde67907b3f815af2b
smahana123 [Tue, 6 Dec 2022 07:03:33 +0000 (12:33 +0530)]
License Headers Added.
Issue-id: AIMLWF-6
Signed-off-by: smahana123 <s.mahana@samsung.com>
Change-Id: Idcd644eb64d36803f2e5fc8daf1ae16c83ca36a3
Signed-off-by: smahana123 <s.mahana@samsung.com>
ashishj1729 [Fri, 25 Nov 2022 10:31:16 +0000 (16:01 +0530)]
Adding Unit Test Cases
Issue-id: AIMLWF-6
Signed-off-by: ashishj1729 <jain.ashish@samsung.com>
Change-Id: Ic7ca6adb1414529e529e5a04656a2e2698433bf5
Signed-off-by: ashishj1729 <jain.ashish@samsung.com>
josephthaliath [Wed, 16 Nov 2022 07:39:32 +0000 (13:09 +0530)]
Update to Dockerfile
Issue-Id: AIMLFW-4
Signed-off-by: josephthaliath <jo.thaliath@samsung.com>
Change-Id: Ia66e046221cb784471813f3aae8f30723a155ac7
SANDEEP KUMAR JAISAWAL [Wed, 9 Nov 2022 10:43:01 +0000 (16:13 +0530)]
Docker file license
Issue-id: AIMLWF-5
Signed-off-by: SANDEEP KUMAR JAISAWAL <s.jaisawal@samsung.com>
Change-Id: I357f2db0303b70fe6a66b796671f7771a7427dcf
SANDEEP KUMAR JAISAWAL [Wed, 9 Nov 2022 06:55:15 +0000 (12:25 +0530)]
Build related files for data extraction repo
Issue-id: AIMLWF-5
Signed-off-by: SANDEEP KUMAR JAISAWAL <s.jaisawal@samsung.com>
Change-Id: Ica0726237ba15a285b89df9d195fdec974c64f61
josephthaliath [Thu, 20 Oct 2022 06:11:42 +0000 (11:41 +0530)]
Logging and configuration functionality for data extraction
Issue-Id: AIMLFW-2
Signed-off-by: josephthaliath <jo.thaliath@samsung.com>
Change-Id: I56257f4afb360fabff6aa0c5afd094fef926fbc1
Signed-off-by: josephthaliath <jo.thaliath@samsung.com>
josephthaliath [Tue, 18 Oct 2022 10:33:15 +0000 (16:03 +0530)]
Main file for data extraction
Issue-Id: AIMLFW-2
Signed-off-by: josephthaliath <jo.thaliath@samsung.com>
Change-Id: Idef89915da682e4a5393f165ea00301c11fe9e1c
Signed-off-by: josephthaliath <jo.thaliath@samsung.com>
josephthaliath [Tue, 18 Oct 2022 09:12:22 +0000 (14:42 +0530)]
Feature engineering pipeline changes
Issue-Id: AIMLFW-2
Signed-off-by: josephthaliath <jo.thaliath@samsung.com>
Change-Id: I01111d4d65a72ef9b95b4c801d11f3f3a6122ebe
josephthaliath [Mon, 17 Oct 2022 09:34:52 +0000 (15:04 +0530)]
Change src folder name to module name dataextraction
Issue-Id: AIMLFW-2
Signed-off-by: josephthaliath <jo.thaliath@samsung.com>
Change-Id: Ifecffec27bd22a94fa7ceba684456e2abdc4728a
josephthaliath [Fri, 14 Oct 2022 10:45:05 +0000 (16:15 +0530)]
Adding files for source funtionality for data extraction module
Issue-Id: AIMLFW-2
Signed-off-by: josephthaliath <jo.thaliath@samsung.com>
Change-Id: I7d9b2ed7dc16bd1af5c4f898772fd5b8636fb6d4
SANDEEP KUMAR JAISAWAL [Thu, 13 Oct 2022 07:10:51 +0000 (12:40 +0530)]
Removing CRLF from few files
Issue-Id: AIMLFW-2
Signed-off-by: SANDEEP KUMAR JAISAWAL <s.jaisawal@samsung.com>
Change-Id: I2ba4f43e29f80408d17ce188a6e68c26e3799f15
Ashish Jain [Thu, 13 Oct 2022 06:21:00 +0000 (06:21 +0000)]
Merge "Adding files for sink funtionality for data extraction module"
SANDEEP KUMAR JAISAWAL [Thu, 13 Oct 2022 05:42:26 +0000 (11:12 +0530)]
Adding files for sink funtionality for data extraction module
Issue-Id: AIMLFW-2
Signed-off-by: SANDEEP KUMAR JAISAWAL <s.jaisawal@samsung.com>
Change-Id: Ia4b9c1af3878f9b5eae79528610ee5c65d88108f
tganesh2k [Wed, 12 Oct 2022 11:27:22 +0000 (16:57 +0530)]
Adding files for transform functions of data-extraction module
Issue-Id: AIMLFW-2
Signed-off-by: tganesh2k <ganesh.kumar@samsung.com>
Change-Id: I36045b5e23ab915fcff69eee75526bb7e6a37630
josephthaliath [Fri, 7 Oct 2022 09:01:14 +0000 (14:31 +0530)]
Adding Base class files for source, transform and sink functions of data-extraction module
Issue-Id: AIMLFW-3
Signed-off-by: josephthaliath <jo.thaliath@samsung.com>
Change-Id: I67b1dd48439b715ac0a09c2bb769848688de6089
SANDEEP KUMAR JAISAWAL [Fri, 7 Oct 2022 04:49:48 +0000 (04:49 +0000)]
Merge " Chore: Automation adds .gitreview"
LF Jenkins CI [Tue, 27 Sep 2022 02:49:26 +0000 (02:49 +0000)]
Automation adds INFO.yaml
Change-Id: Ic55b4dbbbfa8a0a60e22516db539ae9997eeaa21
Signed-off-by: lf-jobbuilder <releng+lf-jobbuilder@linuxfoundation.org>
lf-jobbuilder [Tue, 27 Sep 2022 02:48:43 +0000 (19:48 -0700)]
Chore: Automation adds .gitreview
Signed-off-by: lf-jobbuilder <releng+lf-jobbuilder@linuxfoundation.org>
Change-Id: Id90a777f2c8d3670d14b071f349b00cdcb0c9b69
Eric Ball [Tue, 27 Sep 2022 02:20:35 +0000 (02:20 +0000)]
Initial empty repository
Code Review / aiml-fw / athp / data-extraction.git / log