Add a Cassandra clustering key for data extraction 97/13297/8
authorSungjin Lee <sodyn99@gmail.com>
Tue, 1 Oct 2024 13:30:29 +0000 (13:30 +0000)
committerSungjin Lee <sodyn99@gmail.com>
Thu, 3 Oct 2024 09:45:13 +0000 (09:45 +0000)
commit16079abbc74f1badffb307c5fe7dea9d13ff4714
tree9ff141b7698a6e31f3c0ea53351df61c3a0e9bf6
parentde219b4db421baadf7d32abd6268397d5edd4008
Add a Cassandra clustering key for data extraction

- Add a partition key
- Use Cassandra key settings to enable data sorting and facilitate proper time-series model training
- Add _Id to the clustering key
- Unify the key column name
- Add lit for test_cassandrasink.py

Issue-ID: AIMLFW-148

Change-Id: Ia624d331fc625e126075a3766132bfc07bf1297a
Signed-off-by: Sungjin Lee <sodyn99@gmail.com>
Dockerfile
dataextraction/sink/CassandraSink.py
requirements.txt
test/test_cassandrasink.py