When using the SeaTunnel Engine in local-mode to transfer data from clickhouse to doris, the speed is relatively slow. Is there any parameter that can be adjusted to improve the transfer speed? #4559
Unanswered
itsallsame
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
this is config:
{
"env": {
"job.mode": "BATCH",
"execution.parallelism": 20
},
"source": [
{
"plugin_name": "Clickhouse",
"result_table_name": "tmp_table",
"host": "clickhouse-default:8123",
"database": "tmp",
"sql": "select * from tmp.tmp_table where d = yesterday()",
"username": "doris_ro",
"password": "xxx"
}
],
"sink": [
{
"plugin_name": "Doris",
"fenodes": "rc-test:8036",
"username": "root",
"password": "xxx",
"table.identifier": "tmp.tmp_table",
"sink.label-prefix": "test_ck2doris_dw_002",
"doris.config": {
"format": "json",
"read_json_by_line": "true"
}
}
]
}
Beta Was this translation helpful? Give feedback.
All reactions