From f84c059e68973af20eee7214416e52dd619d69d5 Mon Sep 17 00:00:00 2001 From: Sanskar Modi Date: Mon, 23 Sep 2024 13:48:20 +0530 Subject: [PATCH] config update --- docs/configuration/master.md | 1 + docs/configuration/worker.md | 1 + 2 files changed, 2 insertions(+) diff --git a/docs/configuration/master.md b/docs/configuration/master.md index 928e99bc64..dcc154a7df 100644 --- a/docs/configuration/master.md +++ b/docs/configuration/master.md @@ -32,6 +32,7 @@ license: | | celeborn.dynamicConfig.store.db.hikari.password | | false | The password of db store backend. | 0.5.0 | | | celeborn.dynamicConfig.store.db.hikari.username | | false | The username of db store backend. | 0.5.0 | | | celeborn.dynamicConfig.store.fs.path | <undefined> | false | The path of dynamic config file for fs store backend. The file format should be yaml. The default path is `${CELEBORN_CONF_DIR}/dynamicConfig.yaml`. | 0.5.0 | | +| celeborn.humanFriendlyLog.enabled | true | false | When `true`, enable human friendly configuration. | 0.6.0 | | | celeborn.internal.port.enabled | false | false | Whether to create a internal port on Masters/Workers for inter-Masters/Workers communication. This is beneficial when SASL authentication is enforced for all interactions between clients and Celeborn Services, but the services can exchange messages without being subject to SASL authentication. | 0.5.0 | | | celeborn.logConf.enabled | false | false | When `true`, log the CelebornConf for debugging purposes. | 0.5.0 | | | celeborn.master.allowWorkerHostPattern | <undefined> | false | Pattern of worker host that allowed to register with the master. If not set, all workers are allowed to register. | 0.6.0 | | diff --git a/docs/configuration/worker.md b/docs/configuration/worker.md index 629d5eee50..ae3458baad 100644 --- a/docs/configuration/worker.md +++ b/docs/configuration/worker.md @@ -32,6 +32,7 @@ license: | | celeborn.dynamicConfig.store.db.hikari.password | | false | The password of db store backend. | 0.5.0 | | | celeborn.dynamicConfig.store.db.hikari.username | | false | The username of db store backend. | 0.5.0 | | | celeborn.dynamicConfig.store.fs.path | <undefined> | false | The path of dynamic config file for fs store backend. The file format should be yaml. The default path is `${CELEBORN_CONF_DIR}/dynamicConfig.yaml`. | 0.5.0 | | +| celeborn.humanFriendlyLog.enabled | true | false | When `true`, enable human friendly configuration. | 0.6.0 | | | celeborn.internal.port.enabled | false | false | Whether to create a internal port on Masters/Workers for inter-Masters/Workers communication. This is beneficial when SASL authentication is enforced for all interactions between clients and Celeborn Services, but the services can exchange messages without being subject to SASL authentication. | 0.5.0 | | | celeborn.logConf.enabled | false | false | When `true`, log the CelebornConf for debugging purposes. | 0.5.0 | | | celeborn.master.endpoints | <localhost>:9097 | false | Endpoints of master nodes for celeborn clients to connect. Client uses resolver provided byceleborn.master.endpoints.resolver to resolve the master endpoints. By default Celeborn uses `org.apache.celeborn.common.client.StaticMasterEndpointResolver` which take static master endpoints as input. Allowed pattern: `:[,:]*`, e.g. `clb1:9097,clb2:9098,clb3:9099`. If the port is omitted, 9097 will be used. If the master endpoints are not static then users can pass custom resolver implementation to discover master endpoints actively using celeborn.master.endpoints.resolver. | 0.2.0 | |