Environment Variables in config.yml are not resolved

[jlamande]

Hi,

I created a config.yml file based on the default configuration in the README.md page using :

rules:
  - clusters:
      - $CCLOUD_CLUSTER

On metrics fetch, I see errors as

Received status code 403 instead of 200 for POST on https://api.telemetry.confluent.cloud//v2/metrics/cloud/query ({\"errors\":[{\"status\":\"403\",\"detail\":\"Query must filter by at least one of your authorized resources

Running with docker-compose, I exec a shell in the ccloud_exporter and display environment variables :

$ env
...
CCLOUD_CLUSTER=lkc-xxxx1
...

When I set the real value (lkc-xxxx1) instead of the environment variable $CCLOUD_CLUSTER, metrics are correctly fetched on the cluster.

[satheshs]

We are getting the same kind of error when we are deploying in the kubernetes. Below mention the steps we have followed.

xxxxx@xxxxx-Subxxxxxx kubernetes % make install
kubectl create ns ccloudexporter
namespace/ccloudexporter created

kubectl -n ccloudexporter create secret generic "xxxxxxxxxxxxxxx"-vars --from-literal=CCLOUD_API_KEY="xxxxxxxxxxxxxxx" --from-literal=CCLOUD_API_SECRET="xxxxxxxxxxxxxxxxxxxxxxxxxx" --from-literal=CCLOUD_CLUSTER="xxxxxxxxxxxxxx" ;
secret/xxxxxxxxxxxxxxx-vars created

sed "s/#{cluster}#/"xxxxxxxxxxxxxxx"/g" ccloudexporter.dp.yaml | kubectl -n ccloudexporter apply --record -f - ;
deployment.apps/xxxxxxxxxxxxxxx-dp created

sed "s/#{cluster}#/"xxxxxxxxxxxxxxx"/g" ccloudexporter.svc.yaml | kubectl -n ccloudexporter apply --record -f - ;
service/xxxxxxxxxxxxxxx-svc created

kubectl -n monitoring apply --record -f ccloudexporter.crd.yaml

servicemonitor.monitoring.coreos.com/ccloudexporter unchanged
xxxxx@xxxxx-Subxxxxxx kubernetes % kubectl get all -n ccloudexporter

NAME READY STATUS RESTARTS AGE
pod/lkc-xxxxx-dp-654cd5d595-9cjp4 0/1 CrashLoopBackOff 1 19s

NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
service/lkc-xxxxx-svc ClusterIP 10.0.180.249 2112/TCP 15s

NAME READY UP-TO-DATE AVAILABLE AGE
deployment.apps/lkc-xxxxx-dp 0/1 1 0 19s

NAME DESIRED CURRENT READY AGE
replicaset.apps/lkc-xxxxx-dp-654cd5d595 1 1 0 20s
xxxxx@xxxxx-Subxxxxxx kubernetes % kubectl logs pod/lkc-xxxxx-dp-654cd5d595-9cjp4 -n ccloudexporter
{
"Endpoint": "https://api.telemetry.confluent.cloud/v2/metrics/cloud/descriptors/resources",
"StatusCode": 403,
"body": "eyJlcnJvceeeeiI6eyJjbeeee2RlIjo0MDMsIm1lc3xxeNhZ2UiOiJcjncehrpbnZhbGlkIEFQSSBrZXkifX0K",
"level": "fatal",
"msg": "Received status code 403 instead of 200 for GET on https://api.telemetry.confluent.cloud/v2/metrics/cloud/descriptors/resources. \n\n{"error":{"code":403,"message":"invalid API key"}}\n\n\n",
"time": "2021-09-08T19:23:53Z"
}