Can't print log of spark and scala-logging

[livelxw]

I can't see the logs of spark and scala-logging when submit my application to the k8s. However, I can see the logs if I use println() function. I tried to put a log4j properties file in resource folder but it didn't work. What's wrong?

[liyinan926]

I'm assuming you used kubectl logs <driver pod name> to get logs of the driver. This only works if the logs are written to stdout/stderr. See https://kubernetes.io/docs/concepts/cluster-administration/logging/#logging-at-the-node-level.