Jaeger Ingester and Elastic APM issue #3429
Unanswered
joao-subtil
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi all,
I am building a POC which combines Jaeger agents and Elastic APM. I need to use kafka and wanted to use the Jaeger Ingester as it is lightweight but i am hitting a wall with the data transfer from the Ingester to Elasticsearch.
Basically if I use the Jaeger Collector in this setup i can get the expected outcome(everything works) as all of this is using Jaeger. However when the Jaeger collector is replaced with the Elastic APM no index is ever created on the Elasticsearch and no errors are logged on either side.
I know by testing that indexes are only created when the first message is processed in an all Jaeger setup *. Jaeger collector creates 2 indexes and elastic APM creates 6.
Could the problem of the data not flowing be due to APM span format? or could this be due to the index templates?, or any other issue?
I have not found any documentation regarding how the ingested operates in depth. I would appreciate any pointers on this.
*The index creation log in Elastic when using collector instead of APM.
{"type": "server", "timestamp": "2021-12-03T18:33:47,106Z", "level": "INFO", "component": "o.e.c.m.MetaDataCreateIndexService", "cluster.name": "elastic-single", "node.name": "elasticsearch", "message": "[talkingorange-jaeger-service-2021-12-03] creating index, cause [auto(bulk api)], templates [jaeger-service], shards [5]/[1], mappings [_doc]", "cluster.uuid": "kq33uyn_SGeFMn1eOFGrng", "node.id": "gd22tuIoTnme_67woKYvGQ" }
{"type": "server", "timestamp": "2021-12-03T18:33:47,388Z", "level": "INFO", "component": "o.e.c.m.MetaDataCreateIndexService", "cluster.name": "elastic-single", "node.name": "elasticsearch", "message": "[talkingorange-jaeger-span-2021-12-03] creating index, cause [auto(bulk api)], templates [jaeger-span], shards [5]/[1], mappings [_doc]", "cluster.uuid": "kq33uyn_SGeFMn1eOFGrng", "node.id": "gd22tuIoTnme_67woKYvGQ" }``
best wishes.
Beta Was this translation helpful? Give feedback.
All reactions