What are the best practices for converting telemetry data formats

[xuzhijvn]

My collector config looks like this:

exporters:
  logging:
    loglevel: debug
  kafka:
   .....

processors:
  batch:

receivers:
  otlp:
    protocols:
      grpc:
      http:

service:
  pipelines:
    traces:
      receivers: [otlp]
      processors: [batch]
      exporters: [logging, kafka]
    metrics:
      receivers: [otlp]
      processors: [batch]
      exporters: [logging, kafka]

Take Trace as an example, the exported Trace data format is similar to this:

Resource SchemaURL: https://opentelemetry.io/schemas/1.10.0
Resource labels:
     -> host.name: STRING(tonyxudeMacBook-Pro.local)
     -> ht-env: STRING(uat)
     -> process.command_args: SLICE([/private/var/folders/0x/gsvbztkx7pj2fvqml6_p0yjm0000gn/T/GoLand/___go_build_github_com_open_telemetry_opentelemetry_collector_contrib_examples_demo_client])
     -> process.executable.name: STRING(___go_build_github_com_open_telemetry_opentelemetry_collector_contrib_examples_demo_client)
     -> process.executable.path: STRING(/private/var/folders/0x/gsvbztkx7pj2fvqml6_p0yjm0000gn/T/GoLand/___go_build_github_com_open_telemetry_opentelemetry_collector_contrib_examples_demo_client)
     -> process.owner: STRING(tonyxu)
     -> process.pid: INT(31045)
     -> process.runtime.description: STRING(go version go1.18.3 darwin/arm64)
     -> process.runtime.name: STRING(go)
     -> process.runtime.version: STRING(go1.18.3)
     -> service.name: STRING(ht-app-id-demo-client)
     -> telemetry.sdk.language: STRING(go)
     -> telemetry.sdk.name: STRING(opentelemetry)
     -> telemetry.sdk.version: STRING(1.8.0)
ScopeSpans #0
ScopeSpans SchemaURL: 
InstrumentationScope go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp semver:0.33.0
Span #0
    Trace ID       : 9816573fa0378648ae60ee74e44efeac
    Parent ID      : f8fed9998f6c2b5b
    ID             : a149d63053913b3e
    Name           : HTTP GET
    Kind           : SPAN_KIND_CLIENT
    Start time     : 2022-08-03 03:34:54.725326 +0000 UTC
    End time       : 2022-08-03 03:34:55.31931325 +0000 UTC
    Status code    : STATUS_CODE_UNSET
    Status message : 
Attributes:
     -> http.method: STRING(GET)
     -> http.url: STRING(http://0.0.0.0:7080/hello)
     -> http.scheme: STRING(http)
     -> http.host: STRING(0.0.0.0:7080)
     -> http.flavor: STRING(1.1)
     -> http.status_code: INT(200)
Span #1
    Trace ID       : f78acadf8d63b9bdee3219685a268f0e
    Parent ID      : 25bdce610634c924
    ID             : b00693675e1e6e45
    Name           : HTTP GET
    Kind           : SPAN_KIND_CLIENT
    Start time     : 2022-08-03 03:34:56.320722 +0000 UTC
    End time       : 2022-08-03 03:34:56.326967833 +0000 UTC
    Status code    : STATUS_CODE_UNSET
    Status message : 
Attributes:
     -> http.method: STRING(GET)
     -> http.url: STRING(http://0.0.0.0:7080/hello)
     -> http.scheme: STRING(http)
     -> http.host: STRING(0.0.0.0:7080)
     -> http.flavor: STRING(1.1)
     -> http.status_code: INT(200)
Span #2
    .....
Attributes:
    .....
Span #3
    .....
Attributes:
    .....
Span #4
    .....
Attributes:
    .....
ScopeSpans #1
    .....

But I want to export Trace data like this with kafka exporter:

[
    {
        "protocol":"dubbo",
        "providerPort":7010,
        "consumerSide":true,
        "serviceVersion":"1.0.0",
        "endTime":1484887076041,
        "serviceName":"com.a.b.MyService",
        "startTime":1484887076031,
        "appName":"myApp",
        "chainId":"0",
        "consumerPort":0,
        "initial":true,
        "serviceGroup":"",
        "traceId":"35d01fc4-7cd7-48a7-be6f-36603e5c8d62",
        "methodName":"$invoke",
        "success":true,
        "consumerHost":"192.168.10.11",
        "providerHost":"192.168.10.12",
        "code":"110001",
        "tags":{
            "tag1":"value1",
            "tag2":"value2"
        }
    }
]

What should I do?

Need to create a new exporter? Or create a new processor? Or use transformprocessor or spanprocessor or some other existing processor?

What is the best practice?