Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generic StreamMap for all streams #699

Closed
Tracked by #1883
AvinashGupta802 opened this issue Jun 7, 2022 · 3 comments
Closed
Tracked by #1883

Generic StreamMap for all streams #699

AvinashGupta802 opened this issue Jun 7, 2022 · 3 comments
Labels

Comments

@AvinashGupta802
Copy link

AvinashGupta802 commented Jun 7, 2022

Hi ,
in stream_maps

{
    "stream_maps": {
        "**customers**": { // Apply these transforms to the stream called 'customers'
            "email": null, // drop the PII field from RECORD and SCHEMA messages
            "email_domain": "owner_email.split('@')[-1]", // capture just the email domain
            "email_hash": "md5(config['hash_seed'] + owner_email)", // for uniqueness checks
        }
    },
    "stream_map_config": {
        // hash outputs are not able to be replicated without the original seed:
        "hash_seed": "01AWZh7A6DzGm6iJZZ2T"
    }
}

in place of "customers" , can I use "*" to apply it for all streams ?

Can it developed as new feature ?

@stale
Copy link

stale bot commented Jul 18, 2023

This has been marked as stale because it is unassigned, and has not had recent activity. It will be closed after 21 days if no further activity occurs. If this should never go stale, please add the evergreen label, or request that it be added.

@stale stale bot added the stale label Jul 18, 2023
@edgarrmondragon
Copy link
Collaborator

Still relevant and open for contributions.

@edgarrmondragon
Copy link
Collaborator

This was actually addressed by #1888 :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants