Which container to select for Data Product

[renepajta]

Hi all ,

I am deploying Batch data product. At Synapse config I am struggling to choose which container of Enriched/Curated data lake I should choose. Shall I create a new container per data product or point to main data lake container?

[marvinbuss]

Thanks @renepajta. That is a good point and we probably require some more guidance here. We are recommending to create a new container per Data Product in the Workspace Data Lake and use the container as default storage file system for Synapse and other services.

This container is used by Synapse to store metadata as well as logs and other kind of information. The Data Product teams can still consume data from the other data lakes by assigning the respective MSIs or user IDs to the POSIX ACL layer of the Enriched and Curated Data Lake of the respective Data Landing Zone.

• Where should we include this information?
• Is this already explained well enough in the docs?
• Should we add this to the "Deploy to Azure" frontend?

[renepajta]

I think the explanation is good enough. I would then just enhance the deployment experience to point to documentation.

It may become overwhelming for new adopters to find all necessary information pretty fast.

[marvinbuss]

Let me check how we can guide the user optimally in the Deploy to Azure experience.

[marvinbuss]

@renepajta You can track updates here: #79