Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tx datalake support -tx ( compile ) #53

Merged
merged 3 commits into from
Apr 5, 2024
Merged

Tx datalake support -tx ( compile ) #53

merged 3 commits into from
Apr 5, 2024

Conversation

rkdud007
Copy link
Member

@rkdud007 rkdud007 commented Apr 4, 2024

#48
There are some reworks also following

  • CompiledDatalake should have envelope enum so that Compiler can be compatible with both block sampled datalake and tx datalake.
  • Evaluator should be refactor into datalake types like how compiler and any other datalake primitives are defined

For tx datalake specific
For now, let's try to make it work with tx datalake - tx collection.

  • Evaluator/Compiler should store in adaptor structure as it will be scale into handle multiple tasks that potentially contains different types of datalakes in one time.
  • After evaluate the tx datalake -> compile should work as expected which contain to fetch both tx/header data and reconstruct it
  • Try to take a look at CompileResult / EvaluatedResult so that not misuse redundant type definition

@rkdud007 rkdud007 mentioned this pull request Apr 4, 2024
4 tasks
@rkdud007
Copy link
Member Author

rkdud007 commented Apr 5, 2024

for now, as we need to rewrite tx datalake again, merge this for now and rework on tx in other PR

@rkdud007 rkdud007 marked this pull request as ready for review April 5, 2024 14:18
@rkdud007 rkdud007 merged commit c2f799f into main Apr 5, 2024
1 check passed
@rkdud007 rkdud007 deleted the feat/tx-compiler branch April 5, 2024 14:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant