Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

For C2M2 file tables in Records page, in the DRS bundle, also include the URL to the json file #284

Open
mano-at-sdsc opened this issue May 22, 2024 · 1 comment
Assignees
Labels
C2M2 DRS DRS enhancement New feature or request file file

Comments

@mano-at-sdsc
Copy link
Collaborator

This needs to be discussed further. If we save the json file on the server, we need to make sure the file names don't clash [solution: include the date/time (up to microseconds) row-id for the rows selected in the string on which md5sum is calculated; if DB is updated then the file will be updated], and also will require periodic purge [e.g., after two weeks; if a user task where this file is being referred to tries to use it past the two-week purge time then it will be problem (solution: user can save locally in the workspace after fetching and then subsequently use the local copy from the workspace; will have to pay for storage in cloud)].

If save the json on the server, e.g., in ..../data/tmp/ or ..../data/cache folder, then construct full https path of the file to allow programmatic fetch from some R/python program, etc.

Sumana suggested that for now, let the user download it locally and upload to their workspace as needed using the file upload dialog. from the workspace. What about when we implement a user workspace/account on the portal itself: then can save the file to user's workspace/account (will file permission be an issue).

@mano-at-sdsc mano-at-sdsc added enhancement New feature or request C2M2 DRS DRS file file labels May 22, 2024
@mano-at-sdsc
Copy link
Collaborator Author

mano-at-sdsc commented May 23, 2024

Daniel clarified that there is no need to actually save the json file. If we can construct a URL which will emulate calling an API with all the q,t,row_nums parameters which can build the json blob then using that URL, the json blob can be fetched by R/python like program in any workspace.

However, if many rows selected, the URL length might exceed the limit.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C2M2 DRS DRS enhancement New feature or request file file
Projects
None yet
Development

No branches or pull requests

3 participants