Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow compressed result file upload #149

Open
janisliepins opened this issue Jan 27, 2021 · 7 comments
Open

Allow compressed result file upload #149

janisliepins opened this issue Jan 27, 2021 · 7 comments
Labels
backlog Backlog

Comments

@janisliepins
Copy link

It would be great to be able to POST compressed test result files (.zip, .tar formats)
Need for this arises when i am trying to send several thousand result files to /send-results endpoint.

@fescobar
Copy link
Owner

@janisliepins what is the problem sending multiple files?

@fescobar fescobar added the waiting for answer Waiting for user's answer label Feb 5, 2021
@janisliepins
Copy link
Author

@janisliepins what is the problem sending multiple files?

Well in my case i have several thousand of those result files (in one case around 11 000). So i had to modify some flask options like max_request_body_size for app to be able to handle all those files ... + had issues with allure service host VM where regularly inode limit was reached for the filesystem because of the enormous file count.

This could be all resolved with result archiving - e.g. like for Jenkins Allure plugin - where Jenkins creates ZIP archive for Allure report.

Also question and possible solution - maybe i can send Junit report.xml file to the Allure service? Is it possible? have not tried it yet ....

@kormachevt
Copy link

Would be a superb feature. I stumbled upon 'Argument list is too long' error from curl during an attempt to send over 4000 files.
Currently my workaround is splitting array, but archiving the report would solve this problem entirely.

@arekmadej
Copy link

I've also started to see some issues around sending large amounts of files leading to reliability issues to our nightly automation runs. I'm happy to implement the functionality to allow sending compressed files to the API endpoint and handing it accordingly as long as @fescobar is ok with this

@fescobar
Copy link
Owner

fescobar commented May 2, 2021

@arekmadej Go ahead, please. Fork the project and when you finished your implementation, please create a pull request again my beta branch. I will test it in there.
Also, it would be good if you can add an example here::
https://github.com/fescobar/allure-docker-service#send-results-through-api

Thank you in advance

@fescobar
Copy link
Owner

fescobar commented May 2, 2021

@arekmadej the flow will be the next:

  1. POST https://github.com/fescobar/allure-docker-service/blob/master/allure-docker-api/app.py#L851
  2. Validate extension of file zip received
  3. Put the zip inside the container in path /tmp and extract it in there with a directory with a UID name.
  4. Move the files extracted to the allure-results directory

You need to move first the zip to the temporal directory, otherwise, the automatic check results will be executed and will generate another report. For that reason, don't move directly the zip to the allure-results directory.

Any questions let me know.

@fescobar fescobar added backlog Backlog and removed waiting for answer Waiting for user's answer labels May 2, 2021
@rob-spoor
Copy link

Is there any progress on this feature? Because we're running into timeout issues with "just" 2200 files, that we hope could be resolved by uploading a single, smaller file.

Ostryak pushed a commit to Ostryak/allure-docker-service that referenced this issue Aug 15, 2024
…es :

- using formdata
- using application/zip and body
Ostryak pushed a commit to Ostryak/allure-docker-service that referenced this issue Aug 15, 2024
…es :

- using formdata
- using application/zip and body
Ostryak added a commit to Ostryak/allure-docker-service that referenced this issue Aug 15, 2024
…es :

- using formdata
- using application/zip and body
Ostryak added a commit to Ostryak/allure-docker-service that referenced this issue Aug 15, 2024
…es :

- using formdata
- using application/zip and body
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backlog Backlog
Projects
None yet
Development

No branches or pull requests

5 participants