Skip to content

Pull requests: scaleapi/llm-engine

New pull request New
20 Open 595 Closed
20 Open 595 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Use vLLM for Command-R-Plus model
#670 opened Dec 17, 2024 by sandeshghanta Loading…
@sandeshghanta
Update setup.py
#662 opened Nov 20, 2024 by anagnoko23 Loading…
Node level model weights cache
#652 opened Oct 30, 2024 by seanshi-scale • Draft
Add Templating for Configmaps, Default Values file
#647 opened Oct 23, 2024 by ewkoch Loading…
28
Multinode batch inference
#589 opened Aug 7, 2024 by seanshi-scale • Draft
Bump setuptools from 69.0.3 to 70.0.0 in /model-engine dependencies Pull requests that update a dependency file
#565 opened Jul 15, 2024 by dependabot bot Loading…
Bump zipp from 3.16.0 to 3.19.1 in /model-engine dependencies Pull requests that update a dependency file
#559 opened Jul 9, 2024 by dependabot bot Loading…
Bump certifi from 2023.7.22 to 2024.7.4 in /model-engine dependencies Pull requests that update a dependency file
#557 opened Jul 6, 2024 by dependabot bot Loading…
Bump requests from 2.31.0 to 2.32.2 in /model-engine dependencies Pull requests that update a dependency file
#549 opened Jun 24, 2024 by dependabot bot Loading…
Bump urllib3 from 1.26.16 to 1.26.19 in /model-engine dependencies Pull requests that update a dependency file
#542 opened Jun 18, 2024 by dependabot bot Loading…
Bump msal from 1.26.0 to 1.28.0 in /model-engine dependencies Pull requests that update a dependency file
#538 opened Jun 11, 2024 by dependabot bot Loading…
Bump azure-identity from 1.15.0 to 1.16.1 in /model-engine dependencies Pull requests that update a dependency file
#537 opened Jun 11, 2024 by dependabot bot Loading…
Remove Gunicorn and use Uvicorn only for gateway
#530 opened May 31, 2024 by yunfeng-scale Loading…
7
Bump werkzeug from 2.3.6 to 3.0.3 in /model-engine dependencies Pull requests that update a dependency file
#512 opened May 6, 2024 by dependabot bot Loading…
Bump jinja2 from 3.0.3 to 3.1.4 in /model-engine dependencies Pull requests that update a dependency file
#511 opened May 6, 2024 by dependabot bot Loading…
Bump tqdm from 4.65.0 to 4.66.3 in /model-engine dependencies Pull requests that update a dependency file
#508 opened May 3, 2024 by dependabot bot Loading…
Bump pydantic from 1.10.11 to 1.10.13 in /clients/python dependencies Pull requests that update a dependency file
#502 opened Apr 25, 2024 by dependabot bot Loading…
Bump aiohttp from 3.9.2 to 3.9.4 in /model-engine dependencies Pull requests that update a dependency file
#496 opened Apr 18, 2024 by dependabot bot Loading…
Bump gunicorn from 20.1.0 to 22.0.0 in /model-engine dependencies Pull requests that update a dependency file
#494 opened Apr 17, 2024 by dependabot bot Loading…
Bump transformers from 4.36.0 to 4.38.0 in /scripts dependencies Pull requests that update a dependency file
#489 opened Apr 10, 2024 by dependabot bot Loading…
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.