v2.0.0-rc.5

[decahedron1]

Possibly breaking

• Pre-built static libraries (i.e. not cuda or tensorrt) are now linked with /MD instead of /MT on Windows; i.e. MSVC CRT is no longer statically linked. This should resolve linking issues in some cases (particularly crates using other FFI libraries), but may cause issues for others. I have personally tested this in 2 internal pyke projects that depend on ort & many FFI libraries and haven't encountered any issues, but your mileage may vary.

Definitely breaking

• 069ddfd ort now depends on ndarray 0.16.
• e2c4549 wasm32-unknown-unknown support has been removed.
  • Getting wasm32-unknown-unknown working in the first place was basically a miracle. Hacking ONNX Runtime to work outside of Emscripten took a lot of effort, but recent changes to Emscripten and ONNX Runtime have made this exponentially more difficult. Given I am not adequately versed on ONNX Runtime's internals, the nigh-impossibility of debugging weird errors, and the vow I took to write as little C++ as possible ever since I learned Rust, it's no longer feasible for me to work on WASM support for ort.
  • If you were using ort in WASM, I suggest you use and/or support the development of alternative WASM-supporting ONNX inference crates like tract or WONNX.

Features

• ab293f8 Update to ONNX Runtime v1.19.0.
• ecf76f9 Use the URL hash for downloaded model filenames. Models previously downloaded & cached with commit_from_url will be redownloaded.
• 9d25514 Add missing configuration keys for some execution providers.
• 733b7fa New callbacks for the simple Trainer API, just like HF's TrainerCallbacks! This allows you to write custom logging/LR scheduling callbacks. See the updated train-clm-simple example for usage details.

Fixes

• 1692d11 Fix OpenVINO EP option bugs.
• 08aaa0f Fix DirectML output tensor extraction.

---

If you have any questions about this release, we're here to help:

• Discord: #💬｜ort-discussions
• GitHub Discussions

Love ort? Consider supporting us on Open Collective 💖

❤️💚💙💛

---

This discussion was created from the release v2.0.0-rc.5.

[Esword618]

How to use v2.0.0-rc.5 in Cargo.toml:
I encountered a problem. How to trigger the download of download-binaries? Mine seems not to be triggered. The following is mine:

[package]
name = "transformers-study"
version = "0.1.0"
edition = "2021"

[dependencies]
anyhow = "1.0.86"
image = "0.25.2"
ndarray = { version = "0.16.0", optional = true }
serde = { version = "1.0.206", features = ["derive"] }
serde_json = "1.0.122"
tokenizers = "0.20.0"
ort = { version = "2.0.0-rc.5", default-features = false, features = ["ndarray", "download-binaries"] }
#ort = {git = "https://mirror.ghproxy.com/https://github.com/pykeio/ort", tag = "v2.0.0-rc.5", default-features = false, features = ["ndarray", "download-binaries"]}
#ort = {git = "https://mirror.ghproxy.com/https://github.com/pykeio/ort", tag = "v2.0.0-rc.5", default-features = false, features = ["ndarray", "download-binaries", "fetch-models"]}
tracing-subscriber = "0.3.18"
once_cell = "1.19.0"
raqote = { version = "0.8", default-features = false }
show-image = { version = "0.14", features = [ "image", "raqote" ] }
pix2text = { version = "0.1.0", path = "src/pix2text" }

[features]
default = ["ndarray"]

[Esword618]

OK, thank you. I'll try it.

[Esword618]

Can a function be exposed to initialize and define the ORT_LIB_LOCATION position?

[Esword618]

There is still an error. I downloaded the link https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_static-v1.19.0-x86_64-pc-windows-msvc.tgz and placed it in a path, but an error occurred. Why is this? I'm very curious:

I did not encounter this problem in 2.0.0.rc.4

libort_sys-ae2417700662ce94.rlib(float_conversion.obj) : error LNK2019: unresolved external symbol __std_reverse_trivially_swappable_1, referenced in function "char * __cdecl std::rotate<char *>(char *,char *,char *)" (??$rotate@PEAD@std@@YAPEADPEAD00@Z)
libort_sys-ae2417700662ce94.rlib(charconv_bigint.obj) : error LNK2001: unresolved external symbol __std_reverse_trivially_swappable_1
libort_sys-ae2417700662ce94.rlib(mutex.obj) : error LNK2019: unresolved external symbol _Thrd_yield, referenced in function "public: __cdecl <lambda_0c7c625e92acbcfe85646242ef483888>::operator()(void)const " (??R<lambda_0c7c625e92acbcfe85646242ef483888>@@QEBA@XZ)
C:\Users\jyj34\Desktop\111\target\debug\deps\pix2text-4bce918a05cfa4a2.exe : fatal error LNK1120: 249 unresolved externals

[decahedron1]

Those unresolved external symbol errors are caused by an outdated version of Visual Studio. Make sure you have VS2022 >= 17.10 installed.

[Esword618]

But my VS2022 >= 17.10.