Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Windows Support for spacemesh-cuda #1

Open
LiQing-Code opened this issue Jun 8, 2024 · 13 comments
Open

Windows Support for spacemesh-cuda #1

LiQing-Code opened this issue Jun 8, 2024 · 13 comments

Comments

@LiQing-Code
Copy link

I am interested in using spacemesh-cuda on a Windows environment. I have a few questions regarding this:

  1. Windows Support: Does spacemesh-cuda currently support Windows? If not, are there any plans to support it in the future?

  2. Precompiled Binaries: If Windows is supported, would it be possible to provide precompiled binary files for Windows in the releases section of the repository?

  3. Compilation Instructions: If precompiled binaries are not available, could you provide detailed instructions on how to compile spacemesh-cuda for Windows? Specifically, any required dependencies, environment setup, and build steps would be greatly appreciated.

Thank you for your assistance and for your work on this project!
@Lothar1812
Copy link

+1

@tickinbuaa
Copy link
Collaborator

We currently have no plans to support Windows. However, considering that the source code itself does not depend on platform-specific libraries, only a few modifications to the build-related code should be necessary. These modifications should mainly focus on the rust/src/build.rs and CMakeLists.txt files. If you encounter any issues while compiling on Windows, please provide detailed information.

@tickinbuaa
Copy link
Collaborator

Support for the Windows platform has been completed. If you still encounter any issues, please provide me with detailed error information.

@ziyiz
Copy link

ziyiz commented Jun 24, 2024 •
edited
Loading

Thank you for your time on this project. I tried the latest code to build from source on a Windows 11 environment but no luck
I ran cargo check and got error:

PS C:\Users\xxx\Desktop\spacemesh-cuda\post-rs\ffi> cargo check
warning: C:\Users\xxx\Desktop\spacemesh-cuda\post-rs\ffi\Cargo.toml: `crate_type` is deprecated in favor of `crate-type` and will not work in the 2024 edition
(in the `post` library target)
  Compiling spacemesh-cuda v0.0.1 (https://github.com/ZakuroLab/spacemesh-cuda.git?rev=7910031510ef2a7c1a7e7bcfe96d0e38ea921866#79100315)
  Compiling post-cbindings v0.7.8 (C:\Users\xxx\Desktop\spacemesh-cuda\post-rs\ffi)
error: failed to run custom build command for `spacemesh-cuda v0.0.1 (https://github.com/ZakuroLab/spacemesh-cuda.git?rev=7910031510ef2a7c1a7e7bcfe96d0e38ea921866#79100315)`

Caused by:
 process didn't exit successfully: `C:\Users\xxx\Desktop\spacemesh-cuda\post-rs\target\debug\build\spacemesh-cuda-e81b0d8493ce8a11\build-script-build` (exit code: 101)
 --- stderr
 thread 'main' panicked at C:\Users\xxx\.cargo\registry\src\index.crates.io-6f17d22bba15001f\cmake-0.1.50\src\lib.rs:1098:5:

 command did not execute successfully, got: exit code: 1

 build script failed, must exit now
 note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
warning: build failed, waiting for other jobs to finish...

I use Powershell and 'cmake --version' shows 'cmake version 3.29.6'

@tickinbuaa
Copy link
Collaborator

Thank you for your time on this project. I tried the latest code to build from source on a Windows 11 environment but no luck I ran cargo check and got error:

PS C:\Users\xxx\Desktop\spacemesh-cuda\post-rs\ffi> cargo check
warning: C:\Users\xxx\Desktop\spacemesh-cuda\post-rs\ffi\Cargo.toml: `crate_type` is deprecated in favor of `crate-type` and will not work in the 2024 edition
(in the `post` library target)
  Compiling spacemesh-cuda v0.0.1 (https://github.com/ZakuroLab/spacemesh-cuda.git?rev=7910031510ef2a7c1a7e7bcfe96d0e38ea921866#79100315)
  Compiling post-cbindings v0.7.8 (C:\Users\xxx\Desktop\spacemesh-cuda\post-rs\ffi)
error: failed to run custom build command for `spacemesh-cuda v0.0.1 (https://github.com/ZakuroLab/spacemesh-cuda.git?rev=7910031510ef2a7c1a7e7bcfe96d0e38ea921866#79100315)`

Caused by:
 process didn't exit successfully: `C:\Users\xxx\Desktop\spacemesh-cuda\post-rs\target\debug\build\spacemesh-cuda-e81b0d8493ce8a11\build-script-build` (exit code: 101)
 --- stderr
 thread 'main' panicked at C:\Users\xxx\.cargo\registry\src\index.crates.io-6f17d22bba15001f\cmake-0.1.50\src\lib.rs:1098:5:

 command did not execute successfully, got: exit code: 1

 build script failed, must exit now
 note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
warning: build failed, waiting for other jobs to finish...

I use Powershell and 'cmake --version' shows 'cmake version 3.29.6'

Can you successfully compile spacemesh-cuda? If not, could you provide detailed error information?

@ziyiz
Copy link

ziyiz commented Jun 26, 2024

Thank you for your time on this project. I tried the latest code to build from source on a Windows 11 environment but no luck I ran cargo check and got error:

PS C:\Users\xxx\Desktop\spacemesh-cuda\post-rs\ffi> cargo check
warning: C:\Users\xxx\Desktop\spacemesh-cuda\post-rs\ffi\Cargo.toml: `crate_type` is deprecated in favor of `crate-type` and will not work in the 2024 edition
(in the `post` library target)
  Compiling spacemesh-cuda v0.0.1 (https://github.com/ZakuroLab/spacemesh-cuda.git?rev=7910031510ef2a7c1a7e7bcfe96d0e38ea921866#79100315)
  Compiling post-cbindings v0.7.8 (C:\Users\xxx\Desktop\spacemesh-cuda\post-rs\ffi)
error: failed to run custom build command for `spacemesh-cuda v0.0.1 (https://github.com/ZakuroLab/spacemesh-cuda.git?rev=7910031510ef2a7c1a7e7bcfe96d0e38ea921866#79100315)`

Caused by:
 process didn't exit successfully: `C:\Users\xxx\Desktop\spacemesh-cuda\post-rs\target\debug\build\spacemesh-cuda-e81b0d8493ce8a11\build-script-build` (exit code: 101)
 --- stderr
 thread 'main' panicked at C:\Users\xxx\.cargo\registry\src\index.crates.io-6f17d22bba15001f\cmake-0.1.50\src\lib.rs:1098:5:

 command did not execute successfully, got: exit code: 1

 build script failed, must exit now
 note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
warning: build failed, waiting for other jobs to finish...

I use Powershell and 'cmake --version' shows 'cmake version 3.29.6'

Can you successfully compile spacemesh-cuda? If not, could you provide detailed error information?

Here is the full log:

PS C:\Users\xxx\Desktop\spacemesh-cuda\post-rs\ffi> cargo build --release
warning: C:\Users\xxx\Desktop\spacemesh-cuda\post-rs\ffi\Cargo.toml: `crate_type` is deprecated in favor of `crate-type` and will not work in the 2024 edition
(in the `post` library target)
   Compiling proc-macro2 v1.0.85
   Compiling windows_x86_64_msvc v0.52.5
   Compiling crossbeam-utils v0.8.20
   Compiling prettyplease v0.2.20
   Compiling rustix v0.38.34
   Compiling libc v0.2.155
   Compiling typenum v1.17.0
   Compiling serde_json v1.0.117
   Compiling semver v1.0.23
   Compiling clang-sys v1.8.1
   Compiling generic-array v0.14.7
   Compiling num-traits v0.2.19
   Compiling bindgen v0.69.4
   Compiling serde v1.0.203
   Compiling thiserror v1.0.61
   Compiling crunchy v0.2.2
   Compiling indexmap v1.9.3
   Compiling syn v1.0.109
   Compiling cl-sys v0.4.3
   Compiling winapi v0.3.9
   Compiling rayon-core v1.12.1
   Compiling radium v0.7.0
   Compiling blake3 v1.5.1
   Compiling eyre v0.6.12
   Compiling randomx-rs v1.3.0 (https://github.com/spacemeshos/randomx-rs?rev=d46bcd90e09428883e253b8203d6b311b0a07b91#d46bcd90)
   Compiling cbindgen v0.26.0
   Compiling anyhow v1.0.86
   Compiling spacemesh-cuda v0.0.1 (https://github.com/ZakuroLab/spacemesh-cuda.git?rev=7910031510ef2a7c1a7e7bcfe96d0e38ea921866#79100315)
   Compiling uint v0.9.5
   Compiling windows-targets v0.52.5
   Compiling windows-sys v0.52.0
   Compiling libloading v0.8.3
   Compiling primitive-types v0.12.2
   Compiling bitvec v1.0.1
   Compiling rustc_version v0.4.0
   Compiling quote v1.0.36
   Compiling crossbeam-epoch v0.9.18
   Compiling crossbeam-queue v0.3.11
   Compiling crossbeam-channel v0.5.13
   Compiling ocl-core v0.11.5
   Compiling syn v2.0.66
   Compiling crossbeam-deque v0.8.5
   Compiling num-traits v0.1.43
   Compiling ocl-core-vector v0.1.1
   Compiling num-complex v0.4.6
   Compiling enum_primitive v0.1.1
   Compiling crossbeam v0.8.4
   Compiling qutex v0.2.6
   Compiling block-padding v0.3.3
   Compiling crypto-common v0.1.6
   Compiling core_affinity v0.8.1
   Compiling rayon v1.10.0
   Compiling inout v0.1.3
   Compiling cipher v0.4.4
   Compiling aes v0.8.4
   Compiling errno v0.3.9
   Compiling home v0.5.9
   Compiling tempfile v3.10.1
   Compiling which v4.4.2
   Compiling darling_core v0.20.9
   Compiling serde_derive v1.0.203
   Compiling thiserror-impl v1.0.61
   Compiling mockall_derive v0.12.1
   Compiling darling_macro v0.20.9
   Compiling darling v0.20.9
   Compiling serde_with_macros v3.8.1
   Compiling mockall v0.12.1
   Compiling ocl v0.19.7
   Compiling scrypt-jane-sys v0.1.0 (https://github.com/spacemeshos/scrypt-jane-rs?branch=main#79634704)
   Compiling toml v0.5.11
   Compiling serde_with v3.8.1
   Compiling scrypt-jane v0.1.0 (https://github.com/spacemeshos/scrypt-jane-rs?branch=main#79634704)
   Compiling post-cbindings v0.7.8 (C:\Users\xxx\Desktop\spacemesh-cuda\post-rs\ffi)
error: failed to run custom build command for `spacemesh-cuda v0.0.1 (https://github.com/ZakuroLab/spacemesh-cuda.git?rev=7910031510ef2a7c1a7e7bcfe96d0e38ea921866#79100315)`

Caused by:
  process didn't exit successfully: `C:\Users\xxx\Desktop\spacemesh-cuda\post-rs\target\release\build\spacemesh-cuda-07756e9a49958c2a\build-script-build` (exit code: 101)
  --- stderr
  CMake Warning:
    Manually-specified variables were not used by the project:

      CMAKE_ASM_FLAGS
      CMAKE_ASM_FLAGS_RELEASE
      CMAKE_C_FLAGS
      CMAKE_C_FLAGS_RELEASE


  thread 'main' panicked at C:\Users\xxx\.cargo\registry\src\index.crates.io-6f17d22bba15001f\cmake-0.1.50\src\lib.rs:1098:5:

  command did not execute successfully, got: exit code: 1

  build script failed, must exit now
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
warning: build failed, waiting for other jobs to finish...

It stopped when compiling 'post-cbindings v0.7.8'. I do have cmake in my env, I guess there might be some module path issue. I saw similar issue here and I can try modify the build script a bit rust-lang/cmake-rs#118

@tickinbuaa
Copy link
Collaborator

Can you use CMake to successfully compile the C++ code in spacemesh-cuda? From the error message, I can't see any detailed errors.

@LiQing-Code
Copy link
Author

Can you use CMake to successfully compile the C++ code in spacemesh-cuda? From the error message, I can't see any detailed errors.

I have tried compiling the spacemesh-cuda code using CMake before and encountered many issues. While I was able to solve some of them, I still couldn't complete the compilation successfully.

@tickinbuaa
Copy link
Collaborator

Can you provide the error message you get when compiling the C++ code directly?

@LiQing-Code
Copy link
Author

Can you provide the error message you get when compiling the C++ code directly?

I have stopped trying to compile it for now and didn't keep a record of the previous errors. I'm currently waiting for the library's author or someone else to provide precompiled binaries.

@tickinbuaa
Copy link
Collaborator

Sorry, we do not currently have plans to provide compiled binary files.

@ziyiz
Copy link

ziyiz commented Jun 27, 2024

Can you use CMake to successfully compile the C++ code in spacemesh-cuda? From the error message, I can't see any detailed errors.

I can build spacemesh-cuda with CMake and get the spacemesh-cuda.lib with some tweaks:
a. 'set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} /O2")'
b. skip building the test

But I still got errs when build post-rs with cargo, I'm not familier with rust, trying to figure out settings in cbindings process

@ziyiz
Copy link

ziyiz commented Jun 27, 2024

Actually when I switched to git bash to build the lib, it gave me more info to narrow down the issue:

Building Custom Rule C:/Users/xxx/.cargo/git/checkouts/spacemesh-cuda-test-5dfbd5481bd83b17/7910031/CMakeLists.txt
    Compiling CUDA source file ..\..\..\..\..\..\..\..\..\.cargo\git\checkouts\spacemesh-cuda-test-5dfbd5481bd83b17\7910031\src\spacemesh.cu...

    C:\Users\xxx\Desktop\spacemesh-cuda\post-rs\target\release\build\spacemesh-cuda-22ab13b83af57fe5\out\build>"C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.0\bin\nvcc.exe"  --use-local-env -ccbin "C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.29.30133\bin\HostX64\x64" -x cu   -I"C:\Users\xxx\.cargo\git\checkouts\spacemesh-cuda-test-5dfbd5481bd83b17\7910031\include" -I"C:\Users\xxx\.cargo\git\checkouts\spacemesh-cuda-test-5dfbd5481bd83b17\7910031\src" -I"C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.0\include"     --keep-dir x64\Release  -maxrregcount=0  --machine 64 --compile -cudart static -std=c++17 -arch=all -Xcompiler="/EHsc -Ob2"   -D_WINDOWS -DNDEBUG -D"CMAKE_INTDIR=\"Release\"" -D_MBCS -D"CMAKE_INTDIR=\"Release\"" -Xcompiler "/EHsc /W1 /nologo /O2 /Fd"C:\Users\xxx\Desktop\spacemesh-cuda\post-rs\target\release\build\spacemesh-cuda-22ab13b83af57fe5\out\build\Release\spacemesh-cuda.pdb" /FS   /MD " -o spacemesh-cuda.dir\Release\spacemesh.obj "C:\Users\xxx\.cargo\git\checkouts\spacemesh-cuda-test-5dfbd5481bd83b17\7910031\src\spacemesh.cu"
    nvcc fatal   : A single input file is required for a non-link phase when an outputfile is specified

I'll take a look at this error later

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@ziyiz @tickinbuaa @Lothar1812 @LiQing-Code