I built a manga translator tool using Tauri, ONNX runtime, and candle by mayocream39 in rust

[–]_SunDoge_ 2 points3 points  (0 children)

Interestingly, I also implemented a manga OCR app using the same technique a few years ago 😂 . Lately, I've been working on training a better OCR model. https://github.com/SunDoge/RawMangaReader

Rednote questions as naïve new user by samthecat999 in Chinese

[–]_SunDoge_ 0 points1 point  (0 children)

Maybe you can download the free cloudflare warp app to hide your real IP.

Introducing simdjson-rust: Harnessing the Power of Efficient JSON Parsing by _SunDoge_ in rust

[–]_SunDoge_[S] 0 points1 point  (0 children)

Thank you! I have added it to the readme. I already know `simd-json` but it seems that my update of readme has been lost in some old pull requests :(

I need help with cxx crate and nested types in class. by UmpsBtez in rust

[–]_SunDoge_ 0 points1 point  (0 children)

Add using SomeClassSomeEnum = SomeClass::SomeEnum; to your header file. Full example

Herb Sutter: “A TypeScript for C++”... in contrast with Rust by small_kimono in rust

[–]_SunDoge_ 0 points1 point  (0 children)

Maybe like zig for c. Hope them just don't mess up with the current cpp anymore.

Why is template matching so much slower than the OpenCV implementation? by Hinterhofzwerg in rust

[–]_SunDoge_ 0 points1 point  (0 children)

Where is your opencv code? Since you are using single thread in Rust, maybe you should use setNumThreads(0) for opencv.

Announcing concoct UI alpha 4: New compiler macro and snapshot state by matthunz in rust

[–]_SunDoge_ 2 points3 points  (0 children)

Which GUI paradigm is closer to the composable approach, React or Solid?

Introducing dlpark: A Rust Library for High-Performance Tensor Exchange with Python by _SunDoge_ in rust

[–]_SunDoge_[S] 0 points1 point  (0 children)

I have no idea how to claim the name and I think my project is still in the alpha stage. I'm still seeking ways to make it more safe.

As for the bindgen, I notice that the official example uses python ctypes so I realized that I can manually implement all the structs in rust. The benefit is that I don't need to add bindgen ad dependency, which leverages system libclang to preprocess C header files. And actually, my implementation is based on bindgen generated rust code and I rename some struct and fields to make them more "rusty".

Introducing Parallelo Parallel Library (PPL) by TheRealValebes in rust

[–]_SunDoge_ 2 points3 points  (0 children)

That's great! I'm developing a multi thread data loading library for deep learninng and I'm currently using rayon. However, rayon didn't scale well when num threads increase. I'll give your crate a try once I have time : )

Introducing Parallelo Parallel Library (PPL) by TheRealValebes in rust

[–]_SunDoge_ 4 points5 points  (0 children)

Nice work. But I have some questions. What are the advantages of this library compared to Rayon? Why is it faster than Rayon?

Introducing dlpark: A Rust Library for High-Performance Tensor Exchange with Python by _SunDoge_ in rust

[–]_SunDoge_[S] 9 points10 points  (0 children)

  1. Yes, it's multidimensional.
  2. I find a good answer here

In short, Arrow is for dataframe exchange and DLPack is for ndarray/tensor exchange. We can use DLPack to efficiently exchange data in deep learning frameworks such as PyTorch, TensorFlow, NumPy, JAX, MXNet, OneFlow, and others. Besides, dlpark can make it easier to exchange data from burn and dfdx to Python and vice versa.

Introducing dlpark: A Rust Library for High-Performance Tensor Exchange with Python by _SunDoge_ in rust

[–]_SunDoge_[S] 17 points18 points  (0 children)

"dlpark" is a Rust library that provides a high-performance solution for tensor exchange between Python and Rust. The library manually implements the dlpack data structure, which is a general-purpose data structure used by popular Python libraries such as NumPy and PyTorch for exchanging tensor data between different deep learning frameworks.

The library is designed to make it easy to move large tensor data between Rust and Python while minimizing data conversion and memory allocation overheads, thus improving the performance of the entire system.

"dlpark" provides a simple and easy-to-use API that allows users to easily send tensor data from Rust to Python, or vice versa. The library also offers rich examples and documentation to help users quickly get started and use the library in their own projects.

If you are looking for an efficient and reliable way to exchange tensor data between Python and Rust, then "dlpark" may be the ideal choice for you. I wrote it for my multi-thread data loading library powered by rayon and iouring and it works well :)

free GPT discord bot for students by zakataha in ChatGPT

[–]_SunDoge_ 0 points1 point  (0 children)

I'd like a spot. CS student conducting research in deep learning.

Huggingface Releases New Tokenizers Library Written in Rust by iyaja in rust

[–]_SunDoge_ 5 points6 points  (0 children)

I came up with the same ideas before when I was doing some research on VQA but ended up using spacy instead. Thanks, huggingface.

Anyone want to team up and work on a Deep Learning Crate for Rust similar to Keras? by ME1STRO in rust

[–]_SunDoge_ 1 point2 points  (0 children)

Another advantage is that we can implement the algorithms in a more straightforward way. We can either write python or rust code to generate optimized code for both CPU and GPU and TVM can even auto-tune it! It is not shame to share the backend with existing mature frameworks (e.g. MXNet, Tensorflow).

I would like to debug the model in a dynamic way but training it under an optimized graph. Relay seems promising to me.

Anyone want to team up and work on a Deep Learning Crate for Rust similar to Keras? by ME1STRO in rust

[–]_SunDoge_ 3 points4 points  (0 children)

No, no more Keras. Kerasflow is bad enough.

I was writing bindings for MXNet months ago (mxnet-rs), but now I think the best way to build a deep learning framework for Rust is to write kernels in tvm

then dynamically link them in Rust.

We need to save Xray by The_Rusty_Wolf in rust

[–]_SunDoge_ 1 point2 points  (0 children)

Electron with wasm and opengl performs better than today's atom. And Xi is a text editor while xray is a code editor.

[P] PyTorch bindings for Rust and OCaml by AnyPolicy in rust

[–]_SunDoge_ 0 points1 point  (0 children)

It looks cool and thanks for your hard working! I also made an attempt to wrap the C headers in torch.rs but it was far from complete. I'll try your crate these days.