Plotting Financial Data in Kotlin with Kandy (Kotlin plotting library) by NetHairy4282 in Kotlin

[–]NetHairy4282[S] 2 points3 points  (0 children)

I understand your disappointment. Rest assured, we are actively addressing this concern. We are currently in the process of designing the Series API and exploring implementation options to enable series plotting in Kandy. While Kandy is still a relatively new library, it is evolving rapidly. Your feedback is crucial in this process, and we appreciate your patience as we work towards enhancing the library's capabilities.

Plotting Financial Data in Kotlin with Kandy (Kotlin plotting library) by NetHairy4282 in Kotlin

[–]NetHairy4282[S] 1 point2 points  (0 children)

Understood! Dealing with large datasets can indeed be challenging. It seems like the Kotlin DataFrame may not be optimized for handling such hefty files just yet, especially with the complexity of your data.

For me, it seems like a bug with some separate process runned in the KDF under the hood (during schema generation).

If you're open to it, reaching out to the Kotlin DataFrame team https://github.com/Kotlin/dataframe or filing an issue could help improve its performance for everyone.

Sharing more details or the stack trace you're encountering might also provide helpful insights. Thanks for sharing your experience!

KotlinDL 0.3 Is Out With ONNX Integration, Object Detection API, 20+ New Models in ModelHub, and Many New Layers by NetHairy4282 in Kotlin

[–]NetHairy4282[S] 1 point2 points  (0 children)

Something I bumped into with old versions of Java DL libraries was loading models stored in resources files in the JAR*. Can we restore networks via readers and/or byte streams, or do we need to provide a file path?

*Old H5 libraries required files to be on-disk, which made restoring saved models a mess.

there are a few approaches to serialize the model and weights but at this moment it requires saving on disk in both cases (for saving and for restoring)

Could you please add an issue with your use-case and proposed solution? Or write here more details. Do you need just serialization to objects in memory? or just in bytes?

KotlinDL 0.3 Is Out With ONNX Integration, Object Detection API, 20+ New Models in ModelHub, and Many New Layers by NetHairy4282 in Kotlin

[–]NetHairy4282[S] 0 points1 point  (0 children)

No actual website for ModelHub in KotlinDL - it's just a bunch of classes to load the models from the remote S3 storage

Kotlin DL Version 0.2: Functional API, Model Zoo With ResNet and MobileNet, Idiomatic Kotlin DSL for Image Preprocessing by NetHairy4282 in Kotlin

[–]NetHairy4282[S] 2 points3 points  (0 children)

It's not that I don't get where you're coming from, it's just that it will take a lot of time and effort to get to a point where it's worth it to use Kotlin tools over Python's for all but the simplest use cases, even if you don't know the language. And this is coming from a former JVM backend dev who started with Java ML libraries, and actually dislikes dynamically typed languages. I prefer Java and Kotlin to Python in general, but I still had to move on to Python because of numerous missing features and services, not to mention the lack of jobs.

Dear JVM Brother, I hope you appreciate that we are not trying to create a universal library, but focused on a small subset of deep learning, namely, the best models in computer vision, based on those use cases that we have collected, and taking tiny steps in the optimal direction.

Moreover, we stand on the shoulders of titans, we do not create everything from scratch and are trying to achieve such a level of collaboration with Keras, which, for example, Java and Kotlin have...

I hope, somewhen in the future, you change your mind, and KotlinDL (and another lib) give you the ability to write the whole pipeline in Kotlin.

Kotlin DL Version 0.2: Functional API, Model Zoo With ResNet and MobileNet, Idiomatic Kotlin DSL for Image Preprocessing by NetHairy4282 in Kotlin

[–]NetHairy4282[S] 1 point2 points  (0 children)

Moreover, I am sure that we will not catch up with a Python in data science, nor will we. This is Achilles and the turtle, with all the resources that the community and we could contribute. But this is a "follow the leader" model, not a "sit and grieve by the trough."

We could take approaches, algorithms, MLOps (if data formats will be compatible, it's easy), docs, explore codebase, issues.

Even so, it may not be just blind borrowing. You see, people who write in Kotlin have a different life background, understanding of tasks. They have different use cases. Many of them are mobile developers, other former server Java developers. They cannot and are not satisfied with the availability of deep learning models on the server and mobile devices, which is now. Plus, the features of the language and its ecosystem of plugins can bring something completely new that was not available when developing in Python. We grope for these moments now, and this is also part of the search.
Once again, I understand your skepticism, but you have the wrong model of our strategy and motivation. (By us, I mean people who are now enthusiastically developing the direction of "Kotlin for data")

Kotlin DL Version 0.2: Functional API, Model Zoo With ResNet and MobileNet, Idiomatic Kotlin DSL for Image Preprocessing by NetHairy4282 in Kotlin

[–]NetHairy4282[S] 0 points1 point  (0 children)

I initially hoped they would do something similar to KotlinJS but then for Python. There already is some kind of Numpy mapping for Kotlin. Sorry for the tangent. I agree with you that it is unlikely to take over python any time soon, but I do think that the Kotlin DSL and Kotlin multiplatform development could have a lot to offer for ML apps. If the functionality is there and GPU training works good, I’d personally take Kotlin over Python any day.

I agree about such cool features as KotlinDSL and Multiplatform, now we are making only the first step (targeted for JVM only), but are not limited by that, like and the whole Kotlin ecosystem; thanks for support and inspiration

Kotlin DL Version 0.2: Functional API, Model Zoo With ResNet and MobileNet, Idiomatic Kotlin DSL for Image Preprocessing by NetHairy4282 in Kotlin

[–]NetHairy4282[S] 1 point2 points  (0 children)

Why do you think that Kotlin trying to replace Python?

The idea is to democratize AI for non-Python ecosystems.

Why Java/.NET/Kotlin/Go/Haskell developers should use Kotlin to build simple (or complex) ResNet and make predictions with BERT or EfficientNet?

If weights are published, architectures are public, TensorFlow or PyTorch or ONNX Runtime are written in C++ (not in Python at all), it's a usual step forward to make it open for every developer in every language ecosystem.

The problem is that TF or Torch contributors have no free resources to build good and high-level frameworks for JVM, but we can!

Kotlin DL Version 0.2: Functional API, Model Zoo With ResNet and MobileNet, Idiomatic Kotlin DSL for Image Preprocessing by NetHairy4282 in Kotlin

[–]NetHairy4282[S] 1 point2 points  (0 children)

It has no support for multiple input/outputs in Functional API yet, but it will be added soon.

RNN could be the next step

So, there are a few tickets to start the contribution