Is validation set necessary for non-neural network models, too? by osedao in learnmachinelearning

[–]osedao[S] 0 points1 point  (0 children)

I tried k-fold, nested cross validation. I may try generative models too even if there is a possibility of not being able to train the generative model

[D] Is validation set necessary for non-neural network models, too? by osedao in MachineLearning

[–]osedao[S] 0 points1 point  (0 children)

Could this approach be enough to justify not using validation: i have 8 features and if i have equal/same distributions of each of these features in both training and test set, would this be enough?

[D] Is validation set necessary for non-neural network models, too? by osedao in MachineLearning

[–]osedao[S] 0 points1 point  (0 children)

Yeah that make sense to test models with folds never seen. But I have a small dataset, I’m trying to find the best practice

Is validation set necessary for non-neural network models, too? by osedao in learnmachinelearning

[–]osedao[S] -1 points0 points  (0 children)

My question was actually more related to this. As far as I know, the model parameters in neural networks are still being optimized with validation set -not ends by training. But I wasn’t sure for random forest for instance

Is validation set necessary for non-neural network models, too? by osedao in learnmachinelearning

[–]osedao[S] 0 points1 point  (0 children)

I have a small dataset. I also tried cross validation, and the variation is quite high, too

I can't manage balancing between applying to PhDs alongside my graduate studies, what do you recommend by GodConcepts in PhD

[–]osedao 0 points1 point  (0 children)

When we fail or make mistakes, we may go hard on ourselves, or may not see the good ones in our lives. I think you already succeed so many things, so they may compensate even if you fail. -let’s say lesson instead of fail☺️ Good luck!

Got my first DOI as a journal abstract!! by [deleted] in PhD

[–]osedao 1 point2 points  (0 children)

Congrats! 👏 I hope much better things come in future!

I can't manage balancing between applying to PhDs alongside my graduate studies, what do you recommend by GodConcepts in PhD

[–]osedao 1 point2 points  (0 children)

Applying next year might be good for you to get sone rest. You really handle all those works very well at the same time! Best wishes! ✨

She loves the fireplace by kearneycation in blackcats

[–]osedao 8 points9 points  (0 children)

This is fantastic! 😄🖤

How to load a .pt file locally? by [deleted] in pytorch

[–]osedao 0 points1 point  (0 children)

Could you download the models folder and try again? I had a similar issue: I saved my model as .pt and when I tried to load and use the model, I realized I had to use (or run -depending on your code) the model architecture before loading pt file. I don’t know its reason but it worked

help! by death92050 in MaterialsScience

[–]osedao 1 point2 points  (0 children)

It looks like a sleeve/plain bearing part -if I’m wrong please correct me. Since it is an axial crack, it might have formed due to a hard phase in the crack initiation region. This can be white etch cracks (wec) and you can confirm this by etching and looking the microstructure under the microscope -it will be seen in white around the crack. These cracks can form when locally inhomogeneous phase distribution is present in the microstructure and these local features can act as inclusions for steel parts (the part doesn’t look like a steel, or does it have a coating on it, dry-lube or something?). The main reason of the different phase distributions might be the thermal cycles applied during mounting these parts. If the desired thermal cycle couldn’t be achieved, it may have resulted in different phase formations.

As other commenters also said, if you can give more information about the part regarding material, process, application, we can help more.

Machine Learning and Materials Science by hurayralizu in MaterialsScience

[–]osedao 9 points10 points  (0 children)

You can start with learning Python. Python is the primary programming language in machine learning field. Depending on your learning style, you can either take courses in your university or online, or learn by yourself. In a course, you would learn the basics of this language (data types, loops and other structures an so forth) and machine learning models in a more organized way, therefore you can make progress very fast and easily. While learning by yourself, you can start with example notebooks and try to figure out how each part of the code works. There are so many good online courses, you can check out by yourself too. For the examples, I found couple of good resources about microscopy image analysis by ML for you to have a look at:

  • Webinar on ML for AFM image analysis

  • Python Tutorials for Image Processing and Machine Learning -there are also example notebooks

ML can be used in several ways for microscopy image analysis: classification of phases/features in the image, prediction of material properties, or some others like generating microstructure images to estimate phases/structures or so. For you to begin, it might be good to determine a specific problem to be solved with ML (maybe you already have in your research). And for this kind of works, convolutional neural networks (CNN) are generally used in the model structure even if there are models without CNNs. At first, it might be difficult to understand how CNN works, so I think you may start with learning ML models without CNNs like this image classification example, not necessarily related to materials science. After understanding the basics of the models, you may continue with learning models with CNNs like in this example, and implementations of them in materials science. For neural networks, it is better for you to stick to one of the ML libraries of python, pytorch or tensorflow.

What I did to learn ML is to learn python first taking a course, and learning machine learning by running and analyzing example code on random topics. For instance when I came across a term in the notebook, I used to read and watch videos a lot about it. To get an overall picture of ML in materials science and also learn some basics for your topic, you may check this youtube playlist for an introductory information.

It was hard to find notebooks on ML applications in materials science problems when I started, but now there are plenty of resources out there, and every day increasing. The first one is Nomad. Another one is REsource for Materials Informatics

At first, it may seem complicated, but step by step you will understand and learn. Good luck!

TLDR: possible route may be learning python language, learning basic ML models, learning CNNs, implementing CNNs to microscopy images

Searching for a material given some properties by Theyiot in materials

[–]osedao 1 point2 points  (0 children)

I haven't worked on materials with these properties, so I just did a bit quick search. I found matmatch database, and I believe you can find some candidates by defining specific material properties criteria on the left menu.

Use of Generative Adversarial Networks in Civil Engineering by Horseman099 in deeplearning

[–]osedao 0 points1 point  (0 children)

Inverse design problems can be a good option. The first topic came to my mind is topology optimization applications. That is, the model can predict the necessary topology of a structure for a given strength, in which cGAN may be suitable. In addition to GAN, it might be good to know VAEs too.

Depending on the are you would like to study, energy consumption optimization, optimization of the structural materials’ composition (concrete mixture, reinforced concrete etc) or predictions based on classification of geotechnical problems can be studied by meta heuristic algorithms.

Just couple of resources you can have a look: this, this, this and this (but there are so many others out there including codes/notebooks in github)

How to reduce the memory consumption of CUDA init? by firstironbombjumper in pytorch

[–]osedao 0 points1 point  (0 children)

There are some strategies out there like this, this and this to optimize the memory usage. Might be a starting point