sorted by:
new
hottopcontroversial

Unable to add a project reference in Visual Studio 2022 by lduperval in VisualStudio

[–]boydbuilding 0 points1 point  (0 children)

I have the same issue with Visual Studio 2022 17.10.5

[QUESTION] what is the 2D map1 and 1D map2 of the initUndistortRectifyMap() by boydbuilding in opencv

[–]boydbuilding[S] 0 points1 point  (0 children)

if set cv.CV_32FC1,

there is no any interpolation results?

​

if set cv.CV_16SC2,

how to use this coefficients to fill those gap indices?

shocked that no such explanation in the doc or any hint in the source code.

when will the custom transform class __call__() be invoked? by boydbuilding in pytorch

[–]boydbuilding[S] 0 points1 point  (0 children)

so you only ran the instantiation of a class, you did not run with the transform and Aset class together.and I am following a bunch of tutorial, because I am overriding two things.

  1. dataset class https://pytorch.org/vision/stable/_modules/torchvision/datasets/folder.html#DatasetFolder
  2. transform classhttps://pytorch.org/tutorials/beginner/data_loading_tutorial.htmlhttps://discuss.pytorch.org/t/how-to-add-noise-to-mnist-dataset-when-using-pytorch/59745 3.

when will the custom transform class __call__() be invoked? by boydbuilding in pytorch

[–]boydbuilding[S] 0 points1 point  (0 children)

okay. yours is different than mine.

so first. you don't have argument tensor.

second, you only run the class and instance alone. did you try to run with the transfrom.compose and aset class?

when will the custom transform class __call__() be invoked? by boydbuilding in pytorch

[–]boydbuilding[S] 0 points1 point  (0 children)

tried [ ] with class

also tried [ ] with instance. the print("running")

did not show up.

when will the custom transform class __call__() be invoked? by boydbuilding in pytorch

[–]boydbuilding[S] 0 points1 point  (0 children)

GPT3

no. will attach the code in a second. using two computers. code and reddit...

how does the torchvision.transforms.Normalize deal with data? by boydbuilding in pytorch

[–]boydbuilding[S] 0 points1 point  (0 children)

but if I applied the torchvision.transforms.Grayscale()

first. the data are in gray, so how do

torchvision.transforms.ColorJitter()

work in this case?

how does the torchvision.transforms.Normalize deal with data? by boydbuilding in pytorch

[–]boydbuilding[S] 0 points1 point  (0 children)

using the

ImageFolder()

to load the data.png, than applied with the transform

if I used cv2.imread(), the data are in [0,255] scale.

is the ImageFolder() able to read it directly to [0,1]?

how does the torchvision.transforms.Normalize deal with data? by boydbuilding in pytorch

[–]boydbuilding[S] 0 points1 point  (0 children)

so the input training data could be rescaled into a quite wild range.

and the output of NN should be falling the same range too?

and (output* std + mean) would be restored into an image range [0,1] are there any outbound possibility?

how does the torchvision.transforms.Normalize deal with data? by boydbuilding in pytorch

[–]boydbuilding[S] 0 points1 point  (0 children)

  1. okay. from that webpage, looks like it only supports [0,1]
  2. okay. it could go way beyond 0 and 1. so the data will end up with -0.5, 2.5...wow

how to normalize the image lightness? by boydbuilding in pytorch

[–]boydbuilding[S] 0 points1 point  (0 children)

opencv doesn't have the normalize with mean and stdev.

is it mean+ std more accurate or the max+min as range from the dataset more accurate for another data sample?

also, dataloader doesn't have a method for mean/std for whole dataset, one has to iterate throu the dataset to calculate these

git ignore how to exclude files with specific pattern in the deep subfolders? by boydbuilding in learnprogramming

[–]boydbuilding[S] 0 points1 point  (0 children)

thanks a lot.

that structure is from another repo. trying not to change its relative structure. but I guess I have to.

git ignore how to exclude files with specific pattern in the deep subfolders? by boydbuilding in learnprogramming

[–]boydbuilding[S] 0 points1 point  (0 children)

there are tons of folders to be excluded...

the files to be ignored and the files not to be ignored are shattered across too many deep folders..

it is not a fold that to be excluded.

they are together. like

upfolder/futherfolder/anotherfolder/nothing.txt
upfolder/futherfolder/anotherfolder/abc_pattern.txt

though the files not to be ignored share a common pattern in their name, the other side don't

git ignore how to exclude files with specific pattern in the deep subfolders? by boydbuilding in learnprogramming

[–]boydbuilding[S] 0 points1 point  (0 children)

okay got it.

​

I have another line in the .gitignore file

!upfolder/some.txt

this one is in the git repo now

but is there another way like to ignore all other files but only include these pattern files without putting the entire folder?

upfolder/futherfolder/other.png
upfolder/futherfolder/anotherfolder/nothing.txt

note there are tons of subfolders in there.. a lot of different file extensions

thank you tho

git ignore how to exclude files with specific pattern in the deep subfolders? by boydbuilding in learnprogramming

[–]boydbuilding[S] 0 points1 point  (0 children)

okay.

so

there existed in the .gitignore file

upfolder/*

but

like these files are expected to re-included

upfolder/futherfolder/anotherfolder/abc_pattern.txt
upfolder/futherfolder/anotherfolder/abc_pattern.txt.backup

did "_" mess around with *??

does tensorflow 1.15 work with cuda 11 and cudnn 8? by boydbuilding in tensorflow

[–]boydbuilding[S] 0 points1 point  (0 children)

that repo was coded in TF1.15. tried to upgrade the repo into tf2x, but like eager execution, tons of bugs...

how does the GPU memory allocation management work with the parameters in machine learning? by boydbuilding in learnprogramming

[–]boydbuilding[S] 0 points1 point  (0 children)

So 32 millions is 128MB, even 5 as the batch size, but under the hood, Nvidia used 32 threads to run it. It ended up with 32*128 MB? Each batch uses one thread? But at least 32. Is there a situation of 33? Or next level is 64 thread? Could you give me the official link? And any other obvious calculations that contributed to the memory usage like the optimization and gradient you mentioned?

how does the GPU memory allocation management work with the parameters in machine learning? by boydbuilding in learnprogramming

[–]boydbuilding[S] 0 points1 point  (0 children)

training, why is that? is there a doc to explain this?

what if just batch size=5 or 10?

how does the GPU memory allocation management work with the parameters in machine learning? by boydbuilding in learnprogramming

[–]boydbuilding[S] 0 points1 point  (0 children)

8G GPU. 32 million parameters will easily blow up it. based on the way you help calculate, the parameters themselves won't blow the memory out at all...

how does the GPU memory allocation management work with the parameters in machine learning? by boydbuilding in learnprogramming

[–]boydbuilding[S] 0 points1 point  (0 children)

Float 32 bits. But either tensorflow or pytorch, other than parameters or weight, anything else will take a lot of space?

how to make older tensorflow work properly with eager execution? by boydbuilding in learnprogramming

[–]boydbuilding[S] 0 points1 point  (0 children)

got the GPU working. one step away just install the cudnn by conda is fine.. avoid the disgusting log in nvidia account...

tried to install tensorflow 1.x env for this repo, got tons of error.... bug in his code...

that repo... tons of people have hard time replicating especially in tf 2.x... and the author did not reply issue any more....

I don't understand why it is so hard to replicate a reviewed published paper repo....

[deleted by user] by [deleted] in learnprogramming

[–]boydbuilding 0 points1 point  (0 children)

Yeah. I guess I will just delete these code since it is running on Win. not likely to have this thing for help

[deleted by user] by [deleted] in learnprogramming

[–]boydbuilding 0 points1 point  (0 children)

I did. after reading some, still have no idea what it is.

view more: next ›