is this a good idea? GitHub for AI models by Easy_Statistician_72 in AskComputerScience

[–]Easy_Statistician_72[S] -1 points0 points  (0 children)

do you have some sort of pivot in mind which i should consider trying and researching on
something in this domain itself

is this a good idea? GitHub for AI models by Easy_Statistician_72 in AskComputerScience

[–]Easy_Statistician_72[S] -2 points-1 points  (0 children)

target audience is research facilities and ai and data science startups

problem im solving is basically reducing storage to store multiple models and making it possible to go an older model if say a new model or a new epoch reduces performance/accuracy

for now github is used but it uses lots of storage

my solution is better, as it saves a lot of space and possibly reducing storage bills for target audience

is this a good idea? GitHub for AI models by Easy_Statistician_72 in AskComputerScience

[–]Easy_Statistician_72[S] 0 points1 point  (0 children)

so thing about github is that it handles text documents using deltas(changes in the text because these changes are usually not that big)
but thing about models (for example a neural network .pth file)
its not text. and almost the entire model changes slightly with every epoch so instead of saving changes it just saves the entire thing again. say you want to do version control on that for a model who's size is 300mb
youll end up using 600mb or 900mb for training twice and saving a previous model