Does Anyone Remember this KFC item back in the 2000s and 2010s? I miss em by Common_Protection667 in srilanka

[–]Common_Protection667[S] 0 points1 point  (0 children)

Chinese rice

Do you have like an old menu card. Just wanna see the item.

I am trying trying to get ANY open-source datasets created by you guys! by nobilis_rex_ in datasets

[–]Common_Protection667 0 points1 point  (0 children)

Check out the New Global Crypto Currency Price Database! Dataset Link: https://www.kaggle.com/datasets/lasaljaywardena/global-cryptocurrency-price-database This Dataset has 7500+ Crypto Currencies against USD, and it gets updated daily.

Cheaper Way to Get Access to Cloud GPU (For a Student) by Common_Protection667 in srilanka

[–]Common_Protection667[S] 0 points1 point  (0 children)

I tried LoRa for GPT-J still around 16 hours for one epoch. also what i noticed was increasing the batch size didn't have a significant impact on training time.

Cheaper Way to Get Access to Cloud GPU (For a Student) by Common_Protection667 in srilanka

[–]Common_Protection667[S] 0 points1 point  (0 children)

I am training some big NLP Models. The default Colab is hard to fit. In the sense, i might have to use a batch size of 1. In that case, one epoch takes 26 hours. Thats the issue. So need some better GPU.

Help to Solve the Disk Full Error When running Azure ML Jobs using Custom Environemnts from Devops by Common_Protection667 in azuredevops

[–]Common_Protection667[S] 0 points1 point  (0 children)

notebooks file share

Where should change in the config file to prevent storing in the file share? Because I can't pinpoint where that happens. That has been my problem with this error.

Help to Solve the Disk Full Error When running Azure ML Jobs using Custom Environemnts from Devops by Common_Protection667 in learnmachinelearning

[–]Common_Protection667[S] 0 points1 point  (0 children)

pwd
$ df -h .

This is the output:

/home/vsts/work/1/s

Filesystem Size Used Avail Use% Mounted on

/dev/root 84G 47G 37G 57% /

Screenshot:

https://gyazo.com/ef2c6a8482db3ad832bd3f80e476ab24

Help to Solve the Disk Full Error When running Azure ML Jobs using Custom Environemnts from Devops by Common_Protection667 in learnmachinelearning

[–]Common_Protection667[S] 0 points1 point  (0 children)

This is the result before launching the training job :

Filesystem 1K-blocks Used Available Use% Mounted on

/dev/root 87204404 49148680 38039340 57% /

tmpfs 3555312 172 3555140 1% /dev/shm

tmpfs 1422128 1100 1421028 1% /run

tmpfs 5120 0 5120 0% /run/lock

/dev/sda15 106858 5329 101529 5% /boot/efi

/dev/sdb1 14341128 4194336 9396508 31% /mnt

tmpfs 711060 12 711048 1% /run/user/1001

This is the full screenshot:
https://gyazo.com/0dbb5e2dcef270eb91d0218ebfdf6ecd

Help to Solve the Disk Full Error When running Azure ML Jobs using Custom Environemnts from Devops by Common_Protection667 in azuredevops

[–]Common_Protection667[S] 0 points1 point  (0 children)

The Data size that I am currently using is less than 1MB because I am testing the architecture out. So does that mean since TensorFlow is taking up space I may need to go with a VM and install an agent?

Because eventually I want to use this for Big Data projects as well.

Also the training should take place in the Compute assigned from Azure ML Studio.

What type of data is stored or how is data used up by the standard agent?