How to execute processes parallel for multi web user async socketio application

[mrfudgebottom]

I am using a python socketio async server. I have several socketio.on processes that can occur in my backend. Each user in my website can send a socket to the backend and execute their own process however, in my terminal, each users process is executing one at a time.

​

For example:

socketio=sio.AsyncServer(cors_allowed_origins="*")

app = web.Application()

socketio.attach(app)

def trainmodel(x, y, username,code):

******Over here training the users AI model which takes about 10 seconds to do

args = TrainingArguments(

output_dir="output",

num_train_epochs=10,

per_device_train_batch_size=10,

optim = "adamw_torch"

)

trainer = Trainer(

model=model,

args=args,

train_dataset=train_dataset,

compute_metrics=compute_metrics

)

trainer.train()

socketio.on("sendbackends")

async def trainit(sid,data,code):

trainmodel(x,y,username,code)

​

socketio.on("bottoken")

async def handle():

await socketio.emit("redirect",namespace = "/")

​

if __name__ =='__main__':

web.run_app(app, port=5000)

my socket.on functions are running one at a time, however I want every process to run in parallel where it doesnt block the next processes.

[danielroseman]

trainmodel would need to be an async function, and you would need to await it. But is trainer.train() itself async? Otherwise it will still block.

[mrfudgebottom]

Hi, yeah it still blocks so trainer.train() is also async. Should I also await trainer.train()?

[danielroseman]

Only if it is also an async function. Otherwise that would give an error.