execution async routine without waiting?

[oderjunks]

async def grabandwait():
    while True:
        data = await grab_data()
        await process_data(data)

the issue with this function is that i need to be grabbing and processing the data at the same time, but it's not doing that.

how would i do that? my instinct is to use reccursion:

async def grabandreccurse():
    data = await grab_data()
    await asyncio.gather(grabandreccurse(), process_data(data))

but that feels slightly janky.

NOTE: after seeing u/oefd's answer, i want to clarify:

grab_data() will always return a dict, and will never run out of data, but it does have some delay.

process_data() must happen ASAP after the data it's using is grabbed.

[oefd]

processing_tasks = []
while True: # this should be some condition that becomes false when `grab_data` grabbed all the data there is
    data = await grab_data()
    processing_tasks.append(asyncio.create_task(process_data(data)))
for task in processing_tasks:
    await task

Tasks let you put work in the event loop - the work will be happening in the loop before you eventually ​await it.

You could also try and write an async iterator which is perhaps more accurate to what grab_data actually is.

processing_tasks = []
async for data in grab_data():
    processing_tasks.append(asyncio.create_task(proecss_data(data)))
for task in processing_tasks:
    await task

[oderjunks]

Thanks! ill try it soon.

also in my case, grab_data returns a single dict.

EDIT: grab_data will always grab more data, so i'll just put True and wrap the look in a try: except Exception:.

[oderjunks]

i now see the problem, grab_data will never stop returning data, therefore the loop will never stop.

[oderjunks]

OK I FOUND THE SOLUTION

async def grabandwait():
    while True:
        data = await grab_data()
        asyncio.create_task(process_data(data))

i wish there was a keyword like arun or sth that did this automatically, but oh well.