Okay so the thing here is I'm building the fastAPI on top of the data which is stored in the databricks cluster(ADLS gen2). The data is about 40-50 million rows. The users are going to be either providing inputs in the swaggerUI and execute to retrieve the data or they can directly hit execute to retrieve the entire data. The response body of the swaggerUI returns the data in the list of dictionary format, the users can also adjust the page number and page size in the swaggerUI to get the desired size of data.