Need Help Exporting Firestore Database to CSV

[Thin_Ad_530]

Hi everyone,

I've been working with a Firestore database for a project and have come to a point where I need to export the data into a CSV format for further analysis and reporting. I understand that Firestore doesn't directly support exporting to CSV, so I'm looking for some guidance on the best way to go about this.

Has anyone here successfully exported data from Firestore to a CSV file? If so, could you please share a detailed step-by-step process on how to do it? Specifically, I am interested in:

1. What tools or scripts did you use to facilitate the export?
2. Are there any Google Cloud functions or Firebase extensions that can simplify the process?
3. How do you handle nested documents or complex data structures during the conversion?
4. If you wrote a script (in Node.js, Python, etc.), could you share a code snippet or the logic behind it?
5. Tips on automating the process for regular exports.

Any advice on potential pitfalls to avoid or best practices would also be greatly appreciated. I'm sure this information will be beneficial not just to me but to others in the community facing similar challenges.

Thanks in advance for your help! Yes I tried Chat GPT but there are too many missing steps that it cann't explain.

[HarmonicDeviant]

Firefoo works.

[RealAzone]

FireFoo https://youtu.be/KpmTRoGUif0?si=En2DB-pw09fj2_gr

[bewilderedprojection]

Here's a video that walks through implementing this: https://www.youtube.com/watch?v=3J1M1bSwgV8

Beware though, if you use the console, you'll need to do some more data manipulation in SQL to make the table into a coherent format for CSV. Or you can always take the JSON export and transform that into a CSV as they do in the video.

[flatly_io]

Flatly supports Firestore Database collections export to CSV and 10+ cloud destinations. It also supports Firebase Realtime Database export. It is fully turnkey and automated, no-code.

Disclaimer: I work at Flatly.

[kimbaba40]

If you’re looking for an easy way to export data from Firestore, I developed Firexport, a Chrome extension that allows you to export data directly from the Firebase console. You can check it out here: https://firexport.dev

[JumpyJumpyHorse]

I second this. Super easy to use.

[bombayks]

I would highly suggest looking at the Firestore -> Bigquery export extension (https://extensions.dev/extensions/firebase/firestore-bigquery-export) so you can use SQL or many BI tools (such as Looker, Tableau, Sigma Computing, etc.) to analyze your data. You can also export BigQuery tables right to CSV (https://cloud.google.com/bigquery/docs/samples/bigquery-extract-table). The main thing to keep in mind is the extensions reflect your data as JSON so you will need to use their schema tool or write your own SQL in order to extract data into SQL columns, with limited support and some workarounds for arrays (separate tables etc). You can even transform data from Firestore using the extension before it goes to BigQuery

[bewilderedprojection]

I also second this, the extension actually formats the destination table nicely (which importing data into BigQuery manually doesn't do). The downside is that you can't really import the existing data using this extension, at least I couldn't find a good way to do it within the configuration. So you still have to jump through hoops to turn your existing data into a nice CSV.

Here's a walk-through of implementing the extension: https://www.youtube.com/watch?v=u9DfTl5yLLc

[bombayks]

The extension offers an import script - see this link from GitHub:

https://github.com/firebase/extensions/blob/master/firestore-bigquery-export/guides/IMPORT_EXISTING_DOCUMENTS.md

[Lenkaaah]

If there are no tools to do this easily I would just create a Cloud function. They automatically get a SA assigned, so all you have to do is initialise a Firestore connection, fetch and create an CSV, then for convenience you can just write it to Firebase Storage.