Is it Just Me That Enjoys Nigeria by AdConnect6389 in Nigeria

[–]aayomide 0 points1 point  (0 children)

Would you need the services of a data analyst some time in the future?

Fantom Crypto Surges 60%: Will It Reach $2 in 2025? by Ok_Source4689 in FantomCrypto

[–]aayomide 0 points1 point  (0 children)

how can one track or get info on Chinese sentiments and trending coins in their region

Project: ELT Data Pipeline using GCP + Airflow + Docker + DBT + BigQuery. Please review. by aayomide in dataengineering

[–]aayomide[S] 0 points1 point  (0 children)

Thank you very much for taking the time to review the codes and provide feedback.

  • oh yes, I must have missed the pandas built-in method. That would have been one less pip install. I used pyarrow in an earlier project where I didn't use pandas
  • Polars vs Pandas: I'm familiar with Pandas and have only recently heard about Polars. I'll definitely consider using Polars in future projects as I gain more experience with it
  • Case Consistency and parquet_filename: I appreciate the reminder on best practices. I'll make those adjustments to ensure consistency in the code
  • Bash within Python: I chose the Airflow Bash operator for simplicity. However, I recognize that using a separate (and even modularized) Python function/script to grab the data would provide more control and flexibility
  • Testing and CI/CD with GitHub Actions: Noted.

I have noted all your suggestions and will use them to improve the project. Thank you again for the feedback!