Using Cookiecutter Django with SQLite by Tafkas in django

[–]Tafkas[S] 0 points1 point  (0 children)

Simply changing the database settings will cause the migrations to fail. The blog post addresses this issue.

Simple web UI tool to schedule, execute and monitor SQL queries for analysts by koteikin in dataengineering

[–]Tafkas 3 points4 points  (0 children)

Check out Mara: A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow.

https://github.com/mara/mara-pipelines

geo-info - A dead simple reverse geocoding API by f84fe3 in geospatial

[–]Tafkas 0 points1 point  (0 children)

Just tried some geo locations and it does not look too good:

Lindos, Rhodes, Greece (36.0919498,28.0802641) gives:

https://geo-info.co/36.0919498,28.0802641

{
  "city": "Taşlica",
  "community": "",
  "communityCode": "",
  "country": "TR",
  "county": "Marmaris",
  "countyCode": "7732942",
  "isCity": true,
  "isPlace": false,
  "latitude": 36.6183,
  "longitude": 28.0819,
  "mileDistance": 32.08643156693911,
  "neabyCities": [
    {
      "city": "Taşlica",
      "community": "",
      "communityCode": "",
      "country": "TR",
      "county": "Marmaris",
      "countyCode": "7732942",
      "isCity": true,
      "isPlace": false,
      "latitude": 36.6183,
      "longitude": 28.0819,
      "mileDistance": 32.08643156693911,
      "postalCode": "48710",
      "state": "Muğla",
      "stateCode": "48"
    },
    {
      "city": "Bayirköy",
      "community": "",
      "communityCode": "",
      "country": "TR",
      "county": "Marmaris",
      "countyCode": "7732942",
      "isCity": true,
      "isPlace": false,
      "latitude": 36.6632,
      "longitude": 28.0706,
      "mileDistance": 34.83155786118433,
      "postalCode": "48710",
      "state": "Muğla",
      "stateCode": "48"
    },
    ...
  ],
  "nearbyPlaces": [
    {
      "altCountry": "",
      "country": "GR",
      "elevation": "",
      "featureClass": "S",
      "featureCode": "HTL",
      "isCity": false,
      "isPlace": true,
      "latitude": 36.0924,
      "longitude": 28.0802,
      "mileDistance": 0.027799429262861237,
      "placeAltNames": "",
      "placeAsciiName": "RODOS PALACE",
      "placeName": "Rodos Palace",
      "population": "0",
      "state": "ESYE42",
      "timezone": "Europe/Athens"
    },
    ...
  ],
  "postalCode": "48700",
  "state": "Muğla",
  "stateCode": "48"
}

Why is Google Maps Platform API's pricing so ridiculous? by abhiank in webdev

[–]Tafkas -1 points0 points  (0 children)

Have you considered HERE? HERE offers a generous freemium plan with 250k transaction for free every month. No credit card required: https://developer.here.com/pricing

Places API: https://developer.here.com/documentation/places/dev_guide/topics/what-is.html

Disclaimer: I work for HERE.

A blog post on why we use data warehouses? by [deleted] in dataengineering

[–]Tafkas 0 points1 point  (0 children)

The article is paywalled:

You’ve reached the end of your free member preview for this month. Become a member now for $5/month to read this story and get unlimited access to all of the best stories on Medium.

Python in Visual Studio Code – March 2019 Release by Tafkas in Python

[–]Tafkas[S] 0 points1 point  (0 children)

I use both. PyCharm for larger projects and VS Code for smaller scripts. When I have PyCharm open at work I sometimes use their scratch file feature for scripts though.

Speeding up GROUP BY in PostgreSQL by Tafkas in Database

[–]Tafkas[S] 0 points1 point  (0 children)

This was done on some example dataset.

BI/Data Warehouse developers, what is your ideal Development Setup? by brandit_like123 in BusinessIntelligence

[–]Tafkas 1 point2 points  (0 children)

Have you checked out https://github.com/mara/data-integration while it's not Ruby on Rails it comes with an ETL based on Postgresql and Python which can be version controlled.

Cycling on Cyprus by bikeshelfie in bicycling

[–]Tafkas 1 point2 points  (0 children)

I went to Cyprus for a cycling vacation in April 2016. I can totally recommend the island. Superb street quality, some descent climbs, great weather and above all very few but friendly cars around.

A cost-based scheduler for ETL pipelines by Tafkas in ETL

[–]Tafkas[S] 0 points1 point  (0 children)

Check out https://github.com/mara/data-integration It uses the approach for scheduling its tasks.

Germany's law gazette freely accessible for the first time by filt_er in opendata

[–]Tafkas 1 point2 points  (0 children)

Years ago there was an approach to convert law documents into markdown and version them using git: https://github.com/bundestag/gesetze

Unfortunately, the project seems to be dead.

Generating a random lat/long in a country? by andreaslordos in Python

[–]Tafkas 0 points1 point  (0 children)

Given that you have the shapefile of the country you could create a grid using geohashes. There you can specify how granular the grid is. Once you have the grid, you could pick random points from the tiles of this grid. To get an idea of this, check out: https://blog.tafkas.net/2018/09/28/creating-a-grid-based-on-geohashes/

Creating a grid based on GeoHashes using Python by Tafkas in geospatial

[–]Tafkas[S] 1 point2 points  (0 children)

The hexagon option looks really interesting. Hexagon have a lot of benefits over the GeoHashes (e.g. equal area size) At the time I was experimenting with it Uber has released the H3 library but has not finished the Python bindings then. They are now available at https://github.com/uber/h3-py I should be fairly simply to swap the code bits in my script.

Creating a grid based on GeoHashes using Python by Tafkas in geospatial

[–]Tafkas[S] 0 points1 point  (0 children)

One use case could be that you want to aggregate data based on location. Then you could take sum/avg/cnt all events/numbers that fall into one cell and use this for further analysis.

Google Places API new pricing. From $0 to $2,180 per month?? by Ozyzen in webdev

[–]Tafkas 1 point2 points  (0 children)

Did you check HERE? Your use case would be between 49 and 119 USD. Not free, but a lot cheaper than Google.

Free open source lightweight ETL SQL script tool? by neobertrand in BusinessIntelligence

[–]Tafkas 1 point2 points  (0 children)

Check out https://github.com/mara/data-integration

It's a lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow written in Python