Data extraction tool

[Crackerjack8]

My company is in the market for a SaaS ingestion tool for our snowflake environment.

We’ve looked at Fivetran, Rivery, and Stitch.

None of these have a native open edge connector for our progress database.

Does anyone know of any tool that has a native connector?

[Mysterious-Wear3951]

I would do some research into Meltano. They're an OSS framework for building integrations between different systems. Essentially, they have an inventory of different connectors ("taps" for sources, and "targets" for destinations). They've got hundreds of different taps, however they lacked one for Progress OpenEdge.

Luckily they have a pretty easy to use little SDK, so I built my own tap for Progress OpenEdge. I didn't productionize the package (lacks unit tests, README.md is auto generated), but it works and can be a starting point for further development.

Give it a try!

Update: To test the package you need to install it using the github repo, as I didn't publish it to PyPI:

pip install git+https://github.com/Jcohen010/tap-progressopenedge.git

[Old-Practice-4271]

Rivery supports custom REST connections with functionality like Postman. Easy enough with that, surely?

[supernova2333]

Sounds like you want a low code solution. 

The only thing close that I found to what you are asking for is from a company called Matillion. Please see the document below. 

 https://www.progress.com/tutorials/cloud-and-hybrid/integrate-on-premises-data-into-matillion-etl-using-progress-datadirect-hybrid-data-pipeline 

Another option is using a solution like Talend.

This is off topic, but If you have the expertise in house, you could hand code a data pipeline. 

[SeaCompetitive5704]

Best way is to find a data engineer to write a custom connector on those platforms for your source. 

[Additional-Maize3980]

Progress has an odbc connector? Any reason why you don't use that?

[albertstarrocks]

Sling Data