Universal glue tool
reddit / selfhosted

----------------------------------------------------------------------
vrudaz · 2023-11-12 13:07

Hi.  Do you know any tool similar to orbital?
(https://github.com/orbitalapi/orbital) I discovered orbital a few
days ago but the official container doesn't start. I have a lot of
tasks in the company that involve transferring data downloaded from
API to csv or from API to API.  There is minimal data transformation
along the way, consisting of combining two jsons or selecting fields.
The API is mainly json http rest or pseudo rest. For me, it's a boring
job that I would like to automate

----------------------------------------------------------------------
XxNerdAtHeartxX · 2023-11-12 15:18

This is literally what I do for my day job. Right now, we use AWS
Lambdas (because corporate environment) with python.

If you're comfortable writing python, you could look into using a tool
like [Dagster](https://docs.dagster.io) for building your own ETL
pipelines with python. However, if you need a gui and aren't
comfortable coding, [N8N](https://n8n.io/) may be the tool you need.

It has integrations with certain APIs, but you would need to look into
the specific ones you are using, and possibly just use it's base
'requests' to connect to the api you need.

----------------------------------------------------------------------
vrudaz · 2023-11-15 04:02

Thank you!