AIRFLOW-EDI

Python DAG orchestrator for batch EDI.

Definition

Airflow exposes DAG, Operator, Sensor, XCom (cross-comm), Pool (resource throttle). Native EDI operators: SFTPOperator, SSHOperator, custom EDIFACT parser via PythonOperator. Airflow 3 (June 2024) introduces DAG versioning, deferrable operators, modern executors (CeleryExecutor → KubernetesExecutor).

Origin

Created by Maxime Beauchemin at Airbnb in 2014 ; Apache top-level April 2016 ; v3 June 2024.

Example in context

An EDI hub orchestrates 200 partner SFTP fetches every hour via Airflow KubernetesExecutor.

Related terms

• Dagster — modern competitor.