APACHE-ATLAS-SPEC

Open-source Hadoop metadata governance.

Definition

Apache Atlas v2.x supports HBase, Hive, Spark, Kafka, NiFi. Extensible TypeSystem model (Entity, Classification, Lineage). Apache Ranger integration for policy. REST API + Kafka Notification. ASF Top-Level Project since 2017.

Origin

ASF incubation since May 2015 ; Top-Level Project June 2017.

Example in context

An EDI data lake uses Atlas to catalogue 500 Hive tables and trace lineage from raw EDIFACT file to PowerBI dashboard.

Related terms

• DataHub — modern competitor.