• AirFlow
• Python
• GCP Cloud services - Big Query, DataFlow, Cloud Composer • experience with configuration driven ETL data flow pipelines and scheduling, Apache Spark
• Experience with DevOps: CircleCI • Stream processing, Batch processing
• AirFlow
• Python
• GCP Cloud services - Big Query, DataFlow, Cloud Composer • experience with configuration driven ETL data flow pipelines and scheduling, Apache Spark
• Experience with DevOps: CircleCI • Stream processing, Batch processing