Azure Data Engineer
Irving, TX
Full-Time, Permanent
$110,000 - $120,000
Required Skills:
Experience in GCP/Azure, Strong Data modelling, Python, Experience with RDBMS, Big Data processing frameworks and tools (Cloudera, Sqoop, Hive, Impala, Spark), DevOps tools and techniques (e.g. continuous integration, Jenkins, Puppet, etc)
Preferred Skills:
Experience building/migrating data pipeline from on-prem to Cloud (GCP or any cloud)
Understanding of cloud technologies
Unix Scripting
Tableau and Excel tool expertise
Job description:
Build data pipelines to ingest data from On-prem to cloud
Experience with Big Data processing frameworks and tools (Cloudera, Sqoop, Hive, Impala, Spark)
Experience with DevOps tools and techniques (e.g continuous integration, Jenkins, Puppet, etc)
Experience software development on a team using Agile methodology
Build data standardization & transformation logic using framework following Object Oriented Programming concept
Write Unit Test scripts
Implement standardized error handling & diagnostic logging
Schedule and maintain production workflows on-prem as well as cloud
Troubleshoot and resolve QA and Production defects
Handle code review and code deployment