Tag Archives for " Pi "

Senior Data Engineer | Arvo / Parquet

SR-Data-Engineer_Hive-DevopsDNA

SR-Data-Engineer_Hive-DevopsDNA

Senior Data Engineer | Avro / Parquet

RecruiterDNA | DevOpsDNA – Portland, OR

  • Design and implement product features in collaboration with product owners, report developers, product analysts, and business partners within an Agile / Scrum methodology
  • Provide engineering on modern data processing technology stack including Spark, EMR, Airflow, Python and Snowflake within AWS
  • Contribute to overall architecture, framework, and design patterns to store and process high data volumes
  • Support the culture of team empowerment and engagement through successful self-management. Own your workload and contributions to the team
  • Proactively support product health by building solutions that are automated, scalable, and sustainable— be relentlessly focused on minimizing defects and technical debt
  • Build continuous integration and test-driven development environment
  • Mentor and guide other software engineers within the team including review code and provide feedback relative to best practices and improving performance

Qualifications:

  • Bachelor’s degree in Computer Science, Information Systems or other relevant subject area
  • 2 years’ additional relevant experience in lieu of a degree
  • 5+ years of experience with large-scale data engineering with emphasis on data analytics and reporting
  • Strong experience with SQL and Relational database engineering (Oracle, SQL Server, Teradata)— expert-level SQL abilities
  • 3+ years of experience developing in the Hadoop ecosystem, leveraging tools such as Pig, Hive, Sqoop, Spark and others
  • Good understanding of file formats including JSON, Parquet, and Avro
  • Experience developing solutions in Snowflake
  • Experience developing with the AWS EMR managed service
  • Experience developing with scripting languages such as Shell and Python
  • Experience with agile delivery methodologies in a fast-paced complex environment – Scrum, SAFe, Extreme Programming
  • Strong ability to multi-task and balance multiple priorities in a fast-paced environment

Apply Here