Data Engineer

Full-Time

Senior Level

Remote

Not defined

05 Jan → 04 Feb

Veridic Solutions

Durant, OK, USA

About Company

Veridic is a leading developer of cloud-based software. We combine talented minds with learning and innovation to solve the most complex issues. Our cloud certified engineers are uniquely positioned to serve your cloud projects
View Company Profile

Job Description

Veridic Solutions is looking for Data Engineer. Feel free to apply!

Job Responsibilities

  • Design and implement data products and features in collaboration with product owners, data analysts, and business partners using Agile / Scrum methodology
  • Contribute to overall architecture, frameworks and patterns for processing and storing large data volumes
  • Translate product backlog items into engineering designs and logical units of work
  • Profile and analyze data for the purpose of designing scalable solutions
  • Define and apply appropriate data acquisition and consumption strategies for given technical scenarios
  • Design and implement distributed data processing pipelines using tools and languages prevalent in the big data ecosystem
  • Build utilities, user defined functions, libraries, and frameworks to better enable data flow patterns
  • Anticipate, identify and solve issues concerning data management to improve data quality
  • Work across teams to resolve operational & performance issues

Requirements / Qualifications

  • MS/BS in Computer Science, or related technical discipline
  • 5+ years of experience in large-scale software development, 3+ years of big data experience
  • Strong programming experience, Python preferred
  • Extensive experience working with Hadoop and related processing frameworks such as Spark, Hive, etc.
  • Experience with messaging/streaming/complex event processing tooling and frameworks with an emphasis on Spark Streaming or Structured Streaming and Apache Nifi
  • Good understanding of file formats including JSON, Parquet, Avro, and others
  • Experience with RDBMS systems, SQL and SQL Analytical functions
  • Experience with workflow orchestration tools like Apache Airflow
  • Familiarity with data warehousing, dimensional modeling, and ETL development

How To Apply

Apply through GoRemotely.

View similar jobs