Data Engineer

Compensation

: $94,330.00 - $148,460.00 /year *

Employment Type

: Full-Time

Industry

: Information Technology



About the Role:Are you an outstanding engineer who loves solving interesting challenges related to data at scale? Are questions such as 'How to move multiple TB of data per hour, and optimally compress and serialize it?' or 'How do you ensure we are resilient to data loss in case of failure?' what gets you excited? If so, this role may be a fit.You will work with some of the brightest minds in the industry, along with a team that will continuously challenge you.Responsibilities:* Design and develop high-throughput, low-latency data processing pipelines to quickly ingest and make data available on the Tapad platform across various distributed data stores* Analyze large datasets to identify opportunities to tune and improve the system* Experiment with various Hadoop frameworks like Hive, Pig and Scalding to identify the optimal approach for extracting valuable insights from massive datasetsQualifications:* Bachelors or Masters in Computer Science or related field* 3+ years of experience ingesting, processing, storing and querying large datasets* Professional Hadoop ecosystem experience, including storage optimization and job performance tuning* Expertise in Java, Python or similar language(s). Functional programming experience is a plus* Passion for code correctness and intuition about which values in data are to be expected in a business contextTools We Use:* Typesafe Stack (Scala, SBT, Play!, Akka)* Finagle, Unfiltered* Kafka, MySql, Aerospike, Vertica, Redis, Cassandra, Zookeeper* Hadoop, Scalding, Spark* Mesos, Marathon, Docker* Additional state-of-the-art technologies that enable us to be the bestPosted by StartWire. Apply now!
Associated topics: data administrator, data analytic, data architect, data engineer, data integration, data scientist, database administrator, etl, hbase, mongo database * The salary listed in the header is an estimate based on salary data for similar jobs in the same area. Salary or compensation data found in the job description is accurate.

Launch your career - Upload your resume now!

Upload your resume

Loading some great jobs for you...