• Pull Skill Technologies
  • $95,660.00 -139,760.00/year*
  • Coraopolis , PA
  • Information Technology
  • Full-Time
  • 112 Nyetimber Pkwy

Role: SPARK/SCALA Developer
Location: Plymouth, PA
Duration: Long-term Contract

Job Description:
Good knowledge and Hands on Scala Programming
Good skills on modular program development in Scala
Proficiency in Spark Scala for technical development and implementation
Data pipeline using Spark Scala
Load disparate data sets by leveraging Kafka consumers
Ability to utilize Hive, Spark, Cassandra, Mesos and Kafka
Experience with AWS components and services, particularly EMR, S3, and Lambda
Good understanding of file formats including JSON, Parquet, Avro, and others
Strong development skills around Hadoop, Spark, MapReduce, and Hive
Strong understanding of Hadoop internals
Experience with open source technologies such as Cassandra
Experience with messaging and complex event-processing systems such as Kafka and Storm
Facilitate in job scheduling/monitoring
Good knowledge on Spark concepts and Implementation
Extensive hands on Data frame and Dataset operations of Spark
Good Understanding of Bigdata Technologies and Hadoop
Good knowledge on Hive and HiveQL
Knowledge on Cassandra Architecture and CQL is desirable
Good Hands on in Hadoop stack (MapReduce, Hive, Sqoop, Oozie)
Excellent in writing shell scripts
Experience with application architecture in a big data environment.
Expert with Big Data technologies like Hadoop, Spark, Scala, Hive, HBase, Pig, Cascading
Experience with AWS technologies or equivalent cloud stack As a hands-on engineer, influence all architecture decisions
Build reusable code, with the ability to scale with very large data volumes
Knowledge on Java Programming is desirable
Data Migration/ETL knowledge is desirable

Thanks
Azam Tauhid

Desk : Ext: 102

- provided by Dice
Associated topics: backend, back end, c c++, developer, devops, java, matlab, programming, sdet, software development engineer
Associated topics: .net, algorithm, backend, c c++, devops, programming, sde, sdet, software engineer, sw

* The salary listed in the header is an estimate based on salary data for similar jobs in the same area. Salary or compensation data found in the job description is accurate.

Launch your career - Upload your resume now!


Loading some great jobs for you...