info@smartsourcetec.com
MWBE Certified in PA, NJ and MA.

Position: Big Data Developer with Hadoop and Scalla

Location: Red Bank, NJ

Duties:

Design, build and maintain Big Data workflows/pipelines to process billions of records into and out of our data lake and Identity Graph
Fine tune application performance
Troubleshoot and resolve data processing issues
Engage in application design and data modeling discussions
Participate in developing and enforcing data security policies
Participate in capacity monitoring and planning
Build, maintain and execute unit test cases with high code coverage

Requirement:

QUALIFICATIONS

BS/BA degree in Computer Science, Information Systems or related field
3 years programming in Scala, Java, Python or GO
2 years developing on Hadoop/Spark or AWS EMR
2 years developing on an RDBMS such as Microsoft SQL Server, PostgreSQL, MySQL or Oracle
Experience with large data sets – regularly transforming and querying tables or sets of greater than 20 million records
Exposure to data hygiene routines and models

Experience in database design, development and data modeling

Ability to identify problems, and effectively communicate solutions to team
Ability to work in a dynamic multi-team environment as well as independently

ADDED VALUABLE SKILLS
Hadoop: HDFS, MapReduce, Hive, Pig
Exposure to AWS services such as EMR, Glue, Lambda, Step Functions, Aurora, DynamoDB
Data architecture
Database security
ETL using SQL or a scripting/programming language
Experience with fuzzy-logic matching and tools
NoSQL: HBase, AWS DynamoDB, Cassandra, MongoDB
Familiarity with Linux

DevOps Environment Experience

 

You can APPLY by sending your resume to apply@smartsourcetec.com 

Send detailed resume with at least three references to Attn: HR, Smart Source Technologies, Inc., 622 Georges Road,Suite 104, North Brunswick, NJ 08902

or EMAIL resume to: info@smartsourcetec.com