Big Data Developer

Job Description

<p><p>Get AI-powered advice on this job and more exclusive features.</p>
<p>Direct message the job poster from Tekshapers</p>
<h3>Responsibilities</h3>
<ul>
<li>Design high quality deliverables adhering to business requirements with defined standards and design principles, patterns</li>
<li>Develop and maintain highly scalable, high performance Data transformation applications using Apache Spark framework</li>
<li>Develop/Integrate the code adhering to CI/CD, using Spark Framework in Scala/Java</li>
<li>Provide solutions to big data problems dealing with huge volumes of data using Spark based data transformation solutions, Hive, MPP processes like IMPALA</li>
<li>Create Junit tests and ensure code coverage is met as per the agreed standards</li>
<li>Should be able to work with a team who might be geographically distributed. Review the code modules developed by other juniors.</li>
</ul>
<h3>Required Skill Sets</h3>
<ul>
<li>Must-Have Hands on development experience in programming languages such as JAVA, SCALA using Maven, Apache Spark Frameworks and Unix Shell scripting</li>
<li>Should be comfortable with Unix File system as well as HDFS commands</li>
<li>Should have worked on query languages such as Oracle SQL, Hive SQL, Spark SQL, Impala, HBase DB</li>
<li>Should be flexible</li>
<li>Should have good communication and customer management skills</li>
</ul>
<h3>Desired Skill Sets</h3>
<ul>
<li>Good-to-Have Should have knowledge on Big data Data Ingestion tools such as SQOOP and KAFKA.</li>
<li>Should be aware of the components in Big Data ecosystem.</li>
<li>Should have worked on building projects using Eclipse IDE, Tectia Client, Oracle SQL Developer.</li>
</ul>
<h3>Seniority level</h3>
<p>Mid-Senior level</p>
<h3>Employment type</h3>
<p>Full-time</p>
<h3>Job function</h3>
<p>Information Technology</p>
<h3>Industries</h3>
<p>IT Services and IT Consulting</p>
<p>Referrals increase your chances of interviewing at Tekshapers by 2x</p>
<h3>Data Engineer, Corporate Data and Analytics</h3>
<p>Toronto, Ontario, Canada $135.00-$150.00 4 weeks ago</p>
<p>We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.</p></p>
#J-18808-Ljbffr