Bigdata Engineer

Description:

Knowledge of Financial reporting ecosystem will be a plus .5+ years of experience within Data Engineering/ Data Warehousing using Big Data technologies will be a add-on Expert on Distributed ecosystems Hands-on experience with programming using Core Java or Python/Scala. Expert on Hadoop and Spark Architecture and its working principle Hands-on experience on writing and understanding complex SQL(Hive/Py Spark-dataframes), optimizing joins while processing huge amounts of data . Experience in UNIX shell scripting . Ability to design and develop optimized Data pipelines for batch and real time data processing Should have experience in analysis, design, development, testing, and implementation of system applications Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows.