Your Dream Job in one place Software Engineer Marketing Manager |

Purpose of the Position:

You will be a critical member of the InfoCepts Cloud Data Architect Team. This position requires a sound knowledge on Big Data using Cloud technologies, EMR, Athena, Spark-Scala, PySpark, S3, AWS Lambda etc. Strong foundation on database concepts and SQL is also required.

Location: Pune/Nagpur

Key Result Areas and Activities:

Study existing technology landscape and understand current data integration framework and do impact assessment for the requirementsShould be able to design complex Big Data use cases using AWS ServicesShould be able to reason about various architecture choices in terms of: Cost, Performance and DurabilityShould be able to suggest optimizations in existing designsEnsure optimal balance between cost and performanceProject documentation, Adheres to Quality guidelines & SchedulesWorks hand in hand with PM for successful delivery of project and provide Estimation, scoping, scheduling assistanceEffectively communicate architectural decisions to stakeholdersArticulate design decisions very clearly with stakeholdersPerform Proof-of-Concepts and document all observations before proposing a new solution.Conduct design review sessions with other teams and identify scope of improvement.Suggests automation to improve existing processesAssist other Data Engineers by providing expert advice or troubleshooting steps whenever requiredKeep suggesting new ways to improve team productivityCreate technology focused training plans whenever requiredDeliver technology focused training sessions with team members whenever requiredConduct Expert Knowledge Sharing sessions with Client Stakeholders whenever requiredAssist in RFPs for other Accounts whenever requiredAssist in designing case study documents whenever required

Work and Technical Experience:

Essential Skills:

Overall, 9+ years of IT Exp5+ years of AWS related projectIn depth knowledge of following AWS Services required: S3, EC2, EMR, Athena, AWS Glue, Lambda.Cloud Databases (Good to have) – AWS AuroraMPP Databases (anyone) – AWS Redshift, Snowflake, SingleStoreBig Data (Must have) – Apache SparkProgramming Language (Must have) – Scala, PythonBig Data Table formats (Must have at least one) – Delta Lake (open source), Apache IcebergOperating System (Must have) – Any flavor of Linux, WindowsMust have very strong SQL SkillsOrchestration Tools (Must have): Apache AirflowExpertise in developing ETL workflows comprising complex transformations like SCD, deduplications, aggregations etc.Should have thorough conceptual understanding of AWS VPC, Subnets, Security Groups, & Route TablesShould be a quick and self-learner and be ready to adapt to new AWS Services or new Big Data Technologies as and when required.Should know Data Fabric and Data Mesh concepts.Should know Data Warehousing concepts very well