Data Engineer


Job TitleData Engineer
Experience2-7 years
Job LocationPune
DescriptionSGA's Data Analytics (DA) team requires enthusiastic Data Engineer who can use all the available tools in the market and experience in predictive analytics to solve complex problems and drive business decisions. Leverage experience in usage of tools and technologies like, SQL, Python, R, etc. to Extract transform and prepare large scale datasets from various data source systems. Employ the appropriate algorithms to discover patterns, test hypotheses, and build actionable models to optimize business processes. Solve analytical problems, and effectively communicate methodologies and results. Draw relevant inferences and insights from data including, identification of trends and anomalies.
  • Creating complex data processing pipelines
  • Become solution architect to articulate the technology roadmap at tactical and strategic levels
  • Designing scalable implementations of the models developed by our Data Scientists
  • Deploying data pipelines in production based on Continuous Delivery practices
  • Advising clients on the usage of different distributed storage and computing technologies from the plethora of options available in the ecosystem Ideally Developing and testing models using appropriate tools and technologies and deploying the same in the production environment
Skills Required
  • Advanced Python & PySpark
  • Knowledge of Regex
  • Apache Spark (Databricks)
  • Cloud & Distributed Computing
  • Object Oriented Programming
  • Web Scrapping
  • Knowledge of Data Quality
  • Ability to write efficient and reusable code
  • SQL (Intermediate level),
  • APIs (Look for terms like REST or SOAP),
  • GIT or BitBucket or SVN
  • Experience building and deploying large scale data processing pipelines in a production environment
  • Experience in SQL Databases: SQL server, MySql, Redshift, Access etc.
  • Experience with REST APIs, GIT, AWS & DevOps skill-set is highly desired
  • Strong communication and client-facing skills with the ability to work in a consulting environment is essential
  • Interest to learn and improve all rounded skill set all the time
  • Masters in Computers/ Statistics / Maths

Apply for Data Engineer