Noida | India
Engineer
  • QualifiactionB.Tech(CS-IT) / MCA
  • Experience3 - 6 Years
Responsibilities
  • Working with data modeling of complex data
  • Exposure to retail 3pl and international preferred
  • Setting up scaling tuning, no sql, db, postgresql, cassandra mongo db ms sq
  • Helping team make the right choice of db based on nfr
  • Generating er diagrams db scripts
  • Working with data generation tools
  • Working on data cleansing
  • Handling of cache (elastic or redis) and master and transaction data for complex large volume multinational organization with high volume and low response time
  • learn and implement new db and cloud and technologies
  • Cloud knowledge and working on aws, azure, or google cloud
Desired Skills
  • In-depth architectural knowledge of Spark and Hadoop
  • Expert in building ETL pipelines using Spark (Pyspark)
  • Experience using Spark with HDFS
  • Experienced writing data pipelines using functional programming (Python - must, Java, or Scala)
  • Advanced ANSI SQL experience
  • Firm understanding of Big Data and traditional data processing, understanding the differences in-depth to make informed design decisions
  • Firm understanding of data Modelling OLAP vs. OLTP vs. Hybrid models
  • AWS, Azure, or Google Cloud knowledge (at least one cloud)