Required Technical and Professional Expertise
12 + years of relevant years of experience in data engineering
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience building and optimizing ‘Big Data’ data pipelines, architectures and data sets.
Build processes supporting data transformation, data structures, metadata, dependency and workload management.
Working knowledge of message queuing, stream processing, and highly scalable ‘Big Data’ data stores.
Experience with
Big Data tools: Hadoop, Spark, Kafka, etc.
Relational SQL and NoSQL databases, including Postgres and Cassandra.
Data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
Stream-Processing systems: Storm, Spark-Streaming, etc.
Object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
Preferred Tech and Prof Experience
Ability to present statistical results to lay persons in an easy to understand way.
Proven communication skills, both written and verbal.
Experience developing and testing Machine Learning and/or statistical projects.
When u call please mention you have found this job details on SherJobs
Tagged as: Application Developer, Big Data, Big Data Architect, c#, data engineering, Data pipeline and workflow management tools, Hadoop, IT, Java, Kafka, Postgres and Cassandra, Python, Relational SQL and NoSQL databases, Scala, Software Engineer, SPARK
Job Description About Company : Global management consulting and professional services firm that provides strategy, consulting, digital, technology and operations...
Apply For This JobJob Description PHP Developer -2 to 4 years of experience in PHP -Hands on experience in MVC frameworks like CakePhp...
Apply For This JobJob Description Design, code review and debug web applications, create robust high-volume production applications. Understand and support existing systems, and...
Apply For This JobJob Description Company Name:L&T MHI Surat, Hazira, Designation:PPE, Location:Surat Hazira, Qualification:Dip(Mechanical), Exp:1.5Years Salary: INR 1,00,000 – 2,50,000 P.A. Industry:Industrial Products...
Apply For This JobJOB DETAILS Locality Tarnaka, Habshiguda, Secunderabad, Dilsukh Nagar, Abids Role IT Software – Developer Min Salary Rs. 10000 Max Salary...
Apply For This JobCompany: Hitech Placements Experience: 3 to 7 location: Bengaluru / Bangalore Job Description MERCHANDISER Our Client is High Fashion Export House...
Apply For This Job
