Required Technical and Professional Expertise
12 + years of relevant years of experience in data engineering
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience building and optimizing ‘Big Data’ data pipelines, architectures and data sets.
Build processes supporting data transformation, data structures, metadata, dependency and workload management.
Working knowledge of message queuing, stream processing, and highly scalable ‘Big Data’ data stores.
Experience with
Big Data tools: Hadoop, Spark, Kafka, etc.
Relational SQL and NoSQL databases, including Postgres and Cassandra.
Data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
Stream-Processing systems: Storm, Spark-Streaming, etc.
Object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
Preferred Tech and Prof Experience
Ability to present statistical results to lay persons in an easy to understand way.
Proven communication skills, both written and verbal.
Experience developing and testing Machine Learning and/or statistical projects.
When u call please mention you have found this job details on SherJobs
Tagged as: Application Developer, Big Data, Big Data Architect, c#, data engineering, Data pipeline and workflow management tools, Hadoop, IT, Java, Kafka, Postgres and Cassandra, Python, Relational SQL and NoSQL databases, Scala, Software Engineer, SPARK
Job Description 10+Years of experience in application design, architecture and development using Java/JEE, Python, Microservices, Databases – Proficient in solution...
Apply For This JobJOB DETAILS Locality Mehdipatnam Role Architect Min Salary Rs. 30000 Max Salary Rs. 50000 Min Experience 7 yrs Max Experience...
Apply For This JobJob Description Applies advanced subject matter knowledge to solve complex business issues and is regarded as a subject matter expert. Frequently contributes...
Apply For This JobJob Description HP has an impressive portfolio and strong innovation pipeline across areas such as: • blended reality technology –...
Apply For This JobJob Details Probationary Officer/ Management Trainee job opportunities in Institute of Banking Personnel Selection (IBPS) IBPS recruiting 4102 Posts for...
Apply For This JobJob Description Our client is seeking a Technical Project Manager to oversee a multi person engagement team responsible for delivering enhancements...
Apply For This Job
