Required Technical and Professional Expertise
12 + years of relevant years of experience in data engineering
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience building and optimizing ‘Big Data’ data pipelines, architectures and data sets.
Build processes supporting data transformation, data structures, metadata, dependency and workload management.
Working knowledge of message queuing, stream processing, and highly scalable ‘Big Data’ data stores.
Experience with
Big Data tools: Hadoop, Spark, Kafka, etc.
Relational SQL and NoSQL databases, including Postgres and Cassandra.
Data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
Stream-Processing systems: Storm, Spark-Streaming, etc.
Object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
Preferred Tech and Prof Experience
Ability to present statistical results to lay persons in an easy to understand way.
Proven communication skills, both written and verbal.
Experience developing and testing Machine Learning and/or statistical projects.
When u call please mention you have found this job details on SherJobs
Tagged as: Application Developer, Big Data, Big Data Architect, c#, data engineering, Data pipeline and workflow management tools, Hadoop, IT, Java, Kafka, Postgres and Cassandra, Python, Relational SQL and NoSQL databases, Scala, Software Engineer, SPARK
Job Description Skills And Qualifications -Expert in Python, with knowledge of at least one Python web framework {{such as Django,...
Apply For This JobJob Description Job Title:- Lead Tools Programmer Job Summary:- Main responsibilities: Organize and secure all developments within the Pune Tech...
Apply For This JobJob Description Application development using the Java development stack Excellent working knowledge of JavaScript Good Experience working on Web development,...
Apply For This JobJob Description -Writing client ready thematic research reports on the global technology, media and telecommunication (TMT) sectors covering themes like...
Apply For This JobJob Description Technologies : Mainframe (Cobol/JCL/DB2), Good to have CICS knowledge but not mandatory. Experience : 3-5 Years, Good to...
Apply For This JobJob Description Responsibilities: As a successful Datacenter Project Manager, your performance objectives will consist of: · Empower a culture of...
Apply For This Job
