We are seeking an experienced Senior Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and maintaining robust, scalable data infrastructure and pipelines that support our big data and analytics initiatives, with a special focus on setting up and training Large Language Models (LLMs). You will play a critical role in enabling data-driven decision-making processes across the organization and spearheading our efforts in developing advanced natural language processing capabilities.

• Bachelor’s or master’s degree in Computer Science, Engineering, or a related field.

• Minimum of 5 years of experience in a Data Engineering role.

• Strong analytic skills related to working with unstructured datasets.

• Experience with big data tools: Hadoop, Spark, Kafka, etc.

• Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.

• Experience with AWS cloud services: EC2, EMR, RDS, Redshift.

• Experience with stream-processing systems: Storm, Spark-Streaming, etc.

• Proficiency in one or more programming languages (Python, Java, Scala).

• Solid understanding of SQL and experience with relational databases, as well as NoSQL databases.

• Excellent problem-solving and troubleshooting skills.

• Strong communication and teamwork skills.

Interviews with CTO and CEO