Who You Are:

We are looking to hire a Data Engineering Lead who thrives in a startup environment. You are someone who enjoys working in a fast-paced and agile setting, where you can make a significant impact and help shape the direction of our data engineering initiatives. You exhibit excellent knowledge of data engineering disciplines, including experience working with large datasets in a Python/SQL environment. You will also have hands-on knowledge of the latest data programming approaches, data structures, distributed DBMS and DB modeling and access languages. Additionally, your ability to architect and build pipelines will contribute to the development of our data-driven solutions.

As a self-starter, you are not afraid to take ownership of projects and can handle the challenges that come with a rapidly evolving startup. You are resourceful, innovative, and continuously seek opportunities to improve processes and drive efficiency. Your strong communication and collaboration skills enable you to work effectively with cross-functional teams and stakeholders. If you are passionate about data engineering and are eager to contribute to the success of a startup, we would love to hear from you.

Expected Duties:

• Collaborate closely with data scientists, software engineers, and other stakeholders to develop and implement data-driven solutions that transform transportation systems.
• Architect and build scalable and efficient data pipelines and ETL processes to collect, process, and store large volumes of data, playing a crucial role in laying out the processes and foundations of our Data Engineering initiatives
• Optimize database structures and data models for performance and scalability.
• Ensure data quality and integrity by implementing data validation and cleansing techniques.
• Establishing policies, processes, and controls in data governance to ensure the integrity, quality, and security of data assets in a way that achieves regulatory compliance.
• Work with cloud computing infrastructure to adequately scale data pipelines while actively maintaining cost efficiency and speed.
• Adapt quickly to changing requirements and priorities in a startup environment.
• Mentor and guide junior engineers, fostering a culture of continuous learning and growth within the team.
• Collaborate closely with cross-functional teams to align engineering efforts with product and business objectives.
• Drive innovation and brainstorming sessions to tackle transportation engineering challenges and develop cutting-edge solutions.
• Implement modern solutions and tools to enhance the efficiency and effectiveness of our software development processes.
• Ensure the team meets tight deadlines and delivers high-quality software solutions consistently.
• Scale yourself by effectively coordinating solutions for operational problems, bugs, requirements, and processes.
• Challenge team members to achieve their best while fostering a culture of productivity and excellence.
• Engage in data science work, leveraging your expertise to contribute to the development of data driven solutions.

Required Skills & Experience:

• Bachelor's in Computer Science, Data Science, or a related field
• 7+ years of experience in data engineering, preferably in a startup or fast-paced environment, with prior leadership roles
• Strong proficiency in SQL (for DDL operations, DML operations, data architecture, etc.)
• Strong proficiency in Python and Jupyter (for exploratory data analysis, writing scripts, aggregating datasets, working with data scientists/GIS developers, etc.)
• Knowledge of data modeling, data warehousing, and ETL processes
• Leadership experience preferred

Experience with cloud-based data platforms such as Snowflake and AWS

• Experience working with DBMSs such as PostgreSQL and MySQL
• Familiarity with extracting, analyzing, and mapping geospatial data and GIS systems

Familiarity with distributed systems and big data technologies such as Apache Spark

• Understanding of data visualization concepts and tools
• Strong problem-solving and analytical skills
• Excellent communication and collaboration skills
• Ability to work independently and adapt to changing priorities
• Passion for learning and keeping up with the latest trends in data engineering and technology