Positions:2 Full Time
Experience
4 - 8 Years
Job Description: Software Engineer 2 - Data Engineering
Position Overview
We are seeking a talented and experienced Software Engineer 2 - Data Engineering to join our engineering team. In this role, you will be responsible for designing, developing, testing, and maintaining software applications and data solutions that meet our customers' evolving needs. You will be involved in the entire software development lifecycle, from architecting solutions to deploying them in production environments. This is an excellent opportunity to work on complex data engineering challenges while collaborating with cross-functional teams in an agile environment.
Key Responsibilities
- Engage with customers and stakeholders to deeply understand their use cases, pain points, and requirements, advocating for user-centric and scalable data solutions
- Solve complex data engineering problems by designing, developing, and delivering solutions using various tools, languages, frameworks, and methodologies (including Agile)
- Assess software and data application requirements and determine the most suitable technology stack, integration methods, and deployment strategies
- Create high-level software and data architecture designs that outline the overall structure, components, interfaces, and data flows of applications
- Collaborate effectively with cross-functional teams including product owners, designers, architects, and data analysts to deliver integrated solutions
- Define and implement software testing strategies, guidelines, policies, and processes aligned with organizational vision, industry regulations, and market best practices
- Continuously improve application performance and optimize data pipelines by implementing new technologies and methodologies to maximize development efficiency
- Apply programming best practices including test-driven development, continuous integration, and continuous delivery (CI/CD)
- Support and implement security practices to safeguard user data, including encryption, anonymization, and compliance with data protection regulations
- Develop and maintain back-end applications including APIs, microservices, and data pipelines using server-side languages and cloud-based technologies
- Evaluate and incorporate emerging technologies and capabilities to enhance solutions, monitoring industry trends and participating in solutions involving new stack layers
- Create and maintain comprehensive documentation for code, architecture, and data pipelines to support team knowledge sharing and future maintenance
Required Skills & Experience
- Programming Languages & Tools: Proficiency in Python and at least one additional coding language or framework
- Data Transformation Tools: Hands-on experience with DBT (Data Build Tool) and/or Dataform for data transformation and modeling
- Data Integration Tools: Demonstrated experience with Alteryx for data preparation and integration
- Overall IT Experience: Minimum 4+ years in IT or software development roles
- Development Experience: Minimum 3+ years of professional software development experience
- Software Development Practices: Familiarity with test-driven development, continuous integration, and continuous delivery practices
- Problem-Solving: Strong analytical and problem-solving skills with the ability to design scalable solutions
- Collaboration: Excellent communication and teamwork skills with the ability to work effectively across departments
Preferred Skills & Experience
- Cloud Platform Expertise: 2+ years of hands-on experience with Google Cloud Platform (GCP) tools including BigQuery, Dataflow, Dataproc, Data Fusion, and Cloud SQL
- Data Engineering Tools: Experience with Apache Airflow and PySpark for orchestration and distributed data processing
- Infrastructure as Code: Proficiency with Terraform for infrastructure automation and management
- CI/CD Platforms: Familiarity with Tekton or similar CI/CD solutions
- Database Management: Experience with PostgreSQL and other relational databases
- Advanced Alteryx Experience: 3+ years of specialized experience with Alteryx for complex data workflows
- Data Transformation Expertise: 2+ years of advanced experience with dbt Core, Dataform, or other GCP data tools
- API Development: Experience designing and developing RESTful and microservices APIs
- Cloud-Based Data Tools: Expertise in cloud-native data wrangling applications and platforms
Education & Qualifications
- Bachelor's degree in Computer Science, Software Engineering, Data Engineering, or related field (or equivalent professional experience)
- Professional certifications in cloud platforms (GCP, AWS, Azure) are a plus
Key Competencies
- Technical Excellence: Deep knowledge of software architecture, design patterns, and data engineering best practices
- User-Centric Thinking: Ability to empathize with end users and translate requirements into scalable solutions
- Agile Methodology: Experience working in Agile/Scrum environments with iterative development cycles
- System Design: Capability to design complex systems with consideration for scalability, performance, and maintainability
- Security Awareness: Understanding of data security, privacy regulations, and secure coding practices
- Continuous Learning: Passion for staying current with emerging technologies and industry trends
- Attention to Detail: Meticulous approach to code quality, testing, and documentation
- Adaptability: Ability to work with diverse technology stacks and quickly learn new tools and frameworks
What We Offer
- Opportunity to work on impactful data engineering and software solutions
- Collaborative environment with talented engineers and cross-functional teams
- Professional development and learning opportunities
- Exposure to cutting-edge cloud technologies and data engineering practices
- Competitive compensation and benefits package
Work Environment
This role may involve a combination of individual contribution and collaborative work. You will work in an agile, fast-paced environment where innovation and continuous improvement are valued. Depending on company policy, this position may offer flexible work arrangements.
We are committed to building a diverse and inclusive team. We welcome applications from candidates of all backgrounds and experiences.
PIb8771125b45e-37437-40952553
