About North Cloud
The public cloud is home to $200B+ in annual technology spend, yet 95% of it is still managed with credit cards and spreadsheets. With AI accelerating cloud growth towards $1T by 2030, businesses need better tools to manage, optimize, and scale their cloud investments.
At North, we’re building the next-generation cloud spend management platform, giving companies clarity, control, and automation over their cloud finances. Our mission is to help organizations take charge of their cloud costs and maximize efficiency in the AI-driven era.
Backed by top-tier investors and trusted by leading customers like Brave, StayNTouch, and DataBiologics, we’re assembling a world-class team to redefine how businesses manage cloud spend. If you’re looking for impact, growth, and the opportunity to shape the future of cloud finance, North is the place to be.
About the Role
We're looking for a Sr. Software Engineer, AI to own the machine learning and AI efforts across our platform. You'll work directly with our CTO to define and build AI-powered features that will shape Agent North, our customer-facing AI assistant, as well as drive advancements in cost and usage forecasting, financial modeling, and multi-service provider rightsizing.
This is a hands-on, senior-level role, perfect for someone who thrives in a fast-moving startup environment, has built ML-powered products before, and is comfortable taking a project from 0 to 1. If you're a high-energy, motivated engineer passionate about LLMs, cloud infrastructure, and deploying AI systems at scale, we'd love to hear from you.
What You'll Do
- Design, build, and deploy ML models for cloud automation and optimization.
- Work with LLMs, fine-tuning, optimizing, and integrating them into our platform.
- Develop AI chatbots and customer-facing AI solutions to automate and enhance cloud finance management.
- Ensure security and compliance in AI model deployment, implementing best practices for secure AI infrastructure.
- Set up and maintain ML infrastructure across GCP, AWS, and Azure, optimizing for scale and efficiency.
- Drive ML project development from 0 to 1, making key decisions on architecture, tooling, and implementation.
- Collaborate with engineering, product, and leadership teams to align AI development with business goals.
- Experiment with and implement cutting-edge ML techniques, including prompt engineering, model security, continuous evaluation, and monitoring frameworks.
- Provide thought leadership, driving AI strategy and identifying opportunities to improve and expand North's AI capabilities.
What We're Looking For
- 5+ years of hands-on experience in ML, AI model development, and infrastructure deployment.
- Experience deploying ML models at scale on AWS (cloud-based, distributed systems, or edge deployments).
- Strong programming skills in Python and SQL, with demonstrated ability to write production-quality code.
- Proficiency with ML frameworks and the judgment to determine when and where to apply them based on data complexity.
- Ability to move fast and iterate, taking ideas from concept to production.
- Comfortable with Git.
- Excellent communication skills, with the ability to clearly convey progress, methodology, solution approach, and results.
- Strong analytical background, capable of sifting through complex cost patterns and making sense of intricate financial cloud modeling.
Nice to Have
- Experience working in a startup.
- Experience working with financial cloud data across GCP, AWS, or Azure, or complex large financial and logging datasets.
- Experience deploying models in Amazon Bedrock or on AWS.
- Experience deploying infrastructure with Terraform.
- AWS technical certification (or equivalent cloud certification).
Work Setup
Hybrid role based in New York City, with an office in Dumbo, Brooklyn.
Benefits
- Unlimited PTO
- 16 weeks of paid parental leave (birthing parents receive an additional 4 weeks at 50% pay)
- Two company-wide breaks per year: one around Labor Day and one at the end of the year
- Aetna Medical PPO plan with the majority of the premium covered by North
- Dental and vision insurance
- Flexible spending account (FSA) for health expenses and commuter benefits
- 30 day sabbatical every 4 years
If you're a ML engineer who loves building AI-powered products, deploying at scale, and shaping the future of cloud financial automation, we'd love to hear from you.
The pay range for this role is:230,000 - 270,000 USD per year(Dumbo, NY)
PIb35bb2f94d6b-37437-40403062
