POS-16866
HubSpot is seeking a Technical Lead II to join the Data Infrastructure—Batch Processing Team.
About the team
The Batch Processing Team makes processing large datasets at HubSpot unified, fast, and easy. We provide a suite of tools, platforms, and processes based on Spark, Hadoop, and Iceberg.
Our platform supports thousands of processing jobs daily across hundreds of Spark and Hadoop clusters, processing a petabyte of customer data per day. We deliver this platform on AWS through a Kubernetes control plane across multiple data centers and regions. Through supporting tools and libraries, we enable teams across the engineering organization by defining, developing, and advocating for best practices that help them process data effectively, reliably, and with high performance.
Typical projects include developing tools and client libraries, as well as implementing core orchestration and deployment functionality within our suite of Kubernetes operators. This past year, we introduced an Iceberg lakehouse platform that's driving substantial improvements in interoperability and cost savings as new ML and AI workloads ramp up.
What we're looking for
This role offers a unique opportunity to work at scale on a team pushing the boundaries of a business-critical system. As an engineer, you'll design and solve problems in large, distributed systems and develop software in Java. As a technical lead, you'll own the roadmap and strategy for these platforms, balance competing demands across a portfolio of technologies, and craft the platform into a true product that provides leverage for hundreds of engineers at HubSpot.
Role Responsibilities:
Lead a team of 3–5 engineers as a player-coach
Design and implement scalable backend services, libraries, tools, and automation for data store operations and usage
Collaborate with engineering teams to reliably integrate data processing technologies into their stack
Support the uptime and reliability of database systems
Work in a dynamic, agile environment to deliver comprehensive solutions that address user needs
Conduct code reviews, contribute to internal tooling, and maintain high coding standards for application reliability and performance
Coach the team to work iteratively, experiment with new ideas, and embrace a startup mentality of learning fast and adapting quickly
Continuously learn and adapt to new technologies and frameworks to keep our solutions at the forefront of innovation
Ideal Candidate:
Has extensive experience in the Spark or Hadoop ecosystems and backend platform or infrastructure development, with proficiency in Java
Has experience delivering infrastructure platforms to other engineering teams and understands how to build infrastructure as a product
Has a history of developing solutions that have had an outsized impact on organizational business goals
Thrives in a collaborative environment, with strong communication skills and the ability to work effectively with teams across the organization
Is innovative and entrepreneurial, with a keen interest in staying ahead of technology trends, particularly in AI and machine learning
Demonstrates strong ownership of projects end-to-end, with a track record of successfully rolling out infrastructure and collaborating with multiple engineering teams to deliver results
Has proven ability to solve complex technical problems and analyze trade-offs with empathy for developers
Bonus points for:
Experience developing automation or power-user expertise with technologies such as Iceberg, Doris, Trino, and Flink
Interest and experience actively supporting infrastructure at scale on Kubernetes
Interest and experience contributing to open source software
Pay & Benefits
The cash compensation below includes base salary, on-target commission for employees in eligible roles, and annual bonus targets under HubSpot’s bonus plan for eligible roles. In addition to cash compensation, some roles are eligible to participate in HubSpot’s equity plan to receive restricted stock units (RSUs). Some roles may also be eligible for overtime pay. Individual compensation packages are tailored to your skills, experience, qualifications, and other job-related reasons.
This resource will help guide how we recommend thinking about the range you see. Learn more about HubSpot’s compensation philosophy.
Benefits are also an important piece of your total compensation package. Explore the benefits and perks HubSpot offers to help employees grow better.
At HubSpot, fair compensation practices aren’t just about checking off the box for legal compliance. It’s about living out our value of transparency with our employees, candidates, and community.Annual Cash Compensation Range:$200,600—$321,000 USD
We know the confidence gap and impostor syndrome can get in the way of meeting spectacular candidates, so please don’t hesitate to apply — we’d love to hear from you.
If you need accommodations or assistance due to a disability, please reach out to us using this form.
At HubSpot, we value both flexibility and connection. Whether you’re a Remote employee or work from the Office, we want you to start your journey here by building strong connections with your team and peers. If you are joining our Engineering team, you will be required to attend a regional HubSpot office for in-person onboarding. If you join our broader Product team, you’ll also attend other in-person events, such as your Product Group Summit and other gatherings, to continue building on those connections.
If you require an accommodation due to travel limitations or other reasons, please inform your recruiter during the hiring process. We are committed to supporting candidates who may need alternative arrangements
Massachusetts Applicants: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
Germany Applicants: (m/f/d) - link to HubSpot's Career Diversity page here.
India Applicants: link to HubSpot India's equal opportunity policy here.
About HubSpot
HubSpot (NYSE: HUBS) is an AI-powered customer platform with all the software, integrations, and resources customers need to connect marketing, sales, and service. HubSpot's connected platform enables businesses to grow faster by focusing on what matters most: customers.
At HubSpot, bold is our baseline. Our employees around the globe move fast, stay customer-obsessed, and win together. Our culture is grounded in four commitments: Solve for the Customer, Be Bold, Learn Fast, Align, Adapt & Go!, and Deliver with HEART. These commitments shape how we work, lead, and grow.
We’re building a company where people can do their best work. We focus on brilliant work, not badge swipes. By combining clarity, ownership, and trust, we create space for big thinking and meaningful progress. And we know that when our employees grow, our customers do too.
Recognized globally for our award-winning culture by Comparably, Glassdoor, Fortune, and more, HubSpot is headquartered in Cambridge, MA, with employees and offices around the world.
Explore more:
HubSpot Careers
Life at HubSpot on Instagram
HubSpot may use AI to help screen or assess candidates, but all hiring decisions are always human. More information can be found here. By submitting your application, you agree that HubSpot may collect your personal data for recruiting, global organization planning, and related purposes. Refer to HubSpot's Recruiting Privacy Notice for details on data processing and your rights.