Data Platform Engineer at Team Cymru

Job description

Join the mission to make the digital world safer. About Team Cymru Team Cymru’s mission is to save and improve human lives by helping public and private sector analysts track and take down cybercriminals. We provide visibility into global cyber threat activity and are a key intelligence source for leading cybersecurity and threat intelligence vendors. Our Pure Signal™ platform gives enterprise security teams on-demand access to global internet traffic telemetry, providing clarity into what’s happening across the internet with a level of visibility comparable to their own internal networks. This allows organizations to close detection gaps, accelerate incident response, and get ahead of critical, recurring threats. Team Cymru is a fast-paced, distribution-focused, private equity-backed company where your work directly supports a mission that protects millions worldwide. We’re looking for a Senior Software Engineer to design and build the Go services and pipelines that power our data lake. You’ll own how raw data lands, gets cleaned and conformed, and becomes trusted, business-ready datasets across our bronze, silver, and gold layers. You’ll operate with significant technical ownership, working closely with stakeholders to turn deep domain knowledge into reliable, production-grade systems. This role suits an engineer who can move fluidly between hands-on coding, system design, and mentoring, and who is energized by the mission-driven, high-signal nature of threat intelligence work. Key Responsibilities: Data Lake Design & Development • Design, build, and operate large-scale, high-throughput systems for collecting, processing, enriching, and ingesting threat intelligence data (network telemetry, indicators of compromise, or similar) into our data lake infrastructure • Own all layers of the data lake: bronze, silver, and gold • Choose and tune table formats, partitioning, compaction, and file layout to balance cost, latency, and query performance • Own significant components or services end-to-end, from technical design through deployment, monitoring, and iteration in production • Write clean, well-tested, maintainable code in Go, and contribute to our engineering standards and practices • Participate in architectural decisions, design reviews, and technical planning; provide informed input on trade-offs around scale, latency, and data integrity Collaboration & Domain Translation • Partner directly with threat intelligence analysts and researchers to translate investigative workflows and detection logic into scalable software • Collaborate cross-functionally with product, security, and data teams to prioritize work that has direct impact on customer and analyst outcomes Reliability & Operations • Improve the reliability, performance, and observability of existing systems, including on-call participation for services you own Mentorship & Engineering Quality • Mentor other engineers through code review, pairing, and technical guidance; help raise the bar for engineering quality across the team Qualifications & Experience • 7+ years of professional software engineering experience, including 3+ years building and operating production Go systems at scale • Deep Go fluency: concurrency (goroutines, channels, context), profiling and performance tuning, memory management, and idiomatic testing • Hands-on experience building and running a data lake using the Medallion Architecture (bronze, silver, gold) in production • Strong working knowledge of an open table format such as Apache Iceberg, Delta Lake, or Apache Hudi, and columnar formats like Parquet • Experience with object storage (S3, GCS, or ADLS) and with partitioning, compaction, and schema evolution at scale • Demonstrated experience designing distributed systems; you can reason clearly about trade-offs in scalability, reliability, latency, and cost • Experience working with large or high-velocity datasets; familiarity with streaming or batch data pipeline technologies is a strong plus • Experience building and maintaining ClickHouse and PostgreSQL databases Additional Skills • Genuine interest in cybersecurity or threat intelligence; prior experience in the domain is a plus but not required for a strong engineer with the right curiosity and aptitude • Excellent written and verbal communication skills, including the ability to explain technical trade-offs to non-engineering stakeholders • A collaborative, low-ego approach to technical disagreement, mentorship, and cross-team problem-solving • Experience with the specific data domains relevant to threat intelligence (network flow data, DNS, malware analysis, OSINT, or similar) • Experience with AWS and infrastructure-as-code tooling • Familiarity with security frameworks or standards relevant to the industry (MITRE ATT&CK, STIX/TAXII) • Prior experience in a startup or fast-scaling engineering organization, including comfort with ambiguity and shifting priorities • Open-source contributions or a public track record of technical writing or speaking Education and Certifications • Bachelor’s degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience Travel Occasional travel for team meetings or industry events may be required. Why Join Team Cymru? At Team Cymru, we provide unmatched global threat intelligence that empowers organizations to proactively disrupt adversaries. You'll be at the forefront of cybersecurity innovation, helping customers harness the full power of our threat intelligence to achieve critical business and security outcomes. We offer a collaborative, mission-driven culture where your expertise and impact will directly contribute to improving global security. Ready to make an impact? Apply now and help shape the financial future of a company protecting millions worldwide. This job description is not exhaustive. Responsibilities may evolve as needed. Team Cymru is an equal opportunity employer and welcomes applicants from all backgrounds. This is a remote position. #LI-BR1

Requirements

Must-haves

Join the mission to make the digital world safer.
Data Lake Design & Development
Own all layers of the data lake: bronze, silver, and gold
Choose and tune table formats, partitioning, compaction, and file layout to balance cost, latency, and query performance
Own significant components or services end-to-end, from technical design through deployment, monitoring, and iteration in production
Write clean, well-tested, maintainable code in Go, and contribute to our engineering standards and practices
Participate in architectural decisions, design reviews, and technical planning; provide informed input on trade-offs around scale, latency, and data integrity
Collaboration & Domain Translation
Partner directly with threat intelligence analysts and researchers to translate investigative workflows and detection logic into scalable software
Collaborate cross-functionally with product, security, and data teams to prioritize work that has direct impact on customer and analyst outcomes
Reliability & Operations
Improve the reliability, performance, and observability of existing systems, including on-call participation for services you own
Mentorship & Engineering Quality
Mentor other engineers through code review, pairing, and technical guidance; help raise the bar for engineering quality across the team
7+ years of professional software engineering experience, including 3+ years building and operating production Go systems at scale
Deep Go fluency: concurrency (goroutines, channels, context), profiling and performance tuning, memory management, and idiomatic testing
Hands-on experience building and running a data lake using the Medallion Architecture (bronze, silver, gold) in production
Strong working knowledge of an open table format such as Apache Iceberg, Delta Lake, or Apache Hudi, and columnar formats like Parquet
Experience with object storage (S3, GCS, or ADLS) and with partitioning, compaction, and schema evolution at scale
Demonstrated experience designing distributed systems; you can reason clearly about trade-offs in scalability, reliability, latency, and cost
Experience working with large or high-velocity datasets; familiarity with streaming or batch data pipeline technologies is a strong plus
Experience building and maintaining ClickHouse and PostgreSQL databases
Additional Skills

Nice-to-haves

Genuine interest in cybersecurity or threat intelligence; prior experience in the domain is a plus but not required for a strong engineer with the right curiosity and aptitude

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

goaws

Platform: jazzhr
Effort: medium