Senior Staff Threat Hunter & Intelligence Engineer - Databricks

Other Jobs To Apply

No other job posts for this day.

Senior Staff Threat Hunter & Intelligence Engineer - Databricks About the Role What if you could hunt threats across one of the world's largest data platforms—using that same platform as your weapon? At Databricks, our threat hunters don't just protect a data company; they leverage petabyte-scale analytics, real-time streaming, and ML infrastructure that most security teams can only dream of. This is threat hunting without constraints. We're looking for a Senior Staff Threat Hunter & Intelligence Engineer to define and lead our threat hunting and intelligence capabilities across AWS, Azure, and GCP. You'll set the strategic direction for how we detect and pursue adversaries, build the tooling and infrastructure to hunt at scale, and serve as a technical authority across our security organization. Key Responsibilities Advanced Threat Hunting Operations • Define the strategic vision and roadmap for a structured, repeatable threat hunting program using hypothesis-driven methodologies aligned with industry frameworks. • Develop Databricks-based hunting capabilities and logic to analyse security telemetry at a massive scale across our multi-cloud environment. • Build reusable hunting notebooks and automated intelligence pipelines using Databricks workflows. • Serve as the technical authority for threat hunting across Security, influencing detection strategy and incident response capabilities. • Mentor and develop threat hunting capabilities across the security organization. Strategic Threat Intelligence Leadership • Operationalize threat intelligence from multiple sources (commercial feeds, OSINT, industry sharing groups) into actionable hunting hypotheses. • Work with internal partners to develop and maintain Priority Intelligence Requirements (PIRs). • Build automated enrichment pipelines using Databricks to correlate intelligence with internal telemetry. • Produce intelligence assessments on threats relevant to our business. • Represent Databricks in external security communities, industry working groups, and with strategic customers on advanced threat topics. Platform Innovation & Tooling • Architect scalable hunting infrastructure using Databricks notebooks, arenaflex Lake, and Unity Catalog. • Develop libraries of reusable detection logic and hunting queries optimized for distributed computing. • Build automated workflows for threat intelligence ingestion, enrichment, and correlation. • Create dashboards and visualizations for threat exposure and hunt findings. • Integrate security tools with Databricks platform. Required Qualifications • 12+ years in cybersecurity with 6+ years focused on threat hunting, threat intelligence, or detection engineering. • Deep expertise with nation-state and e-crime threat actors’ TTPs, trends, and historical targets. • Experience working with large-scale security datasets and big data platforms. • Strong Python programming experience with a background in PySpark, distributed computing frameworks, or Databricks’ platform. • Deep understanding of cloud security across AWS, Azure, and GCP—including cloud-native logging, security controls, and container/Kubernetes security. • Strong knowledge of OS internals across macOS, Linux, and containerized environments. • Experience with enterprise-scale software development practices including infrastructure-as-code, code review, and large codebase management. • Demonstrated experience conducting hypothesis-driven threat hunts with measurable outcomes. • Experience defining and driving multi-year security program strategy. • Thought leadership around the application of cybersecurity frameworks, such as MITRE ATT&CK and D3FEND. • Applied CTI skills including consuming and operationalizing IOCs/TTPs, tracking campaigns, and conducting research. • Experience influencing technical decisions beyond your immediate team. • A track record of mentoring Staff+ engineers. Preferred Qualifications • Experience with Databricks platform or similar (Spark, arenaflex Lake, MLflow). • Experience protecting multi-tenant SaaS/PaaS environments. • Experience using AI, Large Language Models or machine learning to automate cybersecurity operations. • Experience with purple team operations and adversary emulation. • Published research at major cybersecurity conferences or in academic journals. • Contributions to impactful open-source security projects or software patents in the cybersecurity domain. What You'll Bring • The ability to think like an adversary while understanding defender constraints. • Comfort with ambiguity and ability to define structure where none exists. • A track record of building consensus across competing priorities. • The ability to translate technical capabilities into business risk reduction. • The desire to automate and scale hunting operations using our modern data platform. • The drive to stay current with rapidly evolving cloud threats and technologies. • The ability to work effectively across security, engineering, and product teams. Pay Range Transparency Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-arenaflex earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here. Zone 1 Pay Range $209,600—$293,375 USD About Databricks Databricks is the data and AI company. More than 10,000 organizations worldwide — including arenaflex, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, arenaflex Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visit Our Commitment to Diversity and Inclusion At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics. Compliance If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone. Apply tot his job

Back to blog

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...