D
Hiring companyDatabricks
Verified today
Staff Software Engineer
Bengaluru, India Full-time On-site
About the role
Lead the design and deployment of AI-driven search relevance systems at Databricks, driving ML and NLP innovations to enhance asset discovery across the platform.
What you’ll do
- Lead development of ML-based search and discovery relevance models.
- Design and implement automated ML/NLP pipelines for data preprocessing, query understanding, ranking, retrieval, and evaluation.
- Collaborate with product managers and cross-functional teams to drive technology-first initiatives.
- Build robust framework for evaluating search ranking improvements offline and online.
What you’ll bring
- BS+ (M.S. or PhD preferred) in Computer Science or related field.
- 10+ years experience building search relevance systems at scale.
- Expertise in applying LLMs to search relevance.
- Strong background in NLP, query understanding, text mining, recommendations, personalization, discovery, conversational AI.
- Proven contributions to open-source projects.
Skills
Search relevance system design and deployment.Machine learning and NLP pipeline development.Large language model integration for search.Query understanding and rewrite techniques.Ranking and retrieval algorithms.Model evaluation and experimentation.Collaboration with product and cross-functional teams.Open-source contribution experience.
Education
BS+