Senior Software Engineer

About the role

AlphaSense's Content Engineering team builds large-scale content processing systems that leverage AI (NLP, LLMs) for document understanding, classification, extraction, and semantic similarity. As a Senior Software Engineer based in Bengaluru, you will deploy production-grade LLM solutions, fine-tune models for specialized extraction tasks, develop prompt engineering strategies, and own systems end-to-end including design, coding, monitoring, testing, CI/CD, and on-call support. The role focuses on solving LLM engineering challenges like high latency and non-deterministic output while scaling data processing pipelines for complex documents.

What you’ll do

• Deploy LLM based production grade solutions
• Fine-tune and adapt State of the art LLMs for specialized data extraction tasks
• Develop innovative prompt engineering strategy and systems to maximize reliability and performance on confidential business documents
• Solve Engineering challenges that come along with LLM solutions, such as high latency, non-deterministic output, etc.
• Implement and scale data processing pipelines that can process high volumes of complex documents with high accuracy and efficiency
• Integrate and manage LLM Observability to trace, debug, and monitor every extraction
• Own systems end-to-end, including designing, coding, monitoring, testing, CI/CD and on-call support

What you’ll bring

• 4+ years of experience as a software engineer, primarily with Python
• Advanced degree (Bachelor's / Master's) in Computer Science, Computer Engineering, or a relevant field with a focus on Artificial Intelligence, machine learning (or equivalent industry experience)
• 2+ years of hands-on experience building and deploying applications that use Large Language Models (LLMs)
• Experience in extracting structured JSON from text using LLMs and a deep understanding of Prompt Engineering
• Proficiency in classic NLP libraries for tasks like NER, text classification, and pre-processing
• Experience with LLM tracing, debugging and evaluation platforms such as Langfuse
• Excellent communication, organizational, problem-solving, debugging, and analytical skills

Skills

Education

advanced degree (Bachelor's / Master's) in Computer Science, Computer Engineering, or a relevant field with a focus on Artificial Intelligence, machine learning