Back to Careers

Senior Data Scientist - LLM

Full Time

Bangalore, Karnataka, India

Apply Now

Required Experience

2+ years

Skills Required

Deep Learning, LLMs, Python

Job Description

Job Summary

  • 5C Network is building multi-modal AI for autonomous diagnosis of medical imaging. This role focuses on developing advanced AI models for medical imaging analysis using Large Language Models.

Key Responsibilities

  • Develop and optimize prompts for various LLM tasks, ensuring high performance in different use cases.
  • Work on instruction fine-tuning for specific tasks to adapt models to custom requirements.
  • Develop workflows for Retrieval-Augmented Generation (RAG) systems to combine LLMs with external knowledge bases.

LLM Deployment

  • Set up and manage the deployment of LLMs in production environments.
  • Ensure scalability, security, and performance in self-hosted LLM environments.
  • Work with quantization techniques to optimize model performance and reduce memory footprint.

Dataset Building and Chain of Thought (CoT)

  • Build and manage high-quality datasets to enable Chain of Thought (CoT) reasoning in LLMs.
  • Annotate and refine datasets to improve LLM performance in complex multi-step reasoning tasks.

Vector Databases and RAG Integration

  • Work with Vector Databases (ideally Qdrant) to implement RAG-based solutions, combining LLMs with semantic search and retrieval.
  • Ensure efficient storage, indexing, and retrieval of vectorized data for enhanced LLM performance.

Collaboration and Research

  • Collaborate with AI researchers and engineers to integrate LLMs into production systems.
  • Research and experiment with new LLM architectures and approaches to improve task performance.

Qualifications

  • Bachelor's or Master's degree in Computer Science, Data Science, or related field
  • Prior experience in self-hosting LLMs and working with deployment frameworks.
  • Prior experience or strong interest in healthcare AI applications.
  • Excellent problem-solving and analytical skills.
  • Strong communication skills and ability to work in a collaborative research environment

Technical Requirements

  • 2+ years' experience in Deep Learning with 1+ years' experience in LLMs
  • Python Expertise: Ability to write clean, scalable code for LLM deployment and fine-tuning.
  • LLM Knowledge: Experience with instruction fine-tuning, quantization, prompt engineering and RAG-based systems.
  • LLM Deployment: Understanding of the tools and processes for self-hosting LLMs, including optimization and scaling techniques.

Role Details

  • Work Type: In-person
  • Location: Bangalore