Lead Analyst - Data Science / Lead Engineer - Enterprise Generative AI Platform- USC & GC Only
Ampstek
Indianapolis, Japan Full Time Engineering Jobs Japan Posted 5d ago
Job Description
Job Title: Lead Analyst - Data Science / Lead Engineer - Enterprise Generative AI Platform
Location: Indianapolis, IN (Onsite)
Job Type: 12+ Months Contract
Job Description:
Primary Skills
- LLM Platform Architecture & Engineering: Designing and operating enterprise-scale, GPU-accelerated, cloud-native LLM serving platforms on Kubernetes
- Distributed Systems & MLOps: Building low-latency, high-throughput, fault-tolerant inference systems; CI/CD, IaC, model lifecycle management
- Production LLM Deployment: Hosting, fine-tuning, and managing LLMs (PEFT, LoRA) with versioning, promotion, rollback, and multi-backend support
- AI Security & Compliance: Implementing runtime guardrails, prompt/output inspection, auditability, traceability, and IAM/RBAC integration
- RAG & Prompt Engineering: Developing retrieval-augmented generation pipelines, standardized prompt frameworks, and evaluation methodologies
- Workflow Orchestration: Managing long-running, event-driven AI pipelines using tools like Temporal.io and gRPC-based services
- Observability & Reliability: Monitoring latency, throughput, cost, security events, and drift; defining SLOs for LLM services
- Programming & Frameworks: Strong hands-on experience with Python, Go, FastAPI, LangChain/LangGraph, Redis
Nice to Have
- Domain Experience: Background in pharmaceutical, healthcare, or other highly regulated industries
- Advanced AI Security Exposure: Prompt-risk mitigation, hallucination detection, and regulated AI deployment
- Research-to-Production Experience: Translating NLP and generative AI research into enterprise platforms
- Cloud LLM Ecosystems: Experience with AWS Bedrock, Azure OpenAI, or Google Vertex AI
- Collaboration & Enablement: Strong cross-functional collaboration with data science, SRE, DevOps, and product teams
- Advanced Platform Tooling: Familiarity with Argo, Flux, Prometheus, Grafana, and object storage (S3-compatible)
Posted May 3, 2026