Exceptional People + Purpose Beyond Profit = Watershed Outcomes

Exceptional People + Purpose Beyond Profit = Watershed Outcomes

AI Engineer

Penguin AI

Penguin AI

Software Engineering, Data Science
India · Hyderabad, Telangana, India · Telangana, India
Posted on Jan 21, 2026

Penguin Ai: Seeking an AI Engineer to Supercharge Our Healthcare Revolution!

Your Role: Generative AI Builder. LLM Magician. Production Pioneer. AI Architect's Right Hand.

Location: Hyderabad

Type: Full-time, Full-throttle!

Start Date: Immediate joiner preferred

Who We Are: The Penguin Ai Rebellion!

We’re not your average AI company — and we don’t want average teammates. Penguin Ai was founded by healthcare veterans who knew the system needed more than hype and half-baked algorithms. We built an AI platform that actually works in healthcare — across Prior Auth, HCC Coding, and all those soul-crushing workflows no one brags about. Our platform is fast to implement (think: 60 days), reduces administrative costs up to 40%, and makes payers look like heroes without writing a line of code.

This is AI for the real world of healthcare. And just to put a fine point on it: powerhouses like Snowflake and AWS don't just partner with anyone. Their trust in our platform speaks volumes about our robust, scalable, and secure technology.

We're growing faster than a penguin on a waterslide and we’re always on the hunt for customer-obsessed problem-solvers to help our clients unlock the full potential of their AI investments.

This isn’t some futuristic sci-fi movie set, this is AI for the real, gritty, essential world of healthcare where speed & data matter.

About the Role: Your Epic Quest as Our AI Engineer!

You are the hands-on builder who brings our AI visions to life! As our AI Engineer, you'll be at the forefront of developing, implementing, and optimizing AI solutions using cutting-edge generative AI technologies. This role is all about getting your hands dirty – from building innovative AI applications and integrating complex models to deploying them seamlessly into production. You'll be working side-by-side with our AI architecture team, turning blueprints into groundbreaking realities.

If you thrive on translating abstract ideas into tangible, high-performing AI systems that solve real-world problems in healthcare, then gear up – your next great engineering challenge awaits!

Your Day-to-Day Superpowers: What You’ll Actually Do:

Your AI Application Architect Superpowers:

  • LLM App Developer: Build and maintain powerful AI-powered applications, wielding LLM APIs from the biggest names (OpenAI, Claude, Gemini, etc.) like a true magician
  • Prompt Engineering Pro: Implement clever prompt engineering strategies and continuously optimize model interactions for peak performance and cost-efficiency
  • Custom AI Workflow Creator: Develop bespoke AI workflows, including advanced Retrieval-Augmented Generation (RAG) systems, pushing the boundaries of what's possible
  • Robust System Builder: Engineer resilient applications with robust error handling, intelligent fallback mechanisms, and precise response validation systems

Your Model Implementation & Fine-tuning Mastery:

  • Open-Source Optimizer: Fine-tune open-source models (like Llama, Mistral) to perfection for specific, high-impact business use cases and domains
  • Training Pipeline Pioneer: Implement cutting-edge training pipelines using modern frameworks (PyTorch, Hugging Face Transformers)
  • Performance Perfectionist: Conduct thorough model evaluation, A/B testing, and relentless performance optimization to ensure our AI is always at its best
  • Versioning Visionary: Master model versioning and experiment tracking, keeping our AI development organized and predictable

Your Production Deployment & Operations Command:

  • Deployment Dynamo: Seamlessly deploy AI models and applications using FastAPI, Docker, and Kubernetes, ensuring smooth transitions from development to production
  • Scalable Microservices Architect: Build scalable microservices architectures for our AI applications, ensuring they can handle immense loads with ease
  • Monitoring Maestro: Implement comprehensive monitoring, logging, and alerting systems for our production AI systems, catching issues before they even become problems
  • Inference Optimizer: Continuously optimize inference performance, latency, and resource utilization, making our AI run faster and more efficiently than ever

Your Integration & Data Engineering Genius:

  • System Integrator: Weave AI capabilities into existing systems and complex workflows, making our AI a seamless part of our customers' operations
  • Data Pipeline Architect: Design and build robust data pipelines for both model training and inference
  • Vector Database Virtuoso: Work expertly with vector databases and embedding systems, unlocking the power of semantic search and knowledge retrieval
  • Caching & Preprocessing Champion: Implement smart caching strategies and efficient data preprocessing pipelines to feed our AI with perfectly prepared data

What We're Looking For: Your AI Engineering Arsenal!

We need someone who embodies a blend of hands-on coding expertise, deep AI knowledge, and a passion for production-grade systems.

Your AI Engineering Experience:

  • ML/Software Engineering Veteran: 3+ years of battle-tested experience in machine learning or software engineering
  • Generative AI & LLM Integrator: 1+ years of hands-on experience integrating and building with generative AI and LLMs
  • Production Deployment Pro: Demonstrated experience deploying robust ML models into production environments

Your Technical Skills:

  • LLM API Expert: Proficiency with LLM APIs and SDKs (OpenAI, Anthropic, Google, etc.)
  • Transformer Tuner: Experience fine-tuning transformer models using Hugging Face, PyTorch, or similar
  • Python Powerhouse: Strong proficiency in Python and modern software development practices
  • Deployment Dynamo: Hands-on experience with FastAPI, Docker, and containerization
  • Kubernetes Commander: Experience with Kubernetes for container orchestration
  • Microservices Architect: Strong knowledge of RESTful API design and microservices architecture

Your Core Competencies:

  • Transformer Architect: Deep understanding of transformer architectures, embeddings, and attention mechanisms
  • Prompt Engineering Guru: Expertise in prompt engineering and model optimization techniques
  • MLOps Familiar: Familiarity with MLOps practices and tools (model versioning, monitoring, CI/CD)
  • Debugging Detective: Strong debugging and troubleshooting skills
  • Distributed Systems Dynamo: Ability to work effectively with large-scale data and distributed system

Bonus Points: Your Secret Weapons!

  • You've launched healthcare AI or automation products at scale
  • You've not just survived but thrived in the beautiful chaos of a high-growth startup
  • Have a knack for vector databases (Pinecone, Weaviate, Chroma, etc.) and RAG implementation
  • Are familiar with model quantization and optimization techniques
  • Have experience with cloud platforms (AWS, GCP, Azure) and their AI services
  • Have built streaming and real-time AI applications
  • Possess knowledge of AI safety and responsible AI practices
  • Have expertise in specific domains like NLP or computer vision

The Culture Fit: Join Our Colony!

You'll waddle with us if:

  • You like your coffee with a side of delightful chaos.
  • You're fuelled by complexity and obsessed with delivering amazing results.
  • You want to build something that fundamentally transforms healthcare, not just tweaks it around the edges.
  • You believe implementation isn’t a handoff; it’s the start of an epic, trusted partnership!

Education & Qualifications:

A Bachelor's degree in Computer Science, Engineering, Data Science, or a related field

Comp & Perks: Because Even Superheroes Need Support!

  • Competitive salary : We reward your ingenuity!
  • Group Medical Insurance : Keep you healthy and smiling.
  • Generous vacation policy and company holidays: Recharge and conquer!
  • A front-row seat in one of healthcare's most exciting AI companies – witness history in the making!