Senior Software Engineer — Microsoft

Hi, I'm Nrk Raju
Guthikonda

"Building AI that respects privacy — 116 open-source tools and counting."

116+
Repositories
100%
Original Work
0
Forks
10+
Industries
Python
Primary Language

About Me

Engineer by day, AI builder by night.

I'm a Senior Software Engineer at Microsoft, working on Copilot Search Infrastructure — specifically Semantic Indexing and Retrieval-Augmented Generation (RAG) that powers GitHub Copilot's code understanding.

Outside of work, I've built 116+ open-source, privacy-first AI tools powered by local LLMs (Gemma 4 + Ollama). Every project runs 100% on-device — zero data ever leaves the user's machine. My goal is to democratize AI for industries where privacy isn't optional: healthcare, legal, education, and finance.

I believe the next wave of AI isn't about bigger models — it's about smarter, smaller models running where the data lives. That's what I build.

🏢

Microsoft — Copilot Search Infra

Semantic Indexing & RAG for GitHub Copilot

🤖

116+ AI Tools

Privacy-first, local LLM-powered, 100% original

🔒

Privacy-First Architecture

Zero cloud dependency — all inference runs locally

🌍

10+ Industries Covered

Healthcare, Legal, Education, Finance, Security & more

Flagship Projects

Standout creations that showcase range and ambition.

🚀

90-local-llm-projects

A mega-portfolio of 90 production-level projects all built with local Gemma 4 + Ollama. Spans healthcare, legal, education, developer tools, creative writing, and more.

Python Gemma 4 Ollama Streamlit FastAPI
View on GitHub
📞

CallPilot

AI-powered outbound phone call assistant using Twilio + OpenAI Realtime API with RAG. Makes intelligent, context-aware phone calls on your behalf.

Python Twilio OpenAI RAG WebSocket
View on GitHub
🎥

Meet NRK

A production-ready Google Meet alternative with unlimited meetings, HD video, screen sharing, and mobile support. Built with Next.js and Azure Communication Services.

TypeScript Next.js Azure WebRTC Tailwind
View on GitHub
🏗️

ArchDesign.io

Master System Design like a Staff Engineer — 30 real-world architectures with LLM-powered deep-dives. Interactive learning platform with subscription model.

TypeScript React LLM System Design
View on GitHub
🛡️

DocShield

Privacy-first medical document assistant powered by Gemma 4. Multi-agent AI that reads, explains, and checks your medical documents 100% locally.

Python Gemma 4 Multi-Agent HIPAA
View on GitHub
📊

LoadLens

RPS Load Testing & Capacity Planning Toolkit — understand system throughput, identify bottlenecks, and plan capacity with real data.

Python Load Testing DevOps
View on GitHub

All Projects

116 repositories, 0 forks, 10+ industries — filter by category.

lab-results-interpreter

HIPAA-friendly medical AI tool that interprets lab results — powered by local Gemma 4 LLM via Ollama. No patient data leaves your machine.

patient-intake-summarizer

HIPAA-friendly patient intake summarizer — local Gemma 4 LLM via Ollama.

medical-report-writer

HIPAA-friendly medical report writer — local Gemma 4 LLM via Ollama.

differential-diagnosis-assistant

HIPAA-friendly differential diagnosis assistant — local Gemma 4 LLM via Ollama.

clinical-note-generator

HIPAA-friendly clinical note generator — local Gemma 4 LLM via Ollama.

docshield

Privacy-first medical document assistant — multi-agent AI powered by Gemma 4.

first-aid-guide-bot

AI-powered first aid guide — local Gemma 4 LLM, 100% private.

symptom-checker-bot

AI-powered symptom checker — local Gemma 4 LLM, 100% private.

drug-interaction-checker

AI-powered drug interaction checker — local Gemma 4 LLM, 100% private.

medical-terms-explainer

AI-powered medical terminology explainer — local Gemma 4 LLM, 100% private.

health-plan-generator

AI-powered health plan generator — local Gemma 4 LLM, 100% private.

ehr-deidentifier

AI-powered EHR de-identifier — local Gemma 4 LLM, 100% private.

nutrition-label-analyzer

AI-powered nutrition label analyzer — local Gemma 4 LLM, 100% private.

exercise-form-guide

AI-powered exercise form guide — local Gemma 4 LLM, 100% private.

sleep-improvement-advisor

AI-powered sleep improvement advisor — local Gemma 4 LLM, 100% private.

stress-management-bot

AI-powered stress management bot — local Gemma 4 LLM, 100% private.

medical-lit-summarizer

AI-powered medical literature summarizer — local Gemma 4 LLM, 100% private.

legal-brief-writer

Privacy-first legal brief writer — local Gemma 4 LLM, zero data leakage.

deposition-summarizer

Privacy-first deposition summarizer — local Gemma 4 LLM, zero data leakage.

court-filing-generator

Privacy-first court filing generator — local Gemma 4 LLM, zero data leakage.

legal-case-researcher

Privacy-first legal case researcher — local Gemma 4 LLM, zero data leakage.

contract-clause-analyzer

Privacy-first contract clause analyzer — local Gemma 4 LLM, zero data leakage.

legal-doc-summarizer

AI-powered legal document summarizer — local Gemma 4 LLM, 100% private.

quiz-generator

AI-powered quiz generator — local Gemma 4 LLM, 100% private.

flashcard-creator

AI-powered flashcard creator — local Gemma 4 LLM, 100% private.

essay-grader

AI-powered essay grading assistant — local Gemma 4 LLM, 100% private.

curriculum-planner

AI-powered curriculum planner — local Gemma 4 LLM, 100% private.

science-experiment-explainer

AI-powered science experiment explainer — local Gemma 4 LLM, 100% private.

math-problem-solver

AI-powered math problem solver — local Gemma 4 LLM, 100% private.

history-timeline-generator

AI-powered history timeline generator — local Gemma 4 LLM, 100% private.

vocabulary-builder

AI-powered vocabulary builder — local Gemma 4 LLM, 100% private.

debate-topic-generator

AI-powered debate topic generator — local Gemma 4 LLM, 100% private.

reading-comprehension-builder

AI-powered reading comprehension builder — local Gemma 4 LLM, 100% private.

study-buddy-bot

AI-powered study buddy chatbot — local Gemma 4 LLM, 100% private.

language-learning-bot

AI-powered language learning chatbot — local Gemma 4 LLM, 100% private.

textbook-summarizer

AI-powered textbook chapter summarizer — local Gemma 4 LLM, 100% private.

gdpr-compliance-checker

AI-powered GDPR compliance checker — local Gemma 4 LLM, 100% private.

vulnerability-report-writer

AI-powered vulnerability report writer — local Gemma 4 LLM, 100% private.

incident-report-generator

AI-powered incident report generator — local Gemma 4 LLM, 100% private.

log-file-analyzer

AI-powered log file analyzer — local Gemma 4 LLM, 100% private.

env-config-manager

AI-powered environment config manager — local Gemma 4 LLM, 100% private.

password-strength-advisor

AI-powered password strength advisor — local Gemma 4 LLM, 100% private.

cybersecurity-alert-summarizer

AI-powered cybersecurity alert summarizer — local Gemma 4 LLM, 100% private.

policy-compliance-checker

AI-powered policy compliance checker — local Gemma 4 LLM, 100% private.

infra-doc-generator

AI-powered infrastructure documentation generator — local Gemma 4 LLM, 100% private.

cicd-pipeline-generator

AI-powered CI/CD pipeline generator — local Gemma 4 LLM, 100% private.

financial-report-generator

AI-powered financial report generator — local Gemma 4 LLM, 100% private.

stock-report-generator

AI-powered stock report generator — local Gemma 4 LLM, 100% private.

household-budget-analyzer

AI-powered household budget analyzer — local Gemma 4 LLM, 100% private.

invoice-extractor

AI-powered invoice data extractor — local Gemma 4 LLM, 100% private.

trend-analysis-tool

AI-powered trend analysis tool — local Gemma 4 LLM, 100% private.

kpi-dashboard-reporter

AI-powered KPI dashboard reporter — local Gemma 4 LLM, 100% private.

sales-email-generator

AI-powered sales email generator — local Gemma 4 LLM, 100% private.

support-ticket-classifier

AI-powered support ticket classifier — local Gemma 4 LLM, 100% private.

competitor-analysis-tool

AI-powered competitor analysis tool — local Gemma 4 LLM, 100% private.

survey-response-analyzer

AI-powered survey response analyzer — local Gemma 4 LLM, 100% private.

sentiment-analysis-dashboard

AI-powered sentiment analysis dashboard — local Gemma 4 LLM, 100% private.

csv-data-analyzer

AI-powered CSV data analyzer — local Gemma 4 LLM, 100% private.

code-review-bot

AI-powered code review assistant — local Gemma 4 LLM, 100% private.

commit-message-generator

AI-powered commit message generator — local Gemma 4 LLM, 100% private.

stack-trace-explainer

AI-powered stack trace explainer — local Gemma 4 LLM, 100% private.

regex-generator

AI-powered regex pattern generator — local Gemma 4 LLM, 100% private.

api-doc-generator

AI-powered API documentation generator — local Gemma 4 LLM, 100% private.

code-snippet-search

AI-powered code snippet search engine — local Gemma 4 LLM, 100% private.

sql-query-generator

AI-powered SQL query generator — local Gemma 4 LLM, 100% private.

code-translator

AI-powered code translator between languages — local Gemma 4 LLM, 100% private.

unit-test-generator

AI-powered unit test generator — local Gemma 4 LLM, 100% private.

code-complexity-analyzer

AI-powered code complexity analyzer — local Gemma 4 LLM, 100% private.

docker-compose-generator

AI-powered Docker Compose generator — local Gemma 4 LLM, 100% private.

loadlens

RPS Load Testing & Capacity Planning Toolkit — understand system throughput at scale.

apiwatch

API Contract Testing & Health Monitor CLI — validate APIs against YAML contracts.

blog-post-generator

AI-powered blog post generator — local Gemma 4 LLM, 100% private.

social-media-writer

AI-powered social media content writer — local Gemma 4 LLM, 100% private.

email-campaign-writer

AI-powered email campaign writer — local Gemma 4 LLM, 100% private.

poem-lyrics-generator

AI-powered poem and lyrics generator — local Gemma 4 LLM, 100% private.

video-script-writer

AI-powered video script writer — local Gemma 4 LLM, 100% private.

newsletter-editor

AI-powered newsletter editor — local Gemma 4 LLM, 100% private.

story-outline-generator

AI-powered story outline generator — local Gemma 4 LLM, 100% private.

product-description-writer

AI-powered product description writer — local Gemma 4 LLM, 100% private.

presentation-generator

AI-powered presentation generator — local Gemma 4 LLM, 100% private.

cover-letter-generator

AI-powered cover letter generator — local Gemma 4 LLM, 100% private.

ai-video-studio-public

AI-powered video production pipeline for nursery rhymes and animated short films.

wavify

A music streaming web app built with React, Tailwind CSS, and Express. Deployed on Azure.

pdf-chat-assistant

AI-powered PDF chat assistant — local Gemma 4 LLM, 100% private.

it-helpdesk-bot

AI-powered IT helpdesk chatbot — local Gemma 4 LLM, 100% private.

meal-planner-bot

AI-powered meal planning chatbot — local Gemma 4 LLM, 100% private.

fitness-coach-bot

AI-powered fitness coaching chatbot — local Gemma 4 LLM, 100% private.

travel-itinerary-bot

AI-powered travel itinerary planner — local Gemma 4 LLM, 100% private.

mood-journal-bot

AI-powered mood journaling chatbot — local Gemma 4 LLM, 100% private.

gift-recommendation-bot

AI-powered gift recommendation chatbot — local Gemma 4 LLM, 100% private.

veterinary-advisor-bot

AI-powered veterinary advisor chatbot — local Gemma 4 LLM, 100% private.

research-paper-qa

AI-powered research paper Q&A tool — local Gemma 4 LLM, 100% private.

news-digest-generator

AI-powered news digest generator — local Gemma 4 LLM, 100% private.

resume-analyzer

AI-powered resume analyzer and feedback tool — local Gemma 4 LLM, 100% private.

meeting-summarizer

AI-powered meeting notes summarizer — local Gemma 4 LLM, 100% private.

pdf-report-generator

AI-powered PDF report generator — local Gemma 4 LLM, 100% private.

callpilot

AI-powered outbound phone call assistant — Twilio + OpenAI Realtime API with RAG.

smart-calendar-assistant

AI-powered smart calendar assistant — local Gemma 4 LLM, 100% private.

personal-knowledge-base

AI-powered personal knowledge base — local Gemma 4 LLM, 100% private.

diary-journal-organizer

AI-powered diary and journal organizer — local Gemma 4 LLM, 100% private.

reading-list-manager

AI-powered reading list manager — local Gemma 4 LLM, 100% private.

home-automation-scripter

AI-powered home automation script generator — local Gemma 4 LLM, 100% private.

family-story-creator

AI-powered family story creator — local Gemma 4 LLM, 100% private.

habit-tracker-analyzer

AI-powered habit tracker and analyzer — local Gemma 4 LLM, 100% private.

standup-generator

AI-powered daily standup generator — local Gemma 4 LLM, 100% private.

time-management-coach

AI-powered time management coach — local Gemma 4 LLM, 100% private.

90-local-llm-projects

🚀 90 production-level projects built with local LLM (Gemma 4 + Ollama) — complete Python portfolio.

meet-nrk

Production-ready Google Meet alternative — HD video, screen sharing, mobile support.

archdesign-io

Master System Design like a Staff Engineer — 30 real-world architectures with LLM deep-dives.

pulse-app

Pulse — a TypeScript-based web application.

ghremotesessionreplica

Web-based remote terminal session — access your shell from any browser or phone.

docshield

Privacy-first medical document assistant — multi-agent AI powered by Gemma 4.

rental-property-agent

Rental property agent — monthly rent reminder and more.

household-budget-analyzer

AI-powered household budget analyzer — local Gemma 4 LLM, 100% private.

loadlens

RPS Load Testing & Capacity Planning Toolkit.

apiwatch

API Contract Testing & Health Monitor CLI.

Technical Expertise

Core technologies across AI, cloud, and full-stack development.

Python
RAG
Semantic Search
LLMs
Ollama
Gemma
Streamlit
FastAPI
LangChain
Azure
Docker
TypeScript
React
Next.js
SQL
Git
NLP
WebRTC
HIPAA
CI/CD

Publications & Writing

Research and thought leadership (in progress).

Privacy-Preserving Clinical AI with Local LLMs

Target: arXiv preprint

📝 In Progress

Building 90 Production AI Tools in 90 Days — A Local LLM Journey

Blog series

📝 Coming Soon

Semantic Indexing at Scale: Lessons from GitHub Copilot

Technical blog post

📝 Coming Soon

Get in Touch

Open to collaborations, speaking engagements, and interesting conversations.