I am a passionate Machine Learning Engineer with experience developing AI solutions across various domains, specializing in Generative AI, Large Language Models (LLMs), Natural Language Processing (NLP), computer vision, and multi-agent systems. I have worked on creating impactful models using deep learning and reinforcement learning. Currently, I’m focused on advanced recommendation systems using Llama LLM. I’m seeking opportunities in AI/ML roles where I can leverage my skills to contribute to cutting-edge projects.

September 2022 - May 2024

• Pioneered the first-ever image-caption dataset in endoscopy and developed a contrastive learning-based Visual Question Answering (VQA) model, EndoAssistant.
• Fine-tuned LLaVA (LLM) for creating an AI assistant for endoscopic surgery.
• Led the development of a Speech Therapy AI Agent, integrating deep learning models with clinical expertise.

January 2021 - June 2022

• Implemented a Multi-Agent Reinforcement Learning algorithm for drone fleets.
• Developed CNN models to classify UAVs based on radio signals and analyze human speech signals, achieving high accuracy.

June 2019 - December 2019

• Developed deep learning models to predict Un-Burnt Carbon levels in thermal power plants, improving efficiency by 15%.
• Conducted extensive EDA and built interactive dashboards in Tableau for data visualization.

• EndoAssistant: Developed a Visual Question Answering (VQA) model for endoscopic surgery using CLIP and Whisper API.
• Drone Fleet Control: Implemented a reinforcement learning algorithm for drone fleet management in Unreal Engine’s AirSim simulator.
• Movie Database System: Created a comprehensive movie information system using Python and SQL, optimized for performance.

• Master of Science (MS) in Artificial Intelligence, University at Buffalo, The State University of New York (May 2024)
• Master of Science (M.Sc.) in Physics, Birla Institute of Technology and Sciences Pilani (June 2022)
• Bachelor of Engineering (B.E.) in Electronics and Instrumentation, BITS Pilani (June 2022)

• " Recent Advances in Thermal Imaging and It’s Applications using Machine Learning: A Review" - IEEE Sensors

• "Classification of UAVs Using Time-Frequency Analysis of Remote Control Signals and CNN" - IEEE iSES 2022

• "Light Weight Deep CNN for Background Sound Classification in Speech Signals" - JASA

• 📚 Publications

• "Recent Advances in Thermal Imaging and It’s Applications using Machine Learning: A Review" - IEEE Sensors

• "Classification of UAVs Using Time-Frequency Analysis of Remote Control Signals and CNN" - IEEE iSES 2022

• "Light Weight Deep CNN for Background Sound Classification in Speech Signals" - JASA

• Email: balu.koduru99@gmail.com
• GitHub: BaluHarshavardan99
• LinkedIn: Balu Harshavardan Koduru

⭐️ From BaluHarshavardan99