Independent Project
- Proposed a novel POSIX Loss penalizing inconsistencies in responses to semantically equivalent prompts, significantly enhancing robustness in Vision-Language Models.
- Implemented comprehensive benchmarks for medical and general-purpose VLMs, evaluating robustness across spelling errors, template variations, and paraphrasing.
- Achieved notable improvements on medical imaging datasets, increasing accuracy (up to 72.9%) and reducing hallucinations via optimized training and fine-tuning methodologies.
Vision-Language ModelsRobustnessMedical Imaging
Independent Project
- Developed an AI-powered legal simulation system using CrewAI to model courtroom proceedings with Groq LLM agents representing judges, juries, prosecutors, and defense attorneys for historical serial killer cases.
- Implemented comprehensive output generation and storage producing detailed reports for each participant's perspective, with standardized file naming and organization for further analysis.
- Created data visualization components to analyze sentencing patterns, victim counts, and relationships between case factors using Matplotlib and Seaborn.
Multi-AgentCrewAILLMsData Visualization
Independent Project
- Developed a retrieval-augmented generation (RAG) system utilizing ChromaDB for embedding storage and Groq's LLaMa 3.1 model for generating context-aware responses.
- Implemented efficient semantic retrieval leveraging embeddings generated by the all-MiniLM-L6-v2 model for improved accuracy.
- Engineered flexible document chunking strategies, balancing context preservation and retrieval precision to optimize response accuracy.
RAGLLMsChromaDBEmbeddings
MBZUAI
- Built a deep learning pipeline for Africa and Pediatric brain tumor segmentation for the corresponding BraTS 2024 tasks.
- Integrated the novel schedule-free optimizer into the training algorithm.
- Performed thorough analysis of fine-tuning and ensembling techniques, and their impact on performance.
Medical ImagingBrain Tumor SegmentationMedNeXt
MBZUAI
- Developed a novel multimodal framework combining BioLinkBERT/CLIP embeddings with 3D Swin Transformers.
- Engineered a hybrid architecture integrating clinical text prompts and PET/CT imaging for tumor segmentation.
- Pioneered an EHR processing pipeline using semantic text embeddings.
MultimodalMedical ImagingSwin TransformerBioLinkBERTCLIP