Thoughtclan Technologies
|Data Science Engineer
Bangalore, Karnataka, India
Summary
As a Data Science Engineer, I developed and optimized advanced LLM-powered applications and scalable data pipelines, significantly enhancing system efficiency and accuracy for RAG and natural language to SQL query generation projects.
Highlights
Engineered a scalable Python-based data ingestion pipeline, scraping over 50,000 pages from diverse sources to support a Retrieval-Augmented Generation (RAG) system.
Designed a custom chunking algorithm, extracting structured data from over 12,000 documents (PDFs, PPTs, DOCs) including text, tables, and images.
Optimized LLM context retrieval and MilvusDB ingestion using Delta run and Re-config optimizations to enhance system performance.
Fine-tuned hybrid, keyword, and semantic search models with re-ranking techniques, boosting search relevance scores by 25%.
Benchmarked and optimized open-source LLMs (LLaMA 3.1, Mistral 7B, Mixtral 8x7B) through LoRA, QLoRA, and PEFT fine-tuning techniques.
Evaluated proprietary LLMs (OpenAI, Claude, Gemini-1.5 Pro/Flash) to inform cost-effective deployment strategies.
Automated information retrieval, reducing processing time from 1 hour to under 30 seconds, achieving an 85.7% efficiency improvement.