
Ratnesh Shukla
Full Stack Developer AI and Data Solutions
Habilidades

Conheça meus serviços


Portfólio
Experiência profissional
Freelance Backend & Data Automation Engineer
Self Employed • Autônomo
Dec 2024 - Present • 1 yr 7 mos
Architected and deployed an end-to-end media ingestion pipeline to scrape, process, and migrate 2,000+ episodes, successfully managing the high-speed transfer of over 5TB of video data to Google Drive using rclone optimization. Engineered an advanced web scraper using Node.js and Puppeteer, connecting to remote browser instances to bypass geo-restrictions and intercept internal XHR network requests for secure HLS (.m3u8) stream extraction. Built a high-throughput, multi-threaded Python backend using Flask and ThreadPoolExecutor to concurrently download and stitch 4MB video chunks, optimizing bandwidth utilization for continuous 150 Mbps network execution. Designed a fault-tolerant, resumable architecture utilizing SSD-to-HDD caching, automated directory polling, and file-based state tracking (.done markers) to ensure zero data loss during long-running execution cycles. Automated complex data mapping workflows by integrating dynamic Node.js scripts with Excel-based localized metadata, parsing thousands of URLs and mapping them directly to the download queue. Managed large-scale media processing workloads (multi-GB to multi-TB scale) across multiple execution cycles with a reliability-focused execution design.