Big data platform for precision agriculture
Problem / Need
Agricultural data arrived in varied formats and needed a unified storage and compute layer for analysis and product development.
Solution
Designed and deployed a production data stack combining a Hadoop data lake, an Apache Spark cluster, and Elasticsearch. Processed hundreds of gigabytes of agricultural data from multiple sources and built ingestion and transformation pipelines to produce ML-ready features.
Tools
Hadoop·Apache Spark·Elasticsearch·Python
