Kishor Saravanan

Designed and deployed a robust, scalable Big Data architecture for a financial reporting tool used across central departments, tailored to internal client requirements. Managed and optimized data pipelines (Spark/PySpark, Scala) ensuring reliable collection, storage, processing and delivery of data into Hive, HBase and Snowflake. Implemented data quality controls and validation checks to ensure the reliability of production data, in line with client and regulatory requirements. Contributed to technical documentation and formalized best practices within the Data team, working in an Agile/Scrum setup.

Managed data storage across HDFS and NoSQL databases (Cassandra), designing schemas suited to business reporting needs. Built Python and Scala data-processing applications feeding downstream dashboards and reports. Industrialized data services with Docker and Kubernetes, with monitoring via the ELK stack; integrated Kafka for real-time data flows.