Building End-To-End Data Solutions on Kubernetes: From Ingest to Visualisation