Big Data serverless application
-
Updated
Feb 15, 2020 - Python
Big Data serverless application
This project implements an end-to-end techstack for a data platform, for local development.
Secondo progetto per il corso di Big Data durante A.A. 2020/2021. Progetto che si incentra sulla creazione di una architettura lambda per effettuare analisi streaming e batch su dati estratti dalla piattaforma Twitch.
A project which includes simulation of real time queries by kafka and performing stream and batch processing of the simulated queries by spark. Also, this follows lambda architecture, in which kafka is publisher and spark helps in subscribing
This project aims to predict smartphone prices using a combination of batch and stream processing techniques in a Big Data environment. The architecture follows the Lambda Architecture pattern, providing both real-time and batch processing capabilities to users.
Create data pipeline using Lambda architecture with Spark, Kafka, Airflow and Snowflake
Canari v3 - next gen Maltego framework for rapid remote and local transform development
Add a description, image, and links to the lambda-architecture topic page so that developers can more easily learn about it.
To associate your repository with the lambda-architecture topic, visit your repo's landing page and select "manage topics."