Skip to content

Latest commit

 

History

10 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

SamplingFlink

Scope of this project is to apply Algorithm 1: CVOPT-SASG: Algorithm computing a random sample for a single aggregate, single group-by as refers in the follow source : https://arxiv.org/pdf/1909.02629.pdf input streams-data are coming from : https://openaq.org/

Loaded into a Kafka topic (Removed in last version) Read From Kafka topic (Removed in last version) // Comment code, Lose Tuples cause Time events.//

How To Run :

  • Run FirstPAssMain
  • Run SecondPassMain

How To Run Using Kafka:

  • Run FirstPassMain
  • Run KafkaMain
  • Run SecondPassMain

Upcoming Updates :

Resolving Time Issues, New KafkaConsumer (Connection between first and second Flink jobs).

About

SamplingFlink is a Java-based project focused on implementing data sampling techniques using Apache Flink. This project aims to provide efficient and scalable solutions for processing and analyzing large data streams.

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Used by

Contributors

Languages