1. 05 Sep, 2024 1 commit
    • Waleed Akbar's avatar
      Changes in Analytics Backend. · 21832189
      Waleed Akbar authored
      - In the BackendService.py:
           + Updated SparkStreamer call with new parameters.
      - In SparkStreaming.py:
         + Added 'GetAggregerations' and 'ApplyThresholds' methods
         + Added 'window_size', 'win_slide_duration', 'time_stamp_col' and 'thresholds' parameters.
      - Added new messages.
      - Updated the 'RunSparkStreamer' call wth new parameters.
      21832189
  2. 03 Sep, 2024 4 commits
    • Waleed Akbar's avatar
      Changes in Analytics Backend · e7e36f7d
      Waleed Akbar authored
      - SparkStreamer write Stream to Kafka topic ANALYTICS_RESPONSE.
      e7e36f7d
    • Waleed Akbar's avatar
      Changes in Telemetry · 067ace16
      Waleed Akbar authored
      - Added Kafka Request Listener to listen for requests from the Analytics Frontend.
      - Updated `SparkStreamer.py` to consume and process streams from VALUE topics, and further filter rows based on KPIs in the `input_kpis` list.
      - Updated the frontend TOPIC from `VALUE` to `ANALYTICS_REQUEST`.
      - Updated messages to keep the KPI UUID consistent with the one generated by the Telemetry Backend service.
      067ace16
    • Waleed Akbar's avatar
      **Changes in Frontend** · c8ad3a5c
      Waleed Akbar authored
      - Added the missing `map<string, string>` in the `analytics_frontend.proto` file.
      - Removed `pyspark` and `java` from the `requirements.in` file, as they are not required for the Frontend.
      c8ad3a5c
    • Waleed Akbar's avatar
      Analytics Backend Initial Version · 0c5d2856
      Waleed Akbar authored
      - Added CRDB secret.
      - Added test script.
      - Added `main` and `__init__.py` files.
      - Added Backend Service file.
      - Added Spark Streamer file (successfully consuming streams from Kafka Topics).
      - Added Tests folder and files.
      - Added requirements file.
      - Added ANALYTICS Kafka topics in `common.tools.kafka.variables` file.
      0c5d2856
  3. 28 Aug, 2024 2 commits
    • Waleed Akbar's avatar
      Changes in Analytic DB and Frontend · 28bf80d3
      Waleed Akbar authored
      - Created the Analytic Engine, Model, and DB files.
      - Added the DB connection.
      - Added `add_row_to_db` in `StartCollector`.
      - Added `delete_db_row_by_id` in `StopCollector`.
      - Improved message formatting.
      - Added a DB test file.
      28bf80d3
    • Waleed Akbar's avatar
      Changes in Analytics Frontend. · e0a77d5f
      Waleed Akbar authored
      - Actul logic is added in StartAnalyzer method.
      - Actual logic is added in StopAnalyzer method.
      - Improvements in message formats.
      e0a77d5f
  4. 27 Aug, 2024 33 commits