Skip to content
Snippets Groups Projects
  1. Jan 13, 2025
    • Waleed Akbar's avatar
      Changes in Telemetry backend Analytics · 8c1d7155
      Waleed Akbar authored
      - Added AnalyzerHelper class
      - Added AnalyzerHandler class
      - Added updated streamer class
      - Update test scripts for analytics backend
      - Updated run script format
      8c1d7155
  2. Nov 04, 2024
  3. Sep 25, 2024
  4. Sep 24, 2024
    • Waleed Akbar's avatar
      Updates to Streamer Classes in Backend Analytics: · dafc8e87
      Waleed Akbar authored
      - Replaced `SparkStreamer` class with `DaskStreamer` class.
      - Updated methods to call the `DaskStreamer` class.
      - Improved messages and test files.
      - Added new package requirements.
      - Made minor changes to the frontend `requirements` file.
      dafc8e87
  5. Sep 22, 2024
    • Waleed Akbar's avatar
      Minor Changes in New Monitoring Services to Improve Overall Functionality · c0c517f0
      Waleed Akbar authored
      - Added new tests in the `scripts` folder.
      - Improved messages and test files across all services.
      Telemetry and Analytics Backend:
      - Added a `try` statement to handle Kafka message decoding errors.
      Telemetry Frontend and KPI Value API:
      - Downgraded `apscheduler` from `3.10.4` to `3.10.1` in the requirements file.
      Kafka:
      - Added a method to retrieve `KAFKA_SERVER_ADDRESS` from environment variables.
      Telemetry Backend:
      - Added a condition to allow the collector backend to run indefinitely.
      - Changed the extracted `KpiValue` timestamp format to `"%Y-%m-%dT%H:%M:%SZ"` to meet Apache Spark requirements.
      - Removed some unused packages from the `requirements.in` file.
      Deployment Script:
      - Added `"telemetry"` and `"analytics"` component names to the `TFS_COMPONENTS` variable in the `my_deploy.sh` file.
      c0c517f0
  6. Sep 19, 2024
    • Waleed Akbar's avatar
      Changes to Analytics Backend: · 821e14f8
      Waleed Akbar authored
      - Corrected the name of `install_servicers()`.
      - Removed `stop_event` from the `RequestedListener` call.
      - Spark Streamer now writes to the `ALARMS` topic.
      - Improved messages and test files.
      821e14f8
  7. Sep 07, 2024
  8. Sep 05, 2024
    • Waleed Akbar's avatar
      Changes in Analytics Backend. · 21832189
      Waleed Akbar authored
      - In the BackendService.py:
           + Updated SparkStreamer call with new parameters.
      - In SparkStreaming.py:
         + Added 'GetAggregerations' and 'ApplyThresholds' methods
         + Added 'window_size', 'win_slide_duration', 'time_stamp_col' and 'thresholds' parameters.
      - Added new messages.
      - Updated the 'RunSparkStreamer' call wth new parameters.
      21832189
  9. Sep 03, 2024
    • Waleed Akbar's avatar
      Analytics Backend Initial Version · 0c5d2856
      Waleed Akbar authored
      - Added CRDB secret.
      - Added test script.
      - Added `main` and `__init__.py` files.
      - Added Backend Service file.
      - Added Spark Streamer file (successfully consuming streams from Kafka Topics).
      - Added Tests folder and files.
      - Added requirements file.
      - Added ANALYTICS Kafka topics in `common.tools.kafka.variables` file.
      0c5d2856
  10. Jul 24, 2024
  11. May 10, 2024
  12. May 08, 2024
  13. May 07, 2024
Loading