- Sep 13, 2024
-
-
Waleed Akbar authored
Backend: - Updated the `StartSparkStreamer` function call to send `Analyzer_uuid` as the key for messages produced on the Kafka topic. - Updated the `SparkStream` definition to receive the key and added the key to the `streamwriter` object. Frontend: - Integrated APScheduler to manage `StreamListener`. - Added `ResponseListener` to consume messages from the `analytics_response_topic` and process them. - Added APScheduler to manage StreamListener. - Added "ResponseListener" to consumer messages from analytics response_topic and process it.
-
- Sep 09, 2024
-
-
Waleed Akbar authored
Proto: - Added `Duration_s` field to the proto file. Frontend: - Added `SelectAnalyzer` logic. - Improved message formatting in the `create_analyzer_filter()` function. - Added a test case: `test_SelectAnalytics`. Backend: - Renamed the `RunSparkStreamer` method to `StartSparkStreamer`. - Updated the `StartRequestListener` method to return `(thread, stop_event)`. - Added a `StopRequestListener` method to stop the listener. Database: - Added the `select_with_filter` method with actual logic implementation. - Updated the `ConvertRowToAnalyzer` method to correctly read the `operation_mode` ENUM value.
-
- Sep 07, 2024
-
-
Waleed Akbar authored
- Updated the position of the `stop_event` parameter. - Added confirmation for pySpark checkpoint deletion. - Added a PySpark termination script to handle the `StopCollector` event.
-
Waleed Akbar authored
**Backend:** - Added a dictionary to manage running analyzers. - Implemented logic to manage running analyzers. - Added the `TerminateAnalyzerBackend` method to handle analyzer termination. **Frontend:** - Modified and invoked the `PublishStopRequestOnKafka` method.
-
Waleed Akbar authored
- Thresholds, window_size, window_slider is added in Frontend and Backend.
-
- Sep 05, 2024
-
-
Waleed Akbar authored
- In the BackendService.py: + Updated SparkStreamer call with new parameters. - In SparkStreaming.py: + Added 'GetAggregerations' and 'ApplyThresholds' methods + Added 'window_size', 'win_slide_duration', 'time_stamp_col' and 'thresholds' parameters. - Added new messages. - Updated the 'RunSparkStreamer' call wth new parameters.
-
- Sep 03, 2024
-
-
Waleed Akbar authored
- Added Kafka Request Listener to listen for requests from the Analytics Frontend. - Updated `SparkStreamer.py` to consume and process streams from VALUE topics, and further filter rows based on KPIs in the `input_kpis` list. - Updated the frontend TOPIC from `VALUE` to `ANALYTICS_REQUEST`. - Updated messages to keep the KPI UUID consistent with the one generated by the Telemetry Backend service.
-
Waleed Akbar authored
- Added CRDB secret. - Added test script. - Added `main` and `__init__.py` files. - Added Backend Service file. - Added Spark Streamer file (successfully consuming streams from Kafka Topics). - Added Tests folder and files. - Added requirements file. - Added ANALYTICS Kafka topics in `common.tools.kafka.variables` file.
-
- Apr 18, 2024
-
-
Lluis Gifre Renom authored
-
- Feb 01, 2023
-
-
Lluis Gifre Renom authored
- Restored execute permissions
-
Lluis Gifre Renom authored
- Added/Updated headers - Added script to update copyright headers
-
- Jul 26, 2022
-
-
Lluis Gifre Renom authored
Common: - added helper scripts FrontEnd: - corrected import paths - added missing parameters in test - refined creation of backend request
-
- May 20, 2022
-
-
Lluis Gifre Renom authored
- initial skeleton (not functional)
-
- Mar 08, 2022
-
-
Lluis Gifre Renom authored
-
- Feb 17, 2022
-
-
Lluis Gifre Renom authored
-
Lluis Gifre Renom authored
-
- Feb 16, 2022
-
-
Lluis Gifre Renom authored
-
- Nov 04, 2021
-
-
Lluis Gifre Renom authored
-
- Sep 23, 2021
-
-
Javi Moreno authored
-
- Jul 16, 2021
-
-
Lluis Gifre Renom authored
- monitoring/test_monitoring.py: provides a basic testing skeleton - monitoring/requirements.in/.txt: updated with pytest - monitoring/genproto.py: added instructions to import generated Python modules using "from . import ..." instead of "import ..."; otherwise, pytest and other possible modules doing imports might complain. - monitoring/monitoring_server.py: packed start_server and stop_server functionaity to simplify test definition, minor formattings, bug resolutions and improvements in package import. - monitoring/monitoring_client.py: minor formattings, bug resolutions, and improvements in package import.
-
- Jun 14, 2021
-
-
Ricard Vilalta authored
-
- Jun 11, 2021
-
-
Ricard Vilalta authored
-