This commit adds support for P4 device and
resource management by implementing:
 * key P4 entities as Python objects
 * a context class for turning P4 info files into context
 * common functions around P4
 * a manager class which exploits P4 entities and context to manage P4 devices
 * GetConfig() RPC
 * SetConfig() RPC, and
 * DeleteConfig() RPC
 * basic internal and unit tests

Signed-off-by: Georgios Katsikas <katsikas.gp@gmail.com>

Georgios Katsikas authored Jan 14, 2022 and Georgios Katsikas committed Sep 20, 2022

Signed-off-by: Georgios Katsikas <katsikas.gp@gmail.com>

Georgios Katsikas authored Jan 14, 2022 and Georgios Katsikas committed Sep 20, 2022

Signed-off-by: Georgios Katsikas <katsikas.gp@gmail.com>

Georgios Katsikas authored Jan 14, 2022 and Georgios Katsikas committed Sep 20, 2022

Signed-off-by: Georgios Katsikas <katsikas.gp@gmail.com>

Signed-off-by: Georgios Katsikas <katsikas.gp@gmail.com>

Signed-off-by: Georgios Katsikas <katsikas.gp@gmail.com>

- device: added environemnt variable to prevent loading drivers other than emulated
- monitoring: set environment variable to force loading only emulated driver during unitary tests of monitoring

Common:
- renamed device type OPTICAL_LINE_SYSTEM to OPEN_LINE_SYSTEM
- added DATACENTER and EMULATED_DATACENTER device types.

Context:
- modified service constraints for test object to use nomenclature "metric[unit]"
- corrected ConstraintModel dump methods

Device:
- uncommented dump methods in database ContextModel and TopologyModel

OFC'22 / OECCPSC'22 tests:
- renamed device type OPTICAL_LINE_SYSTEM to OPEN_LINE_SYSTEM

WebUI:
OFC'22 / OECCPSC'22 tests:
- renamed device type OPTICAL_LINE_SYSTEM to OPEN_LINE_SYSTEM

Fix unitary tests to align with changes in monitoring component information model.

Fix monitoring loops to align with changes in monitoring component information model.

- fixed parsing of custom rules in unitary tests

- Added missing log dump in unitary test

Adapted L3_AttackMitigator/L3_CentralizedAttackDetector/L3_DistributedAttackDetector to common proto folder
- Moved imports from *.proto folder to common.proto folder
- Removed genproto.sh scripts
- Arranged requirements to accelerate Docker image creation
- Minor code and linting fixes
- Updated Dockerfile
- Arranged GitLab CI/CD pipeline

- Arranged commit before merge
- Replaced string-based timestamps by context.Timestamp
- Created helper functions to convert timestamps string from/to float
- Arranged requirements to meet dependencies of converter functions

Common:
- Corrected Python package versions to prevent collisions with p4runtime

Context:
- Minor corrections in GitLab CI/CD pipeline

Device:
- Corrected Python package versions to prevent collisions with p4runtime

Monitoring:
- Arranged requirements to accelerate Docker image creation
- Corrected Python package versions to prevent collisions with p4runtime
- Updated Dockerfile
- Arranged GitLab CI/CD pipeline

Device:
- Removed obsoleted run_tests_locally-device.sh script
- Moved imports from *.proto folder to common.proto folder
- Removed device's genproto.sh script
- Minor code and linting fixing
- Arranged requirements to accelerate Docker image creation
- Updated Dockerfile
- Arranged GitLab CI/CD pipeline
- Corrected usage of ConfigRules to use new custom ConfigRules

Monitoring:
- Moved imports from *.proto folder to common.proto folder
- Removed monitoring's genproto.sh script

- Corrected unitary test to execute pipeline

- Migrated to use new generic gRPC servicer
- Migrated to use new generic Rest servicer
- Migrated to use new settings framework
- Migrated tests to use new generic servicers and mock's
- Solved bug with endpoint monitors' population (dupplicated sample types due to wrong key generation)
- Use Emulated driver when both driver and device type are not specified
- Separated unitary tests and execution scripts per device driver
- Extracted common unitary test functionalities into separate code files
- Minor code styling/formatting

- code styling and cleanup

- Corrected default values in unitary test config template
- Minor code styling

- solved minor bug with default openconfig operations.

- OpenConfigDriver: code cleanup and added default values

- Updated default OpenConfig unitary test template config
- Added minor code improvements in OpenConfig Driver

- OpenConfigDriver migrate from netconf_client to ncclient library
- Clean integration of Candidate datastore
- OpenConfigDriver code cleanup

- Implemented support for ACLs
- Added suport for Candidate datastore

new development of microwave device - implemented the Api to get configurations, create and delete services

Signed-off-by: Georgios Katsikas <katsikas.gp@gmail.com>

OpenConfig Driver:
- updated delete operation for interfaces to just remove its description

- Added Routing Policies as special resource for interrogation during initialization
- Added flags in unitary tests to control which tests to be executed in OpenConfig.
- Added run-test-locally specific for device component.

OpenConfig Driver:
- Implemented routing policy templates, parsing and configuration.
- Implemented retry decorator for NetConf client.