| Title | Kafka as a Service Solution Design - Pilot Application(s) |
|---|---|
| Version | 4.0 |
| Approval Pull Request (PR) | PR194241 |
Solution Design - Pilot Application(s)¶
Purpose & Scope¶
This Solution Design covers the Pilot Applications used for testing and verifying the release process, access management on the platform, communication with MAP and Application Pipeline execution. See the Solution Designs section for an overview of the entire KaaS Solution.
Abbreviations and definitions¶
See Abbreviations and definitions
Solution Design Requirements¶
| ID | Name |
|---|---|
| 1 | KaaS Pilot Data Product/KaaS Pilot Application |
| 2 | KaaS MAP Pilot Application |
KaaS Pilot Data Product (KaaS Pilot Application)¶
The KaaS Pilot Application will simulate a (simplified) use-case of the core functionality of the platform, by setting up topics and schemas in a 'Pilot Team' through the Data Product Pipeline Template. It will;
- deploy topics w/ different configuration
- deploy schemas into schema registry, used for schema validation
- deploy business metadata and tag configurations
Through pipeline approval gates between environments, configured to the default, recommended roles.
The KaaS pilot application configuration is stored here GIT: kaas_pilot_application
Detailed solution design is stored together with Kaas MAP Pilot Application.
KaaS MAP Pilot Application¶
The KaaS MAP Pilot application will act as the producer and consumer of the records in the topics created in the KaaS Pilot Application.
- The application will use the Confluent schema registry connector from MuleSoft exchange to connect to KaaS Schema registry
- The application will use Apache Kafka Connector to produce/consume topics into KaaS
- The application will authenticate w/ Azure AD and OIDC to Send/receive records
It will be a MuleSoft Application, stored on the MAP platform in the Business Group 'CS' (Cross services). Detailed documentation is stored here GIT: kaas-map-pilot-app
Traceability between Requirements¶
Traceability between Requirements (URS) and (SDR)¶
| ID | Work Item Type | URS (Status Dynamically Updated) | GIT SDR |
|---|---|---|---|
| 1422220 | URS | #1422220 | Solution Design Requirement: KaaS Pilot Application |
| 1422189 | URS | #1422189 | Solution Design Requirement: KaaS MAP Pilot Application |
Change Log¶
| Version no. | CHG no. | Approved Pull Request | Date | Change Description |
|---|---|---|---|---|
| 1.0 | CHG0100614 | PR102949 | Date of acknowledgement | New document |
| 2.0 | CHG0137496 | PR139926 | See PR | Minor update: KaaS Pilot Data Product name is added along with KaaS Pilot Application |
| 3.0 | CHG0136055 | PR145250 | See PR | Updated reference to Pipeline template, as part ADO resource Refactor CHG |
| 4.0 | CHG0170084 | PR194241 | See PR | Updated GIT link for KaaS Pilot (MAP-CS to KaaS Workspace) |