Post on 08-Mar-2018
transcript
sqs.com
SQS – der weltweit führende Spezialist für Software-Qualität
RPD - RapidDeploymentPackage für SAP PBT - Prozessorientiertes Testing
SAP Testing
sqs.com
SQS – der weltweit führende Spezialist für Software-Qualität
Agenda
• SAP SolutionManager 7.2 • CBTA - ComponentBasedTestAutomation
• SQS RPD – RapidDeploymentPackage for SAP
• Testautomatisierung mittels vorgefertigter Componenten
• SAP SolutionManager 7.2 • Solution Documentation / BusinessBlueprint
• SQS Process Based Testing • Prozessorientiertes Testing
© SQS Software Quality Systems Ges.mbH | Titel der Präsentation | Intern | Version 1.0 | 2
3 © SQS Software Quality Systems Ges.mbH | Titel der Präsentation | Intern | Version 1.0 |
SAP Solution Manager 7.2
CBTA - ComponentBasedTestAutomation
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 4
SAP Solution Manager 7.2 – Test Suite Capabilities
Business Process
Change Analyzer (BPCA)
Test Execution • Manual Test Execution
• Automated Test Execution
• Defect Management
Test Managment Analytics • Gap reports
• Status reports
• Progress reports
• Dashboard
other 3rd party test automation tools
Change Impact Analysis
HP UFT
CBTA (Component Based Test Automation)
WS Certify
Test Plan Management • Test Plan
• Test Packages
• Test Sequences
• Tester assignment
Scope and Effort
Analyzer (SEA) Test scope estimation
before upgrade
Test scope optimization during upgrade
Solution Documentation • Executable Library
• Process Step Library
• Business Processes
Test Automation Framework
S/4HANA Test Experience*
Test Data SAP TDMS • Lean test system setup and refresh
Test Data Container (TDC) • Test data provisioning for manual and automated tests
Test Cases • Manual Tests
• Automated Tests
Solution Documentation Test Planning Test Execution and Analytics Change Impact
Analysis
* planned
HP UFT SAP TAO SAP Solution Manager Adapter for HP QC HP ALM
Supported UI technologies by SAP test tools: SAPGUI, WD-ABAP, CRM Web-Client, SAPUI5, Fiori, … Partner test tools: all other UI technologies
Integration for SAP customers already using
HP test suite
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 6
Automated Tests Test Configuration and its building blocks
Test Script
Business Process
…
HP UFT
System under Test Test Data
Test Configuration
other ISV test automation tools
Order Type Customer Product
OR C1000 P-100
OR C2000 P-200
Test Data Container
SAP customers have a choice of test automation tools integrated with SAP Solution Manager 7.2 through the Test Automation Framework
CBTA, eCATT
Certify Launch creation or maintenance
of automated tests
Composite Tests for E2E business processes covering SAP and non-
SAP process steps CBTA 1 CBTA 2 HP UFT 3 CBTA 4
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 7
Test Automation with CBTA
Component-based Test Automation (CBTA)
Business Analyst executes
business transaction via CBTA
Test Composition Environment (TCE)
CBTA creates test script based on test
components during execution
Attributes • Business Transaction • Systems under Test
Parameters • Parameters for test data inputs • Dynamic handover between scripts
Script Components
• SAP delivered test components • On the fly generated components
Test Data • Data defined in Test Data
Container • Test Data Assignment Wizard
CBTA (Component-based Test Automation) is part of SAP Solution Manager and
provides test automation for all major SAP UI technologies
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 9
Test Management Test Execution with automated test cases
LAB Preview
Test Configuration
Test Script SAP CBTA, HP UFT, …
System under Test
Test Data Container (TDC)
Logon and automated execution of business process
Test data selection
TDC
Test execution: handover of • Test Script + • Test Data + • Test System
User starts test execution
Test Script Test Data System Data
Tester Worklist Test results and logs
1
2
3
5
4
10 © SQS Software Quality Systems Ges.mbH | Titel der Präsentation | Intern | Version 1.0 |
SQS RapidDeploymentPackage
Beschleunigung der Testautomatisierung mit vorgefertigten Componenten
SQS’ new smart business process testing approach for SAP SAP Knowledge Assets as accelerators
Requirements Writing TCs Execution
• Use existing test assets • Readily available for “n”
number of business processes
• Proven methodology • Expedited Testing • Reduced Effort
Traditional Testing methodology
SQS’s Smart Business Process Testing Approach
SQS Group | SQS Global SAP Testing Capabilities, Solutions & Services | 11
Knowledge Asset Management – SAP Functional Regression Testing (e.g. Upgrades, Roll-outs, Run-SAP type of projects)
SAP Reusable Assets/Accelerators
Module
Critical Business Process/Scenarios
Available in SQS Assets Logical Test Cases Finance & Controlling 19 490 Sales and Distribution 24 350
Materials Management 50 530 Production Planning 38 1120 Quality Management 14 210
Warehouse Management 17 160 Plant Maintenance 12 465
Human Capital Management 9 410 CRM Sales
11 600
CRM Marketing CRM Master Data (Account Management, Product
Management) IS-Utilities 73 585 IS-Retail 57 1390
IS-Pharma 82 130
List KAM Assets SQS Group | SQS Global SAP Testing Capabilities, Solutions & Services | 12
13 SQS Group | SQS Global SAP Testing Capabilities, Solutions & Services |
SAP Modules Logical test cases available in SQS Asset repository
Critical Business Process/Scenarios
available in SQS Assets
Business Process Test coverage %
Production Planning 850 38 80 %
Quality Management 120 12 80 %
Plant Maintenance 285 13 70 %
Organizational Management 20 1 80 %
Sales and Distribution 245 24 70 %
Material Management 210 50 85 %
Warehouse Management 115 17 85 % Customer Relationship Management 760 11 60 %
Finance and Controlling 250 18 70 %
COPA – Profitability Analysis 20 10 50 %
Example of SQS Assets Coverage: SAP ECC ERP (Manufacturing Customer)
SQS Test Automation FaQtory™ SAP Test Automation: Approach & Solutions
SQS is listed on the AIM London
Subject Matter Experts Test Architects Test Analysts
Batch runs of test cases
Identify Module & Test Cases
Designing Framework Function
Writing specifications
Accepting developed functions and test cases
Implementing functions
Implementing test cases
Code review
Single runs of test cases
Test specs Test design specs
Test FaQtory Assembly helps achieve scalability • Robust, maintainable & scalable SAP automation framework • Over 600 automated scripts maintained for ECC 6 (various enhancement Packs) • Extremely efficient execution and defect tracking mechanism
Test Assets
Test
Automation
FaQtory
Designing Framework Designing Framework
QC TC Restructuring
QC TC Restructuring
Identify Test Cases
Back
SQS Group | SQS Global SAP Testing Capabilities, Solutions & Services | 14
SQS-TEST®/Professional Suite and Solution Manager
SQS Group | SQS Global SAP Testing Capabilities, Solutions & Services | 15
Test Management
Solution Manager SQS-TEST®/Professional Suite
Business Process Repository (Business Process Hierarchy)
(B.P.M / BPx)
Business Blue Prints Project Requirements/
Scope
Test Workbench
Test Planning
Design
Planning & Control
Execution
End to End Scenarios
Business Processes
Test Cases
Test Steps
Test Pack (step level control)
Test cases execution
Map hierarchy
Test results
Test Pack (Test Cases, Test Execution,
Test Reporting)
Upload results
Map Test Pack and
upload the Tc’s in
Excel/ Word
SQS RDP -> Solution Manager Übernahme von Testfällen
Business Blueprint
SAP Solution Manager
Download test assets from SQS test Professional
and upload to Solman
SQS Group | SQS Global SAP Testing Capabilities, Solutions & Services | 16
SQS SAP Testing Services Portfolio – Rapid Deployment
Quality Management
Health Check 1.1
Master Quality Plan 1.2
QA for Business Blueprints
1.3
QA for Implementation
1.4
Test Management
Test Strategy 2.1
Master Test Plan 2.2
Detailed Test Plan 2.3
Operational Test Management
2.4
Test Manage-ment Office
2.5
Functional Testing
Data Migration Test 3.1
SAP Core Test & Optimization
3.2
Interface Test 3.3
End-to-End Test 3.4
Roles & Autho-rization Test
3.5
User Acceptance Test 3.6
Non-Functional
Testing
Load & Perfor-mance Test
4.1
Code Analysis 4.2
Infrastructure Test 4.3
Security Test 4.4
Operations Acceptance Test
4.5
Test Infrastructure
Test Environment Management
5.1
Test Data Management
5.2
Test Automation for Regression
5.3
Test Tools for SAP Testing
5.4
Training
ERP Testing Overview
6.1
ERP Test Automation
6.2
ERP Load & Performance
Test 6.3
*Further information on each service could be provided upon request
SQS Group | SQS Global SAP Testing Capabilities, Solutions & Services | 17
SAP Testing Strategy and Differentiation
18 © SQS Software Quality Systems Ges.mbH | Titel der Präsentation | Intern | Version 1.0 |
SAP Solution Manager 7.2
BusinessBlueprint
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 19
SAP Solution Manager 7.2 – Test Suite Capabilities
Business Process
Change Analyzer (BPCA)
Test Execution • Manual Test Execution
• Automated Test Execution
• Defect Management
Test Managment Analytics • Gap reports
• Status reports
• Progress reports
• Dashboard
other 3rd party test automation tools
Change Impact Analysis
HP UFT
CBTA (Component Based Test Automation)
WS Certify
Test Plan Management • Test Plan
• Test Packages
• Test Sequences
• Tester assignment
Scope and Effort
Analyzer (SEA) Test scope estimation
before upgrade
Test scope optimization during upgrade
Solution Documentation • Executable Library
• Process Step Library
• Business Processes
Test Automation Framework
S/4HANA Test Experience*
Test Data SAP TDMS • Lean test system setup and refresh
Test Data Container (TDC) • Test data provisioning for manual and automated tests
Test Cases • Manual Tests
• Automated Tests
Solution Documentation Test Planning Test Execution and Analytics Change Impact
Analysis
* planned
HP UFT SAP TAO SAP Solution Manager Adapter for HP QC HP ALM
Supported UI technologies by SAP test tools: SAPGUI, WD-ABAP, CRM Web-Client, SAPUI5, Fiori, … Partner test tools: all other UI technologies
Integration for SAP customers already using
HP test suite
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 20
System Landscape and Solution Documentation
System Landscape
SAP ERP
DEV
QAS
PRD
QAS
DEV
PRD
Single source of truth
SAP CRM
Solution Documentation
SAP SRM
QAS
DEV
PRD
Solution: <Solution title>
Branch: • Production
• Maintenance • <e.g. Innovation>
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 21
SAP Solution Manager 7.1 – selected pain points
in Projects and Solutions 2 different directories with different functionality for Projects and Solutions
Performance issues in both Directories
Limitation to 3 level hierarchy (Scenario Business Process Process Step)
Insufficient and nonflexible Lifecycle Management
Architectural limitations for enhancements requested
…
TO DO
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 22
How to setup the Business Blueprint
Alternatives to create Process Step Library (PSL) 1. Automated Blueprint generation program
RUTILITY_BLUEPRINT_GENERATION via SAP Note 2061626 (SP10 and beyond)
Application „Scope and Effort Analyzer“ (SP11)
2. Solution Documentation Assistant
3. MS Excel upload
Thousand of users execute SAP transactions every day
Sales:
Create Sales Order, …
Financials
Billing HR:
Employee absence
Usage statistics can be used to build-up the initial Blueprint (PSL)
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 23
Solution – Branches - System Landscape
Solution Administration (Transaction SLAN): Business Solution (BUSINESS_SOLUTION)
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 24
Solution Documentation Libraries and Business Processes
ERP Scenarios
Sales Scenarios
Quotation
Business Processes
Sales Order STD
Order to Cash V1
Goods Issue
Billing
Delivery
Executables
SD
Quotation (VA21)
Library
Sales Order (VA01)
SD-SLS
Goods Issue (VL02N)
Billing (VF01)
Delivery (VL01N)
SD-BIL
LE-SHP
LE
Technical functions
Z_Price_Determination
FUNC
Customer Exe
Dev Class 1
ZVA01 Process Steps
Sales Order STD
Sales Order Special
Quotation
Sales Order Special
Order to Cash V2
Goods Issue
Billing
Delivery VA01, VA02, VA03
ZVA01, …
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 25
Solution Documentation Executable Library
Generated Executables (like transactions) for SAP ERP system
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 26
Solution Documentation Process Step Library
Process Steps defined in Process Step Library with reference to executables from Executable Library
and assigned Test Cases
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 27
Solution Documentation E2E Business Processes
Business Processes „Order to Cash“ defined in Business Process section with reference to Process Step Library and Executable Library.
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 28
Solution Documentation Process Diagram for Business Processes
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 29
Solution Documentation with built-in lifecycle Management Branch concept
Production branch
Maintenance branch
Innovation branch Release 1 Implement baseline processes
• Single Function Tests (SFT) – QAS System • User-Acceptance Tests (UAT) - QAS • Functional Integration Tests (FIT) - QAS • Regression Tests (RT) - Pre-PRD System
Go-live of Release 1
Release 1 changes visible
Go-live of Maintenance changes
Release 2 Implement add.processes
• Single Function Tests (SFT) • User-Acceptance Tests (UAT) • Functional Integration Tests (FIT) • Regression Tests (RT)
Maintenance changes • Execute RT
The branch functionality records all changes (blueprint nodes, test cases, TBOMs) and provides life-cycle support
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 30
Solution Documentation with built-in lifecycle Management Branch concept – simple example
Production branch
Maintenance branch
Innovation branch Release 1 • Order-to-Cash (O2C) V1 • Procure-to-Pay (P2P) V1
Go-live of Release 1
Release 1 changes visible
Go-live of Maintenance changes
Release 2 • O2C V2 • SFT, UAT, FIT • Define regression tests • Execute regression tests
Maintenance change: • Customizing change for
O2C V1 • Execute RT
sqs.com
SQS – der weltweit führende Spezialist für Software-Qualität
Process based Testing: Vision zur Effizienzsteigerung
sqs.com
Act
Akt Akt Akt
SubP Akt Akt
SubP Akt
SubP
BP Step
BP Step BP Step BP Step
BP Step BP Step
BP Step BP Step
System Process / Business Function
Entsch BP Step
System Process
System Process
System Process
Domain A
Domain XYZ
Vorgehen - Die zwei Layer eines Geschäftsprozessmodells Process based Testing (PbT)
Act
Akt Akt Akt
SubP Akt Akt
SubP Akt
SubP
BP Step
BP Step BP Step BP Step
BP Step BP Step
BP Step BP Step
Business Process
System Process
Entsch BP Step
System Process
System Process
System Process
BP Step
BP Step BP Step BP Step
BP Step BP Step
BP Step BP Step
Business Process
EntschEntschEntschEntschEntsch BP StepBusiness Layer existiert
Act
Akt Akt Akt
SubP Akt Akt
SubPAkt
SubP
System Process
System ProcessSystem Process
System ProcessSystem ProcessSystem Process
System Process
Application Layer (Ebene 4) wird erstellt
Application Layer = • Business (&System) Functions • + Interfaces
Existiert in ARIS,ADONIS oder als ppt-Bild
Systemprozesse werden in VISIO erstellt und sind damit elektronisch auswertbar
Geschäfts-Prozesstest abgeleitet aus der Prozessmodellierung
Process based Testing (PbT) - Ziele
• Es gibt eine Technik „PbT“ (Process based Testing) bei der die Prozessmodellierung die Basis für den GP-Test ist
• Die GP-Modellierung wird erweitert um die bei Ihnen bereits genutzte Systemebene 4. Der Abdeckungsgrad lässt sich risikobasiert definieren
• Das Design der Testfälle wird automatisch (ohne Aufwand) abgeleitet. • Ablage der Testfälle im SolutionManager erfolgt über vorhandene
Schnittstelle • Redundante Informationen werden vermieden – Jede Information existiert
nur an genau einem Ort in einem Modell - der GP-Dokumentation - Inkonsistenzen und Pflegeaufwand werden extrem minimiert
• Einhalten der regulatorischen Vorgaben – Ableitung (Anforderungen zu Test) , Abdeckung, Nachvollziehbarkeit, Dokumentation, Risiko-basiertes Testen (Pfadabdeckungen werden generiert)
33 © SQS Service Management | PbT| 03.06.2016
Das Test-Modell ist eine Erweiterung des Prozessmodells
IT Portfolio gesamt
Geschäftsprozess- Modell
Design, Programmierung, Roll Out, …
Test fälle für Funktionale Tests
(Konfiguratinosabdeckung)
ManuelleTest Ausführung / Automatisierte Ausführung
Systems
Business- und System Requirements
(auch als Delta)
Test Modell
Process based Testing (PbT)
34 © SQS Service Management | PbT| 03.06.2016
1. Vom “Business Layer” werden die Testfälle ermittelt, die zu einem Integrationstest, Abnahmetest oder auch End-2-End Test gehören
2. Vom “Application Layer” werden die Testfälle für den Funktionstest oder Dialog-Test oder Szenarien-Test automatisch abgeleitet
2. Vorteile PbT Überblick - Optimierter Testprozess
Process Based Testing (PbT)
36 © SQS Service Management | TIRP| 03.06.2016
Effiziente Qualitätssicherung • Auf der Grundlage von Geschäftsanforderungen durch
Prozessmodellierung auf Geschäftsprozessebene • Auf der Grundlage von Systemanforderungen durch Prozessmodellierung
auf Applikationsebene Verbesserung/Erleichterung des Projektmanagements
• Durch vollständige Transparenz (& durch KPI`s) V 0.17 V0.21
Processes Total of designed Processes 204 262Total of designed Processes Prio A, B, C BP 18 27
SP 69 118Unchanged since V0.17 BP x 13
SP x 62Objects/Screens 147 157
Branches Total of integrated Branches 282 362Total of integrated Branches in Prio A, B, C 257 323
Maturity Average completeness of BusinessLayer A, B, C in % BP 85,68 86,48Average completeness of ApplicationLayer A, B, C in % SP 83,18 71,69
2. Vorteile PbT Überblick - Optimierter Testprozess
Process based Testing (PbT)
• Strukturierte und übersichtliche Spezifikationen von Testmodellen, anhand derer Testfälle nach einer formalen Methode generiert werden
• Minimierung des Zeitaufwandes für die Umsetzung von Change-Request bis zu konkreten Testfällen, die in verschiedenen Teststufen ausgeführt werden
• Reduzierung der Kosten für das Testfalldesign im Produkt-Lifecycle. Testfallerstellung erfolgt durch den Generator ‚Process Notation Processor‘ per Knopfdruck
• Steuerung der Abdeckung durch selektive Generierung der Pfade risikobasiert - komplett in Abhängigkeit von Bedarf, Zeit, Kosten
• Wartung der „Testfälle“ zentral im GP-Modell • Systemmodell in Visio ist interpretierbar und damit nutzbar für GP-
Simulationen, Testfall-Generierung, Code Generierung etc. • Fertigstellungsreife ist in Stufen realisier- und nutzbar
37 © SQS Service Management | PbT| 03.06.2016
In Projekten nachgewiesener Nutzen von PbT Process based Testing (PbT)
• Prozessmodel wird vom Product Owner (Fachbreich) freigegeben • Beschreibung der Testfälle detailliert und wiederverwendbar • Fachbereichsmitarbeiter werden für den Test nicht mehr benötigt • Automatisierung der Testdurchführung, Erstellung der Skripte ist
automatisiert durchführbar • Time-to-Market wird beschleunigt • Regulatorische Anforderungen werden erfüllt – Nachvollziehbarkeit des
Vorgehens, Tracebility Anforderungen - Tests • Durchgängiges Vorgehen, Interpretierbarkeit des Visio-Modelles und GP-
Modelle werden weiter verwendet • Wirtschaftlichkeitsrechnung, RoI < 2 Jahre konnte in Projekten nachgewiesen
werden
38 © SQS Service Management | PbT| 03.06.2016
SCRUM ProcessedBasedTesting im agilen Umfeld
39 © SQS Software Quality Systems AG | Agile| März 2016 |
ProcessModell
PbT ProcesModel contains Epic and extracts UserStory ProcessedBasedTesting im agilen Umfeld
40 © SQS Software Quality Systems AG | Agile| März 2016 |
Epic UserStory Incl. Requirements
SCRUM ProcessedBasedTesting im agilen Umfeld
41 © SQS Software Quality Systems AG | Agile| März 2016 |
UserStory incl. Req
© SQS Software Quality Systems AG | Industrialisation | Dec 2015 | 42
User-Acceptance-Test
Development / Realization /
Implementation
Actor/Events BP+SP Cutting BPS Creating
Path Design = Concrete TestCases =
Simulations
Business Requirements Specification
BP+SP Design TestConditions
Project Order with high level Requirements
Product(s) maintained, Documentation, etc.
New V-Modell as Baseline for Epic and extracted UserStorys
Integrationtest
Configured Extractions from Constructionplan
Componenttest
Process+Path SignOff
Systemtest
5 % 25 % 70 % 95 % 100 %
Maturity UAT executed here!
Welche Vorgehensweisen aus dem klassischen Umfeld lassen sich im agilen Vorgehen einsetzen?
ProcessedBasedTesting im agilen Umfeld
43 © SQS Software Quality Systems AG | Agile| März 2016 |
sqs.com
SQS Software Quality Systems Ges.mbH Hietzinger Kai 67–69 1130 Wien, Österreich Telefon: +43 1 3193523-0 Telefax: +43 1 3193523-24 info-austria@sqs.com
Vielen Dank für Ihre Aufmerksamkeit.
((Bitte wenn gewünscht ergänzen)) Name der Kontaktperson Telefon: +43 1 XXXXXXX Mobil: +43 XXX XXXXXXXX vorname.nachname@sqs.com