Post on 01-Aug-2020
transcript
Ein Unternehmen der Daimler AG
Lecture @DHBW: Data Warehouse
00 Course intro
Andreas Buckenhofer
Daimler TSS GmbH
Wilhelm-Runge-Straße 11, 89081 Ulm / Telefon +49 731 505-06 / Fax +49 731 505-65 99
tss@daimler.com / Internet: www.daimler-tss.com
Sitz und Registergericht: Ulm / HRB-Nr.: 3844 / Geschäftsführung: Martin Haselbach (Vorsitzender), Steffen Bäuerle
© Daimler TSS I Template Revision
Andreas BuckenhoferSenior DB Professional
Since 2009 at Daimler TSS
Department: Machine Learning Solutions
Business Unit: AnalyticsDHBWDOAG
Contact/Connect
vcard
• Oracle ACE Associate
• DOAG responsible for InMemory DB
• Lecturer at DHBW
• Certified Data Vault Practitioner 2.0
• Certified Oracle Professional
• Certified IBM Big Data Architect
• Over 20 years experience with
database technologies
• Over 20 years experience with Data
Warehousing
• International project experience
We make Daimler themost innovative mobility provider.We don‘t build cars, but we design innovative, holistic IT solutions forDaimler.
Daimler TSS 4
Sales & CareEnabling brilliant customer journeys
through customer interaction and
measurable customer proximity
Strategic InitiativesDeveloping new topics and ideas as well as
emerging technologies for Daimler
Cyber SecurityCreating customized, holistic
solutions for IT security
MobilityStaying agile with new
mobility concepts
Digital ProductionCreating optimum production processes
with continuous data analysis
Digital VehicleDesigning reliable software
development for a sophisticated
autonomous driving experience
Integrated, innovative and always close to the issue.
Daimler TSS
Methodological expertise and solutions coupled with technological excellence and a maximum degree of security are our specialties.
Acutely aware of this special position of trust, we bear responsibility through market-leading IT solutions for the success and future of a globally active group.
Driven by innovative ideas, we always venture across borders to find the best solutions and generate impressive results.
Daimler TSS 6
Our Locations & Project Hubs
D Ulm (Headquarters), Stuttgart, Berlin, Karlsruhe
KL Project hub Kuala Lumpur
CH Project hub China
*As of January 2019
4 locations / 1203 employees*:
We attach great importance to both human and digital networking.Passion for IT and a still very intimate start-up culture unite us in these endeavors, ensuring a sense of community and creative freedom in everyday working life.
Daimler TSS Data Warehouse / DHBW 8
Who are you?
Knowledge or experience:
- Databases
- SQL
- DWH
- Big Data
Your expectations?
About you
Daimler TSS Data Warehouse / DHBW 9
DWH Lecture – topics with learning targets
• Understand the importance of a data-driven culture
• Know tools relevant for DWH and Big Data
• Name DB technologies and techniques that are well-suited for DWHs
• Describe different DWH and Big Data architectures in detail
• Explain DWH data modeling (physical models)
• Explain Data integration/engineering (ETL) processes
• Understand Streaming technologies
• Specify visualization & metadata & security & PM requirements
• Name current DWH and Big Data trends
Daimler TSS Data Warehouse / DHBW 10
Daimler TSS
Data
Source
Data
Usage
Data Infrastructure
Data Management
Data Processing
Data Flow
Data Security
Data Governance
Data Culture
LogsOLTP
File Formats
Social Media
Images
Do
cum
en
ts
Machines
Star Schema
ODSData Vault
3NF
(SQL) Engines
Appliance
Virtualization
Reporting
Dashboarding
Search
Data Mining
Exploration
Simulation
Info
rmati
on
Desi
gn
ETL Batch
Str
eam
ing
CleansingProfiling
Map Reduce
ELT
RAM
SSD
Harddisk
Video
Sensors
Geospatial
Staging
Data Mart
Data Lake
Monitoring Scheduling Logging
Ethics Law GDPR
Data Catalog Metadata Domain Model
#dataops agile Project Management
Execution
Integration
Error Handling
Authentication Authorization Anonymization
Clic
kst
ream
Archive
On premises
In-MemoryMPP
RDBMS NoSQL Hadoop
MDM
Cube Core Warehouse Layer
KappaLambda
Real time
Micro Batch
Graph Models
Automation
Collection
Self Service
Planning
An
aly
tics
Audio
Glossary Data Quality
Cloud
Legacy
Text
Mobile
Data Hub
Daimler TSS Data Warehouse / DHBW 11
Many employment opportunities
DWH department in every (bigger) end user company, also in many medium-sized or small-sized companies
DWH department in every (bigger) consulting company
DWH-only specialized consulting companies
DWH tool vendors
Daimler TSS Data Warehouse / DHBW 12
Many employment opportunities – challenging JOB requirements
DWHs are complex, much more complex compared to most OLTP systems
Challenging job profiles with comprehensive requirements
• Data Architecture
• Data Integration / ETL
• Data Modeling (not only 3NF)
• Data Visualization
• Data Quality
• Data Security
• Requirements Engineering
• Project Management
Daimler TSS Data Warehouse / DHBW 13
Job description examples
Daimler TSS Data Warehouse / DHBW 14
Job description examples
Daimler TSS Data Warehouse / DHBW 15
About the lecture
• 36 semester periods per week (Semesterwochenstunden)
• 14:15 – 17:30
• 2.10. / 10.10. / 17.10. / 24.10. / 31.10. / 7.11. / 14.11. / 28.11. / 5.12. / 12.12.
• Structure of the lecture
• Review of the preceding lecture
• Presentation of content with (group) tasks
• Group exercise
• Exam
• 1h
• Questions in German
Daimler TSS Data Warehouse / DHBW 16
Course material
• Download slides from
http://wwwlehre.dhbw-stuttgart.de/~buckenhofer/
Daimler TSS Data Warehouse / DHBW 17
Course contact
• Who is the class representative?
• Do you have a class email address?
• Please send me an email so that I have your contact data
Daimler TSS Data Warehouse / DHBW 18
Literature
Daimler TSS Data Warehouse / DHBW 19
Literature
http://btw2017.informatik.uni-stuttgart.de/slidesandpapers/Tutorial/SDM_slides.pdf
Daimler TSS Data Warehouse / DHBW 20
Seminar paper (Studienarbeiten)
Studienarbeit Teamgröße
Real-Time nahe Analyse von Tweets mit Hilfe von Apache Kafka und Apache Pulsar 1 Person
Prototypische Realisierung eines Wissensnetzes (Knowledge Graph) mit einer Graph-Datenbank 1-2 Personen
Storytelling mit Geodaten im Web und auf Apps 1-2 Personen
Real-Time nahe Speicherung und Analyse von geographischen Zeitreihendaten in einer Geo-
Datenbank
1-2 Personen
Konzeption und Implementierung eines Data Hubs für die Speicherung und den Austausch von
Fitnessdaten
1-2 Personen
JSON – schemalose Zukunft beim Datenbank-Design? 1 Person
Speicherung und Verarbeitung von Geodaten in Datenbanken 1 Person
Cloud-native Datenbanken für Docker und Kubernetes - der Beginn einer neuen DB-Ära? 1 Person
Daimler TSS Data Warehouse / DHBW 21
Finally
Questions?
Any time
Feedback
After lecture or by
Daimler TSS GmbH
Wilhelm-Runge-Straße 11, 89081 Ulm / Telefon +49 731 505-06 / Fax +49 731 505-65 99
tss@daimler.com / Internet: www.daimler-tss.com
Sitz und Registergericht: Ulm / HRB-Nr.: 3844 / Geschäftsführung: Martin Haselbach (Vorsitzender), Steffen Bäuerle
© Daimler TSS I Template Revision