Post on 28-Mar-2015
transcript
Service Data Challenge Meeting, Karlsruhe, Dec 2, 2004
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
Plans and outlook at GridKa
Forschungszentrum Karlsruhe GmbHInstitute for Scientific Computing
P.O. Box 3640D-76021 Karlsruhe, Germany
Holger Marten
http://www.gridka.de
Service Data Challenge Meeting, Karlsruhe, Dec 2, 2004
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
HEP experiments served by GridKaHEP experiments served by GridKa
Atlas (SLAC, USA)
(CERN)(FermiLab ,USA)
(FermiLab ,USA)
• Committed to Grid Computing
• Have real data already today
LHC experiments non-LHC experiments
Service Data Challenge Meeting, Karlsruhe, Dec 2, 2004
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
Grid Computing Centre Karlsruhe, GridKaGrid Computing Centre Karlsruhe, GridKa
Prototype Main setup Full operation
2005 2006 2008
non- LHC Experiments
2002 2009
Data processing & Grid deployment
Phase I Phase II Phase III
Data challenges & simulation Data taking
LHC Experiments / LCG
Service Data Challenge Meeting, Karlsruhe, Dec 2, 2004
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
0
2000
4000
6000
8000
2002 2003 2004 2005 2006 2007 2008 2009
Tbyt
e
4000
3000
2000
1000
0
kSI9
5
LCG Phase I Phase II Phase III
CPUDisk
Tape
GridKa – Planned hardware resources (status 07/2004)GridKa – Planned hardware resources (status 07/2004)
Oct ’04:1070 CPUs220 TB disk375 TB tape
Service Data Challenge Meeting, Karlsruhe, Dec 2, 2004
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
0%
20%
40%
60%
80%
100%
2002 2003 2004 2005 2006 2007 2008 2009
0%
20%
40%
60%
80%
100%
2002 2003 2004 2005 2006 2007 2008 2009
Distribution of planned resources at GridKaDistribution of planned resources at GridKa
0%
20%
40%
60%
80%
100%
2002 2003 2004 2005 2006 2007 2008 2009
CPU
Disk
Tape
non-LHC
non-LHC
non-LHC
LHC
LHC
LHC
Service Data Challenge Meeting, Karlsruhe, Dec 2, 2004
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
each January-October 2003 2004
processor usage [h] 1.591.000 3.215.000
number of jobs 263.000 1.092.000
Usage of GridKaUsage of GridKa
LHC 33%
nLHC 67%
Service Data Challenge Meeting, Karlsruhe, Dec 2, 2004
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
Site Total Jobs CPU Time (h) Events O.Data (GB) EventsUSA 56 1408 32500 13 0.02%Israel 77 2493 64600 21 0.03%Brasil 247 4489 231355 83 0.12%Switzerland 813 19826 726750 235 0.39%Taiwan 595 8332 757200 216 0.41%Canada 1148 21286 1204200 348 0.65%Poland 1418 24058 1224500 403 0.66%Hungary 1817 31103 1999200 592 1.08%France 5888 135632 4997156 1967 2.69%Netherlands 6408 131273 7811900 2246 4.21%Russia 10059 255324 8999750 3388 4.85%Spain 13378 304433 13687450 4189 7.38%Germany 17101 275037 17732655 6235 9.56%Italy 25626 618359 24836950 7763 13.39%United Kingdom 46580 917874 47535055 14567 25.62%CERN 52940 960470 53708405 18948 28.95%
All Sites 184151 3711397 185549626 61214 100.00%
GridKa contribution to LHC DataChallengesGridKa contribution to LHC DataChallenges
Contribution by GridKa to LCG DataChallenges ~ 8-12% depending on experiment
9,5 %
LHCbAliceanteilig
Service Data Challenge Meeting, Karlsruhe, Dec 2, 2004
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
http://goc.grid-support.ac.uk/lcg2
Status LCG/EGEE production environmentStatus LCG/EGEE production environment
GridKa contribution: 1070 CPUs, 5 TB
Service Data Challenge Meeting, Karlsruhe, Dec 2, 2004
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
GridKa – Internet-ConnectionGridKa – Internet-Connection
2001 2002 2003 2004 2005 2006 2007 2008
34 Mbps
155 Mbps
2 Gbps
10 Gbps 20 Gbps
StartDiscussionwith Dante !
Sept 2004 Upgrade of the DFN-Interconnect from Karlsruhe to Géant with 10 Gbps; Tests running !
Routing (full 10 Gbps): GridKa – DFN (Karlsruhe) – DFN (Frankfurt) – Géant (Frankfurt) – Géant (Paris) – Géant (Genf) – CERN
Start10 Gbps
Tests
Service Data Challenge Meeting, Karlsruhe, Dec 2, 2004
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
RouterC
CPU
2007
10 G 10 G
RouterA
CPU
2004
1 G1 G
RouterB
CPU
2005/6
10 G
10 G
Internet
RouterD
CPU
2008
10 G
10 G10 G
10 G
Plan for LAN/WAN extensions under discussionPlan for LAN/WAN extensions under discussion
Service Data Challenge Meeting, Karlsruhe, Dec 2, 2004
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
GridKa planning for the next yearGridKa planning for the next year
• increase CPU/ disk/ tape capacities by ~30%
• 10 Gbit/s Internet into production
• performance tests & optimization of SAN storage access
• testing S-ATA in production
• dCache connection to tapes in production
• Planning for expansion 2006-2008 !
• Tier-0/1 Service Challenges
• gLite (at least) in pre-production service
Service Data Challenge Meeting, Karlsruhe, Dec 2, 2004
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
IssuesIssues• application software & middleware depends on OS
• (too ?) many different test and production services with different status
- prototype service (testbed) with SL & gLite- pre-production service with SL on WN & LCG-2.2.0- service challenge setup- implementing VOMS & accounting- production service with RH7.3
We are currently writing a migration plan toScientific Linux & LCG-2.3.0
- it’s not easy without interrupting services- versions of exp. software & mw MUST become more flexible & interoperable in the future
let’s see gLite; might be better ?
Service Data Challenge Meeting, Karlsruhe, Dec 2, 2004
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
Issues IIIssues II
• limited technical information for planning 2006-2008- how many Tier-2’s and what are their demands- data classes and data rates from applications (tape access!)
wait for computing models in January’04
• limited manpower resources for increasing number of activities- applied for in 2005: 30 persons- funded in 2005: 20 persons- avail. end of 2004: 15 persons (+ 4 in GGUS)
... for everything including implementation, testing & running the GridKa site for LCH and non-LHC