PublicationsBack to Top

BaBar's experience with preservation of data and analysis capabilities
Accepted for publication in the CHEP 2023 Proceedings
Managing remote cloud resources for multiple HEP VO's with cloudscheduler
Accepted for publication in the CHEP 2023 Proceedings
HEPScore: A new CPU benchmark for the WLCG
Preprint (arxiv) June 2023
Data Preservation in High Energy Physics -- DPHEP Global Report 2022
European Physical Journal C 83, 795 (2023)
HEPiX benchmarking solution for WLCG computing resources
Computing and Software for Big Science (2021) 5, 28
HEPiX benchmarking solution for WLCG computing resources
Submitted to the CHEP2021 Conference
Cloudscheduler: a VM provisioning system for a distributed compute cloud
EPJ Web of Conferences 245, 07031 (2020)
ATLAS Sim@P1 upgrades during long shutdown two
EPJ Web of Conferences 245, 07044 (2020)
Using Kubernetes as an ATLAS computing site
EPJ Web of Conferences 245, 07025 (2020)
The Dynafed data federator as a grid site storage element
EPJ Web of Conferences 245, 04003 (2020)
High-throughput cloud computing with the Cloudscheduler VM provisioning service
Computing and Software for Big Science (2020) 4:4
Using a dynamic data federation for running Belle-II simulation applications in a distributed cloud environment
EPJ Web Conf. Vol 214, 2019, 23rd Int Conf on Computing in High Energy and Nuclear Physics (CHEP 2018)
Integrating a dynamic data federation into the ATLAS distributed data management system
EPJ Web Conf. Vol 214, 2019, 23rd Int Conf on Computing in High Energy and Nuclear Physics (CHEP 2018)
Sim@P1: Using Cloudscheduler for offline processing on the ATLAS HLT farm
EPJ Web Conf. Vol 214, 2019, 23rd Int Conf on Computing in High Energy and Nuclear Physics (CHEP 2018)
Quasi-online accounting and monitoring system for distributed clouds
EPJ Web Conf. Vol 214, 2019, 23rd Int Conf on Computing in High Energy and Nuclear Physics (CHEP 2018)
Rucio - Scientific Data Management
Barisits, M., Beermann, T., Berghaus, F. et al. Comput Softw Big Sci (2019) 3: 11. https://doi.org/10.1007/s41781-019-0026-3
Federating distributed storage for clouds in ATLAS
F Berghaus et al 2018, 18th International Workshop on Advanced Computing and Analysis Techniques in Physics Research (ACAT 2017). J. Phys.: Conf. Ser. 1085 032027. https://doi.org/10.1088/1742-6596/1085/3/032027
Consolidation of Cloud Computing in ATLAS
CHEP 2016 (San Fransisco) J Physics Conf Ser 898
Context-aware distributed cloud computing using CloudScheduler
CHEP 2016 (San Fransisco) J Physics Conf Ser 898
Enabling Research Network Connectivity to Clouds with Virtual Router Technology
CHEP 2016 (San Fransisco) J Physics Conf Ser 898
Context-aware cloud computing for HEP
ISGC 2016 (Taipei) Proc Science 033
Utilizing clouds for Belle II
CHEP 2015 (Okinawa) J Physics Conf Ser 664
The Evolution of Cloud Computing in ATLAS
CHEP 2015 (Okinawa) J Physics Conf Ser 664
Distributed cloud computing in High Energy Physics
ACM SIGCOMM Distributed cloud computing workshop 2014 (Chicago)
HEP Computing in a Context-Aware Cloud Environment
ACM 2014 workshop on Scientific cloud computing (Vancouver)
Dynamic web cache publishing for IaaS clouds using Shoal
CHEP 2013 (Amsterdam) J Physics Conf Ser 513
ATLAS Cloud R&D
CHEP 2013 (Amsterdam) J Physics Conf Ser 513
HTC Scientific Computing in a Distributed Cloud Environment
ACM 2013 workshop on Scientific cloud computing (Chicago)
Efficient LHC Data Distribution across 100Gbps Networks
IEEE Computer Society - SuperComputing 2012
Disk-to-Disk network transfers at 100 Gb/s
CHEP 2012 (New York) J Physics Conf Ser 396
Exploiting Virtualization and Cloud Computing in ATLAS
CHEP 2012 (New York) J Physics Conf Ser 396
Data Intensive High Energy Physics Analysis in a Distributed Cloud
HPCS 2011 (Montreal) J Physics: Conf Ser 341
Repoman: A Simple RESTful X.509 Virtual Machine Image Repository
ISGC 2011 (Taipei) Proc Science 052
Simulation and user analysis of BaBar data in a distributed cloud
ISGC 2011 (Taipei) Proc Science 052
A batch system for HEP applications on a distributed IaaS cloud
CHEP 2010 (Taipei) J Physics Conf Ser 311
Research computing in a distributed compute cloud
HPCS 2010 (Toronto) J Physics: Conf Ser 256
HEP Specific Benchmarks of Virtual Machines on multi-core CPU Architectures
CHEP 2010 (Prague) J Physics Conf Ser 219
dCache with tape storage for High Energy Physics applications
CHEP 2010 (Prague) J Physics Conf Ser 219
Deploying HEP Applications Using Xen and Globus Virtual Workspaces
CHEP 2007 (Victoria) J Physics Conf Ser 119
BaBar MC Production on the Canadian Grid using a Web Services Approach
CHEP 2007 (Victoria) J Physics Conf Ser 119
The GridX1 Computational Grid: from a set of service-specific protocols to a service oriented approach
HPCS 2007 (Regina) IEEE

Stories and videosBack to Top

Videos

Using Microsoft Azure cloud for High Energy Physics
UVic using Azure (2017)
Glnt VM Image Repository
C.Leavett-Brown, OpenStack Summit Paris 2014
OpenStack User Stories
R.Sobie 2014
Clouds in High Energy Physics
R.Sobie Keynote Presentation, OpenStack Summit Portland 2013
SC12 HEP data disk-to-disk
SuperComputing 2012 Conference video
High Energy Physics Data at 100 Gb/s
SuperComputing 2011 Conference video
The BaBar Detector at SLAC
H.Leavett-Brown animation of BaBar experiment 2010

Articles

NDRIO 2020-2021 Annual Report Researcher Profiles
NDRIO’s Researcher Council Elects New Chair, Dr. Randall Sobie NDRIO News March 2021
CFI Award for the Belle II Raw Data Centre UVIC News March 2021
Canada’s New Digital Research Infrastructure Organization Names Inaugural Researcher Council NDRIO 2020
A data system for the world’s largest physics experiment UVic Ring 2016 and BC Technology 2016
The Fast Path to International Research Collaboration, Brocade 2015
HEP Data-Intensive Distributed Cloud Computing System CANARIE 2015
SanDisk Helps Accelerate HEP Research for the Origin of the Universe SanDisk Media release 2014
Canadian physicists achieve 100G transatlantic transmission CANARIE 2014
CANARIE invests in 9 innovative software projects CANARIE 2014
Team demonstrates intercontinental OpenFlow network at Super Computing (BCNET 2013)
Enterprises launch their own private clouds CNN Money 2013
Physicists link OpenStack, Nimbus clouds around the world to share resources IT World 2013
Moving at the speed of data UVIC Internal 2013)
High-Energy Physicists Smash Records for Network Data Transfer 2012 Caltech News
Particle physicists use fast network to find the Higgs boson CANARIE 2012
Data goes faster than ever CERN 2012
High-Energy Physicists Set Record for Network Data Transfer BBC and NPR and Ciena
Preserving research data to enable long-term investigation and discovery, CANARIE 2011
Canada Explores New Frontiers in Astroinformatics, HPC in the Cloud 2011
UVic research data transfer = 132 million books, UVIC Ring December 2010
Cloud computing at UVIC, CANARIE 2010
UVIC establishes compute cloud for particle physics, UVIC Vice-President Research Newsletter
Preserving the Data Harvest, Symmetry Magazine, December 2009
Researchers Collaborate to Sustain Canada’s Forests, BCNET 2009
$1.55 Million Funds Data Preservation, UVIC Media Release 2009
CANARIE Invests Millions More in Cutting-edge Canadian Research, CANARIE 2009
Technology Brings Scientists Together Oak Bay and Sannich News 2008
WestGrid linked to Nobel Prize in Physics, WestGrid News, 2008
BCNET Faculty Recognition Award, BCNET 2008
Building a high-speed network for High Energy Physics, UVic 2008
CANARIE Announces Network Enabled Platform (NEP) Projects, CANARIE 2008
BCs Big Science Projects get on Board to Use New Supercharged ROADM Network, BCNET 2007
ATLAS: Huge Data Needs Huge Bandwidth, BCNET 2007
The Power of Grid Computing, UVic 2006
Canadian grid computing project finds place in ATLAS, ITBusiness 2005
Creating the World’s Largest Computer Grid BCNET 2005
GridX1 project joins LHC Computing Grid, CERN Courier 2005
Grid project probes our origins, IT World Canada 2005
UVic Helps Form World’s Largest International Computer Grid, Grid Today article 2005
Dan Vanderster : UVic graduate student wins BCNet coolest application contest BCNET 2004
Dan Vanderster : IEEE Gold Medal in Computer Engineering UVIC 2003
Girding for the Grid, UVIC 2003

PresentationsBack to Top

2024

Scitags: An Initiative to Improve R&E Networking Visibility
T.Sullivan BCNET Connect Conference, April 2024

Data Preservation and Open Data at the B-Factories
M.Ebert SLAC FlavorSymposium April 2024

2023

The BaBar Long Term Data Analysis facility
M.Ebert HEPIX 2023 Workshop, Victoria, October 2023

Managing remote cloud resources for multiple HEP VO’s with cloudscheduler
M.Ebert CHEP 2023 Conference, Norfolk, May 2023

BaBar’s Experience with the Preservation of Data and Analysis Capabilities
M.Ebert CHEP 2023 Conference, Norfolk, May 2023

HEPscore: a new benchmark for WLCG compute resources
R.Sobie CHEP 2023 Conference, Norfolk, May 2023

Identifying and Understanding Scientific Network Flows
CHEP 2023 Conference, Norfolk, May 2023

Cloud based Tier 2 Computing at the University of Melbourne
D.Dossett, M.Sevior, M.Ebert, Asian Forum for Accelerators and Detectors Melbourne April 2023

Creating a Grid Storage Element Using S3-compatible Object Storage and Dynamic Federation at the University of Melbourne
CHEP 2023 Conference, Norfolk, May 2023

HEPscore: a new benchmark for the WLCG
R.Sobie, HEPiX Workshop, Taipei March 2023

Cloudscheduler V.2 from an HTCondor admin's point of view
M.Ebert, HEPiX Workshop, Taipei M arch 2023

Job Accounting for HTCondor with Heterogeneous Systems
M.Ebert, HEPiX Workshop, Taipei M arch 2023

2022

HEPScore – a new CPU benchmark for the WLCG
R.Sobie , WLCG Workshop Lancaster 2022

Preservation of Data and Analysis Capability at BaBar
M.Ebert, Belle II Data Preservation Workshop Oct 7 2022

Meeting the digital infrastructure needs of the Canadian Research Community
R.Sobie and N.Ladak, BCNET 2022

2021

Shoal a squid cache publishing and advertising tool
M.Ebert, HEPiX 2021

2020

Belle II Benchmarks
T.Sullivan, HEPiX Benchmarking Working Group, Nov 2020
Update on the Digital Research Infrastructure in Canada
R.Sobie, IPP AGM 2020

2019

Kubernetes as an ATLAS computing site
D.MacDonell, Pre-GDB meeting on containers, CERN, December 2019
ATLAS Sim@P1 upgrades during long shutdown two
F.Berghaus, CHEP 2019, Adelaide, ATL-COM-SOFT-2019-086
Using Kubernetes as an ATLAS Computing Site
CHEP 2019, Adelaide, ATL-SOFT-SLIDE-2019-782
Cloudscheduler V2, distributed cloud computing
R.Sobie CHEP 2019, Adelaide
The Dynafed data federator as grid site storage element
F.Berghaus et al, CHEP 2019, Adelaide
Analysing perfSonar data with Elasticsearch
R.Seuster, HEPiX 2019, Amsterdam
Using Dynafed with clouds for ATLAS and Belle II
F.Berghaus Pre-GDB Workshop on Dynafed July 2019 CERN
Digital Research Infrastructure in Canada
R.Sobie IPP AGM 2019
Cloudscheduler V2
F.Berghaus Cernvm Workshop CERN
Container clusters for particle physics applications
D.MacDonell Matrix Institute Workshop Victoria
Network Technology Watch Update
Seuster and Martelli, HSF-WLCG Workshop, Norfold 2019
Using the Dynafed dynamic federator as a Rucio Storage Element
F.Berghaus Rucio Workshop Oslo
Update of the Canadian T1 and T2 Facilities
R.Seuster, HEPiX San Diego 2019
Cloudscheduler Version 2
R.Seuster, HEPiX San Diego 2019
Using Dynafed data federation as a site Storage Element
M.Ebert, HEPiX San Diego 2019

2018

Cloud Usage for Workloads in High Energy Physics
M.Ebert, ComputeCanada Cloud External Relationship Development Meeting
Cloud Usage for Workloads in High Energy Physics: Utilizing Distributed Clouds for Compute and Storage
M.Ebert, Openstack Summit, Vancouver 2018
Using a dynamic data federation for running Belle-II simulation applications in a distributed cloud environment
M.Ebert, CHEP 2018 Sofia
Integrating a dynamic data federation into the ATLAS distributed data management system
F.Berghaus, CHEP 2018 Sofia
Quasi-online accounting and monitoring system for distributed clouds
R.Seuster, CHEP 2018 Sofia
Sim@P1: Using Cloudscheduler for offline processing on the ATLAS HLT farm
F.Berghaus, CHEP 2018 Sofia

2017

Running HEP workloads in distributed clouds
R.Seuster, HEPiX KEK 2017
Cloud storage with the Dynafed data federation
M.Ebert, HEPiX KEK 2017
Federating distributed storage for clouds in ATLAS
F.Berghaus ACAT Seattle 2017
Exploiting clouds and data federations for HEP
R.Sobie HPCS Kingston 2017
Networks in Canadian HEP
R.Sobie IPP AGM Kingston 2017

2016

Clouds in HEP
R.Sobie Plenary talk CHEP San Fransisco 2016
Context-aware distributed cloud computing using CloudScheduler
R.Seuster CHEP San Fransisco 2016
Enabling Research Network Connectivity to Clouds with Virtual Router Technology
R.Seuster Poster CHEP 2016
Consolidation of Cloud Computing in ATLAS
R.Taylor Poster CHEP San Fransisco 2016
Cloud Computing at Tier-2 Sites
R.Sobie WLCG Workshop San Fransisco 2016
Summary of Track on Middleware, Monitoring and Accounting
R.Sobie Plenary talk CHEP San Fransisco 2016
Cloud computing for HEP applications
R.Sobie, HPCS Edmonton 2016
Context-aware cloud computing for HEP
R.Sobie, ISGC Taipei 2016

2015

Federating clouds for HEP
I.Gable, OpenStack Summit, Vancouver 2015
The evolution of cloud computing in ATLAS
R.Taylor, CHEP 2015 Okinawa
HEP production using the HTCondor/CloudScheduler architecture
I.Gable, CHEP 2015 Okinawa
Utilizing cloud computing resources for Belle-II
R.Sobie, CHEP 2015 Okinawa
Glint: VM image distribution in a multi-cloud OpenStack environment
Poster CHEP 2015 Okinawa

2014

Glint: image distribution in a multi-cloud environment
C.Leavett-Brown, OpenStack Summit, Paris 2014
HEP Computing in a Context-aware Distributed Cloud
R.Sobie, DCC Workshop, Chicago 2014
Glint Image Repository
R.Desmarais, Poster SAVI Workshop, Toronto 2014
HEP Computing in a Context-aware Distributed Cloud
R.Sobie, Science Cloud Workshop, Vancouver 2014
Big data in HEP
R.Sobie, BCNET 2014
Status of the Canadian LHCONE Network
I.Gable, LHCONE Meeting, CERN 2014

2013

HTC computing in a distributed compute cloud
R.Sobie, Science Cloud Workshop, New York 2013
Distributed IaaS Clouds and 100G Networking for HEP applications
I.Gable, HPCS 2013, Ottawa
Clouds in High Energy Physics
R.Sobie, OpenStack Summit 2013, Portland
Adding IaaS Clouds to the ATLAS Computing Grid
R.Taylor, Int Science Grid Conference Taipei 2013

2011

Data intensive HEP analysis in a distributed cloud
A.Charbonneau, HPCS Montreal 2011
Operating a distributed IaaS cloud for BaBar
I.Gable, HEPiX Conference, Darmstadt 2011
Cloud computing for research
R.Sobie, BCNET 2011
Clouds for research computing
R.Sobie, Canada-EU Internet Workshop, Waterloo 2011
Repoman: a simple RESTful X.509 Virtual Machine Image Repository
R. Impey ISGC Taipei 2011
Simulation and user analysis of BaBar data in a distributed cloud
C.Leavett-Brown ISGC Taipei 2011

2010

Research Computing in a distributed cloud environment
K.Fransham, HPCS 2010, Toronto
Sky’s the Limit
C.Leavett Brown, BCNET 2010
An Adaptive Batch Environment for Clouds
I.Gable, HEPiX Spring 2010, Lisbon
Cloud Scheduler
P.Armstrong, Globus World, Argonne National Laboratory 2010

Former PersonnelBack to Top

Former Staff

Frank Berghaus
Kevin Casteels
Micheal Paterson
Ian Gable
Ron Desmarais
Chris Tooley
Ashok Agarwal
Kyle Fransham
Marcus Lee
Catherine Meng
Rolf Seuster
Matt Vliet
Duncan Penfold-Brown
Daniel Vanderster

Former coop students

Alyssa Blair (Fall 2203)
Cindy Ng (Fall 2022)
Victor Kamel (Fall 2021 and Summer 2022)
Kathryn Dolby (Summer 2021)
Garet Robertson (Winter 2020)
Matthew Ens (Fall 2019)
Shaelyn Tolkamp (Winter 2019)
Tayha Weiss-Gibbons (Fall 2017 and Winter 2018)
Jodie Weldon (Winter 2017 and Fall 2018)
Trevor Lee (Fall 2016)
Darryl Ring (Winter 2016)
Matthew Murray (Summer 2015)
Martin Conklin (Winter and Summer 2015)
Colson Driemel (Summer 2014 and Winter 2015)
Alex Lam (Winter 2014)
Robert Prior (Fall 2013)
Michael Chester (Winter 2013)
Pranav Shrestha (Winter 2012)
Andrey Polyakov (Fall 2011)
Tubego Phamphang (Fall 2011)
Robert Rusnak (Summer 2011)
Tony Bashi (Winter 2011)
Brennan McKinney (Winter 2011)
Drew Harris (Fall 2010)
Michael Anderson (Fall 2010)
Holly Leavett-Brown (2010-2012)
Matt Vliet (Winter 2009 and Summer 2010)
Adam Bishop (Summer 2009 and Winter 2010)
Michael Paterson (Summer and Fall 2008, Fall 2009, Winter 2010)
Vikram Sandhu (Fall 2009)
Chris Usher (Winter 2006, Summer 2009)
Cole Uhlmanm (Summer and Fall 2008)
David Bartle (Winter 2008)
David Grundy (Winter 2008)
Sean Manning (Winter 2008)
David Gong (Fall 2007)
Sydney Schaffer (Summer 2007)
Cameron Sobie (Summer 2007)
Tristan Sullivan (Winter 2007)
Duncan Penfold-Brown (Winter 2007)
Sergey Popov (Fall 2006)
Simon Ramage (Summer 2006)
Patrick Armstrong (Summer 2006)
Avery Berman (Winter 2006)
Angela Norton (Fall 2005, Fall 2006)
Ron Desmarais (Summer 2005)
Marco Yuen (Winter 2005)
Quinn Matthews (Fall 2004)
Clayton Lindsay (Summer 2004)
Alexandro Dimopoulos (Winter 2004)
Lila Klektau (Fall 2003, Summer 2004)
Manjinder Benning (Winter 2003)
Jenny Allan (Winter 2003)
Dan Vandrster (Fall 2002)
Ian Zwiers (Summer 2002)
Graeme Smetcher (Winter 2002)

University of Victoria
Randall Sobie	IPP Research Scientist (Group Leader)
Colson Driemel	Cloud Developer
Marcus Ebert	Computational physicist
Colin Leavett-Brown	Cloud Developer
Tristan Sullivan	HEPNET/Canada

Monitoring and Anomaly Detection for Cloud Computing Infrastructure	V. Kamel (2021)
Continuous Integration System for the Cloudscheduler VM Provisioning Service	V. Kamel (2022)
The Transition from MaxMind to MySQL Database for HEPRC’s Shoal Project	K. Dolby (2021)
Testing frameworks for the Cloudscheduler Web interface	E. Klassen (2021)
Creating unit tests for the Cloudscheduler interface	G. Robertson (2020)
Containerization of Cloudscheduler VM Provisioning Service	M. Ens (2019)
Cloud Management: Time Series Data Visualization and Development	S. Tolkamp (2019)
Continuous integration for a cloud management system	T. Weiss-Gibbons (2018)
Containerized cloud scheduling environment	T. Weiss-Gibbons (2017)
Web Application for Visualizing Benchmarks and Resource Accounting	J. Weldon (2017)
Dynamic Monitoring and Alerting for High Throughput Computing Clouds	D. Ring (2016)
Benchmarking the Performance of IaaS Clouds for HEP Applications	M. Murray (2015)
Dynamic Squid Web Cache Monitoring	R. Prior (2013)
Shoal: IaaS Cloud Cache Publisher	M. Chester (2013)
Hadoop Distributed File System Propagation Adapter for Nimbus	M. Vliet (2010)
Dynamic Resource Distribution Across Clouds	M. Paterson (2010)
Cloud Aggregator: Improving the Nimbus Monitoring System	A. Bishop (2010)
Evaluation of Nagios for Real-time Cloud Virtual Machine Monitoring	M. Paterson (2009)
The CERN Virtual Machine and Cloud Computing	V. Sandhu (2009)
Creating and Controling KVM guest using libvirt	M.Vilet (2009)
The Differences in Globus 4.2	C. Uhlman (2008)
Monitoring Grid Virtual Machine deployments	M. Paterson (2008)
Condor Web Services Submission of Jobs to a Computational Grid	S. Manning (2008)
Globus Workspaces and LRMS using the Workspace Pilot	D. Bartle (2007)
Xen-based Grid Computing Cluster and Condor SOAP Client	S. Gong (2007)
Developing a Monitoring Database for a Computing Grid	S. Schaffer (2007)
Running BaBar Applications with a Web-Services Based Grid	T. Sullivan (2007)
AutoXen: Automating Virtual Machine Deployment Within the Grid	A. Norton (2006)
Deploying a J2EE Application Using Java WebStart	S. Popov (2006)
Building a Scheduler Adapter for the GridWay Metascheduler	P. Armstrong (2006)
Greater Demands on Computational Grids	S. Ramage (2006)
Monitoring Grid X1	C. Usher (2006)
Evaluation of Virtual Machines for HEP Grids	A. Norton (2005)
Grid Monitoring	M. Yuen (2005)
The GridX1 Monitoring Framework	A. Matthews (2004)
Preparing the Grid for Scientific Applications	C. Lindsay (2004)
Extending Grid Computing in Canada: Federating Grid Canada and LCG	A. Dimopoulos (2004)
Running ATLAS Experiment Simulations on a Grid Environment	L. Klektau (2003)
Optimization of Job Assignment on a Computational Grid	D. Vanderster (2003)
Running ATLAS On The Grid Canada Testbed	M. Benning (2003)
Running ATLAS Experiment Simulations on a Grid Environment	J. Allan (2003)
Grid Computing using Particle Physics Applications	D. Vanderster (2002)
Building the UVic Grid Testbed	G. Smecher (2002)

HEP Research Computing

PersonnelBack to Top

University of Victoria