Call for Papers
3rd Workshop on Benchmarking Cyber-Physical Systems
and Internet of Things (CPS-IoTBench'20)
in conjunction with ACM MobiCom 2020
September 21-25, 2020 - London, UK
----------------------------------------------------------------------
Over the last decade, research on Cyber-Physical Systems (CPS) and Internet
of Things (IoT) has led to smart systems at different scales and environments,
from smart homes to smart cities and smart factories. Despite many successes,
it is difficult to measure and compare the utility of these results due to a
lack of standard evaluation criteria and methodologies. This problem inhibits
evaluation against the state-of-the-art, the comparability of different
integrated designs (e.g., control and networking), and the applicability of
tested scenarios to present and future real-world cyber-physical applications
and deployments. This state of affairs is alarming, it significantly hinders
further progress in CPS and IoT systems research.
******** TOPICS ********
The Workshop on Benchmarking Cyber-Physical Systems and Internet of Things
(CPS-IoTBench) brings together researchers from the different sub-communities
to engage in a lively debate on all facets of rigorously evaluating and
comparing cyber-physical networks and systems. Unique to this workshop, we
seek reports describing the reproduction of experimental results reported in
published papers. Examples of these include researchers looking to validate
another piece of work before comparing their own to it, or industrial
organizations evaluating a new technology or demonstrating the robustness
of their technology before customer delivery.
We invite researchers and practitioners from academia and industry to submit
papers focusing on one of the following topics:
- describe an attempt to reproduce experimental results from published work;
- identify fundamental challenges and open questions in rigorous benchmarking
and evaluation of cyber-physical networks and systems;
- report on success stories/failures with using standard evaluation criteria;
- present example benchmark systems and approaches from any relevant community
(embedded systems, networking, control, robotics, machine learning);
- propose new research directions, methodologies, or tools to increase the
level of reproducibility and comparability of evaluation results;
- report on examples of best practices in different CPS sub-communities towards
achieving the repeatability of results;
- present models to capture & compare the properties of algorithms and systems;
Well-reasoned arguments or preliminary evaluations are sufficient to support a
paper's claims.
Submitted papers must be written in English and may contain up to 6 pages,
including references, figures, and tables. We will follow a double-blind
reviewing process, therefore authors must anonymize their submissions.
References to the authors' own previous work must not be omitted but referred
to in the third person. Accepted papers will be published either on OpenReview.net
or on the ACM Digital Library.
******** IMPORTANT DATES ********
- Paper submission deadline: May 15, 2020 (11:59:59PM EST)
- Notification of acceptance: July 1, 2020
- Camera-ready versions: July 31, 2020
- Workshop date: September 21 or 25, 2020
******** ORGANIZERS ********
Workshop co-organizers:
- Carlo Alberto Boano (Graz University of Technology, Austria)
- Michael Breza (Imperial College London, United Kingdom)
- Romain Jacob (ETH Zurich, Switzerland)
- Ramona Marfievici (Digital Catapult, United Kingdom)
- Marco Zimmerling (TU Dresden, Germany)
Technical Program Committee:
- Brad Campbell (University of Virginia, USA)
- Omprakash Gnawali (University of Houston, USA)
- Matthias Hollick (TU Darmstadt, Germany)
- Roman Kolcun (Imperial College London, UK)
- Amy Murphy (Bruno Kessler Foundation, Italy)
- Pat Pannuto (University of California, San Diego, USA)
- Gian Pietro Picco (University of Trento, Italy)
- Usman Raza (Toshiba Research Europe Limited, UK)
- Vijay Rao (TU Delft, The Netherlands)
- Alexandru Uta (Leiden University, The Netherlands)
---------------------------------------------------------------------
Our sincere apologies if you receive multiple copies of the call