Call for Papers 3rd Workshop on Benchmarking Cyber-Physical Systems and Internet of Things (CPS-IoTBench'20) in conjunction with ACM MobiCom 2020 September 21-25, 2020 - London, UK https://cpsbench20.ethz.ch/ ---------------------------------------------------------------------- Over the last decade, research on Cyber-Physical Systems (CPS) and Internet of Things (IoT) has led to smart systems at different scales and environments, from smart homes to smart cities and smart factories. Despite many successes, it is difficult to measure and compare the utility of these results due to a lack of standard evaluation criteria and methodologies. This problem inhibits evaluation against the state-of-the-art, the comparability of different integrated designs (e.g., control and networking), and the applicability of tested scenarios to present and future real-world cyber-physical applications and deployments. This state of affairs is alarming, it significantly hinders further progress in CPS and IoT systems research. ******** TOPICS ******** The Workshop on Benchmarking Cyber-Physical Systems and Internet of Things (CPS-IoTBench) brings together researchers from the different sub-communities to engage in a lively debate on all facets of rigorously evaluating and comparing cyber-physical networks and systems. Unique to this workshop, we seek reports describing the reproduction of experimental results reported in published papers. Examples of these include researchers looking to validate another piece of work before comparing their own to it, or industrial organizations evaluating a new technology or demonstrating the robustness of their technology before customer delivery. We invite researchers and practitioners from academia and industry to submit papers focusing on one of the following topics: - describe an attempt to reproduce experimental results from published work; - identify fundamental challenges and open questions in rigorous benchmarking and evaluation of cyber-physical networks and systems; - report on success stories/failures with using standard evaluation criteria; - present example benchmark systems and approaches from any relevant community (embedded systems, networking, control, robotics, machine learning); - propose new research directions, methodologies, or tools to increase the level of reproducibility and comparability of evaluation results; - report on examples of best practices in different CPS sub-communities towards achieving the repeatability of results; - present models to capture & compare the properties of algorithms and systems; Well-reasoned arguments or preliminary evaluations are sufficient to support a paper's claims. Submitted papers must be written in English and may contain up to 6 pages, including references, figures, and tables. We will follow a double-blind reviewing process, therefore authors must anonymize their submissions. References to the authors' own previous work must not be omitted but referred to in the third person. Accepted papers will be published either on OpenReview.net<http://openreview.net/> or on the ACM Digital Library. ******** IMPORTANT DATES ******** - Paper submission deadline: May 15, 2020 (11:59:59PM EST) - Notification of acceptance: July 1, 2020 - Camera-ready versions: July 31, 2020 - Workshop date: September 21 or 25, 2020 ******** ORGANIZERS ******** Workshop co-organizers: - Carlo Alberto Boano (Graz University of Technology, Austria) - Michael Breza (Imperial College London, United Kingdom) - Romain Jacob (ETH Zurich, Switzerland) - Ramona Marfievici (Digital Catapult, United Kingdom) - Marco Zimmerling (TU Dresden, Germany) Technical Program Committee: - Brad Campbell (University of Virginia, USA) - Omprakash Gnawali (University of Houston, USA) - Matthias Hollick (TU Darmstadt, Germany) - Roman Kolcun (Imperial College London, UK) - Amy Murphy (Bruno Kessler Foundation, Italy) - Pat Pannuto (University of California, San Diego, USA) - Gian Pietro Picco (University of Trento, Italy) - Usman Raza (Toshiba Research Europe Limited, UK) - Vijay Rao (TU Delft, The Netherlands) - Alexandru Uta (Leiden University, The Netherlands) --------------------------------------------------------------------- Our sincere apologies if you receive multiple copies of the call