- ripe-atlas - mailman.ripe.net

New on RIPE Labs: Time Travel with RIPE Atlas
by Vesna Manojlovic 25 Sep '15

25 Sep '15

Dear colleagues, Please find another new RIPE Atlas related article on RIPE Labs: RIPE Atlas users can now use a new feature on the maps to travel back in time: https://labs.ripe.net/Members/suzanne_taylor_muzzin/ripe-atlas-time-travel-… Kind regards, Vesna

1 0

Latest three RIPE Labs articles about RIPE Atlas
by Vesna Manojlovic 24 Sep '15

24 Sep '15

Dear colleagues, there have been many new articles published on RIPE Labs: about RIPE Atlas features, using RIPE Atlas data for analysis, etc. Please find the info about the latest three in this email, and many more here: https://labs.ripe.net/atlas Regards, Vesna Looking at France-IX with RIPE Atlas and RIS, by Emile Aben Sep 24, 2015 10:09 AM This article describes our recent collaborations with France-IX on collecting data plane and control plane Internet data with RIPE Atlas and the RIPE NCC's Routing Information Service (RIS): https://labs.ripe.net/Members/emileaben/looking-at-france-ix-with-ripe-atla… New RIPE Atlas Tool: LatencyMON, by Massimo Candela Sep 23, 2015 10:10 AM LatencyMON is a new RIPE Atlas web application that you can use to easily visualise and compare multiple latency trends collected by groups of RIPE Atlas probes. https://labs.ripe.net/Members/massimo_candela/new-ripe-atlas-tool-latencymon Checking your Internet Connectivity with RIPE Atlas Anchors, by Stéphane Bortzmeyer Sep 14, 2015 05:05 PM If you monitor your external Internet connectivity, you may wonder which machine is the best to ping. Hesitate no more - you can use RIPE Atlas anchors as landmarks. https://labs.ripe.net/Members/stephane_bortzmeyer/checking-your-internet-co…

1 0

NIX.CZ (Czech Republic) has joined RIPE Atlas anchors
by Michela Galante 24 Sep '15

24 Sep '15

Dear RIPE Atlas users, We're happy to announce that another RIPE Atlas anchor has joined the network and is now available as a target for probe hosts conducting their own user-defined measurements. The new anchor is called cz-prg-as6881 and it is hosted by NIX.CZ in Prague, Czech Republic. Anchoring measurements (ping, ping6, traceroute and traceroute6) are scheduled towards this anchor from all the other anchors as well as several hundred probes, providing a continual overview of regional reachability. Results of these measurements are available as raw data in JSON format, and visualised on the map and "seismograph" with many configurable features. You can access the anchoring measurements for all anchors at: https://atlas.ripe.net/anchors/list/ Learn more about RIPE Atlas anchors at: https://atlas.ripe.net/about/anchors/ Thank you for participating in RIPE Atlas! Kind Regards, RIPE Atlas Team atlas(a)ripe.net

1 0

Downloading ad-hoc Atlas measurements as JSON
by Jonathan Brewer 24 Sep '15

24 Sep '15

Hi All, One of my current frustrations is that when downloading ad-hoc Atlas measurements, the file name is always the same: "RIPE-Atlas-measurement.json". This is unfortunate. It would be great if the web server would by default call this measurement by its ID. Anyone else experiencing this problem? Regards, Jon

5 6

Maintenance works today
by Robert Kisteleki 24 Sep '15

24 Sep '15

Dear All, We'll carry out maintenance work on the core RIPE Atlas infrastructure today, approximately between 10-11h Amsterdam time (8-9 UTC). This will also affect the API/UI, most likely resulting in failed API calls or web page loads. Excuses for the inconvenience. Regards, Robert Kisteleki

1 0

RIPE Atlas Tools and Python versions
by Daniel Quinn 24 Sep '15

24 Sep '15

As some of you may already know, we’ve been working on a new command-line toolkit that will let you do nifty things like: * List measurement and probe metadata * Generate reports from measurement results * Stream measurement results It’s coming along quite nicely, but I’m running into just too many cases where support for Python 2.6 is (a) making my job harder, and (b) making my code uglier. Given that (a) means I spend more time fixing compatibility rather than adding features and (b) just makes me sad, I wanted to ask the community how important Python 2.6 is to you. So here’s the question: Of those of you who would find such a tool interesting/useful, how many of you *only* have access to a computer running Python 2.6? Such systems include CentOS distributions earlier than 7, and corresponding RedHat Enterprise systems. If you’re using Debian, or Ubuntu, you should already have 2.7 by default, and if you’re on Gentoo or Arch, you probably have both 2.7 and 3.5 already. I understand that Apple’s OSX is running 2.7 these days as well. If I don’t get a wave of messages about how very important 2.6 is to your collective health and wellbeing, I’m going to consider this a non-issue and drop support for 2.6. Thanks for your input everyone :-)

5 5

Friday's events on RIPE Atlas
by Romeo Zwart 23 Sep '15

23 Sep '15

Dear all, Here is a description of the events that took place last Friday and some 'lessons learned' that we took away from it. The high level summary of events is that an Atlas user was authorised to create an extreme number of measurements involving a large number of probes. This effectively overloaded the back-end machinery in various different ways. Even though this event could only happen because of the exception in resource use limits, we have implemented workarounds and countermeasures to avoid a repetition in future, and we will be investigating some of the more fundamental issues in the coming period. More information is available below for those interested. Observations: - Problems started shortly before 11am when one of the Atlas users created a large number of new measurements each involving all available probes. The user had been given an exceptional amount of credits as part of a special experiment. Therefore the normal limitations on the impact any individual user can have on the system were not active when the measurements were created and activated. - The results of the newly created measurements put a lot of strain on the measurement scheduler, which triggered our interest. After some investigation the cause of the overload was identified and the related measurements were ended. - However, by this time the majority of results, up to that moment, had already reached our queuing servers and the consumers were already ingesting the results into our Hadoop storage platform. - At this phase we discovered a capacity problem with the process that consumes the Atlas results, so we doubled the capacity of that component on the fly. - This exposed the next bottleneck in our platform in the form of an accumulation of the created results on a very small number of processing nodes. Normally the incoming measurement results are distributed over several storage nodes, so this strongly reduced the consumption rate of new data. - A third factor that contributed was the fact that, in attempt to curb growth of the Atlas data, we have migrated the Atlas data sets to a more efficient compression algorithm earlier in the year. This saved us some 40-50% of storage space for the Atlas data, at the expense of some compute power. Under normal circumstances, even at high loads, this compute power is abundantly available on the storage cluster. Under the specific circumstances of last Friday's events, it turned out that the change of the compression algorithm had increased processing time for some Hadoop system tasks by up to a factor of 8, which had a direct impact on the data consumption speed. Immediate actions taken: - Removed special privileges of the end-user in question - Added capacity to the Atlas consumer processes - Returned (temporarily) to less efficient compression on the Atlas data sets. Lessons learned and further planned action: - Granting special privileges for some of the Atlas users needs (even) more attention than it already receives. - We need to better communicate "best practices" to these power users so they can use their extra allowances responsibly. - Improved compression of Atlas data has decreased our storage demands but also decreased our processing capacity. This needs further investigation to find the optimum configuration. - Investigate possibilities to better spread incoming results over more worker nodes (reduce hotspots). - Investigate and quantify reasonable boundaries of scalability of the whole system, to guide the limits for granting credits to end users. Kind regards, Romeo Zwart

10 15

Booking.com IT Services, Singapore has joined RIPE Atlas anchors
by Valentino Dijkstra 22 Sep '15

22 Sep '15

Dear RIPE Atlas users, We're happy to announce that another RIPE Atlas anchor has joined the network and is now available as a target for probe hosts conducting their own user-defined measurements. The new anchor is called sg-sin-as43996 and is hosted by Booking.com <http://booking.com/> IT Services, Singapore. Anchoring measurements (ping, ping6, traceroute and traceroute6) are scheduled towards this anchor from all the other anchors as well as several hundred probes, providing a continual overview of regional reachability. Results of these measurements are available as raw data in JSON format, and visualised on the map and "seismograph" with many configurable features. You can access the anchoring measurements for all anchors at: https://atlas.ripe.net/anchors/list/ <https://atlas.ripe.net/anchors/list/> Learn more about RIPE Atlas anchors at: https://atlas.ripe.net/about/anchors/ <https://atlas.ripe.net/about/anchors/> Thank you for participating in RIPE Atlas! Kind regards, RIPE Atlas Team RIPE NCC atlas(a)ripe.net <mailto:atlas@ripe.net>

1 0

Booking.com IT Services, Singapore, as joined RIPE Atlas anchors
by Valentino Dijkstra 22 Sep '15

22 Sep '15

Dear RIPE Atlas users, We're happy to announce that another RIPE Atlas anchor has joined the network and is now available as a target for probe hosts conducting their own user-defined measurements. The new anchor is called nz-lyj-as17746 and is hosted by Booking.com IT Services, Singapore. Anchoring measurements (ping, ping6, traceroute and traceroute6) are scheduled towards this anchor from all the other anchors as well as several hundred probes, providing a continual overview of regional reachability. Results of these measurements are available as raw data in JSON format, and visualised on the map and "seismograph" with many configurable features. You can access the anchoring measurements for all anchors at: https://atlas.ripe.net/anchors/list/ <https://atlas.ripe.net/anchors/list/> Learn more about RIPE Atlas anchors at: https://atlas.ripe.net/about/anchors/ <https://atlas.ripe.net/about/anchors/> Thank you for participating in RIPE Atlas! Kind regards, RIPE Atlas Team RIPE NCC atlas(a)ripe.net <mailto:atlas@ripe.net>

1 0

[rfc-editor@rfc-editor.org: [lmap] RFC 7594 on A Framework for Large-Scale Measurement of Broadband Performance (LMAP)]
by Stephane Bortzmeyer 21 Sep '15

21 Sep '15

We just need "millions" of Atlas to implement this vision :-)

1 0

Data delays on RIPE Atlas
by Robert Kisteleki 19 Sep '15

19 Sep '15

Dear all, The data backend behind RIPE Atlas is experiencing some issues at the moment. This causes delays in processing and serving the data, meaning all results are delivered late. We're working on a fix. Excuses for the inconvenience. Regards, Robert

3 4

Strange 500 submission error
by Stephane Bortzmeyer 18 Sep '15

18 Sep '15

Atlas' API sends me back HTML pages :-) RIPEAtlas.RequestSubmissionError: Status 500, reason "<!DOCTYPE html> <html> <head> <meta charset="UTF-8" /> <meta http-equiv="X-UA-Compatible" content="IE=edge" /> <meta content="RIPE Atlas, RIPE, Atlas" name="description" /> <link rel="stylesheet" type="text/css" media="screen" href="https://www-static.ripe.net/static/common/fonts/open-sans.css" /> <link rel="stylesheet" type="text/css" media="print" href="https://www.ripe.net/portal_css/Ripe/print.css" /> <link href="https://www.ripe.net/++resource++collective.js.prettify.stylesheets/prettif…" media="screen" type="text/css" rel="stylesheet" /> <link rel="stylesheet" type="text/css" media="screen" href="https://www.ripe.net/portal_css/Ripe/++resource++ripe.plonetheme.stylesheet…" /> <link rel="stylesheet" type="text/css" media="screen" href="https://www.ripe.net/portal_css/Ripe/++resource++ripe.plonetheme.stylesheet…" /> <link rel="stylesheet" type="text/css" media="screen" href="https://www.ripe.net/portal_css/Ripe/++resource++ripe.plonetheme.stylesheet…" />  <title> - RIPE Atlas — RIPE Network Coordination Centre</title> <link rel="shortcut icon" type="image/x-icon" href="https://www.ripe.net/favicon.ico" /> <link rel="apple-touch-icon" href="https://www.ripe.net/touch_icon.png" /> <link rel="search" href="https://www.ripe.net/search" title="Search this site" /> ...

5 7

Ripe-Atlas 500 Internal Server Error ?
by Max Mühlbronner 17 Sep '15

17 Sep '15

Hi, Atlas is not working right now. (500 Internal Server Eror) Same from different locations/networks. But i guess you already noticed? Best Regards -- Max Mühlbronner 42com Telecommunication GmbH Straße der Pariser Kommune 12-16 10243 Berlin E-Mail: mm(a)42com.com Web: www.42com.com Firmenangaben/Company information: Handelsregister/Commercial register: Amtsgericht Berlin HRB 99071 B Umsatzsteuer-ID/VAT-ID: DE223812306 Geschäftsführer/CEO: Thomas Reinig, Alexander Reinig Diese E-Mail enthält Informationen von 42com Telecommunication GmbH. Diese sind möglicherweise vertraulich und ausschließlich für den Adressaten bestimmt. Sollten Sie diese elektronische Nachricht irrtümlicherweise erhalten haben, so informieren Sie uns bitte unverzüglich telefonisch oder per E-Mail. This message is intended only for the use of the individual or entity to which it is addressed. If you have received this message by mistake, please notify us immediately.

2 1

Join our new webinar on "Advanced RIPE Atlas Usage"
by Vesna Manojlovic 17 Sep '15

17 Sep '15

Dear colleagues, We are pleased to announce our new webinar: Advanced RIPE Atlas Usage, aiming to teach LIRs how to use RIPE Atlas measurements for network monitoring and troubleshooting. https://www.ripe.net/support/training/learn-online/webinars/advanced-ripe-a… It's part of the series of interactive on-line learning sessions, that give you the opportunity to learn and interact with trainers without leaving your desk, as well as for hands-on practice, and to get your questions answered by developers. Learn how to: - Use RIPE Atlas measurements for network monitoring and troubleshooting - Use API calls for measurement creation - Integrate RIPE Atlas with existing monitoring systems There are three dates scheduled: 2nd July, 27th August & 17th September. Webinars start at 11:30 UTC, and take about one hour. Register now at: https://www.ripe.net/support/training/learn-online/webinars We look forward to seeing you online. Kind regards, Vesna Manojlovic RIPE NCC

4 6

TELUS in Montreal, Canada has joined RIPE Atlas anchors
by Valentino Dijkstra 16 Sep '15

16 Sep '15

Dear RIPE Atlas users, We're happy to announce that another RIPE Atlas anchor has joined the network and is now available as a target for probe hosts conducting their own user-defined measurements. The new anchor is called ca-mtr-as852 and is hosted by TELUS in Montreal, Canada. Anchoring measurements (ping, ping6, traceroute and traceroute6) are scheduled towards this anchor from all the other anchors as well as several hundred probes, providing a continual overview of regional reachability. Results of these measurements are available as raw data in JSON format, and visualised on the map and "seismograph" with many configurable features. You can access the anchoring measurements for all anchors at: https://atlas.ripe.net/anchors/list/ <https://atlas.ripe.net/anchors/list/> Learn more about RIPE Atlas anchors at: https://atlas.ripe.net/about/anchors/ <https://atlas.ripe.net/about/anchors/> Thank you for participating in RIPE Atlas! Kind regards, RIPE Atlas Team RIPE NCC atlas(a)ripe.net <mailto:atlas@ripe.net>

1 0

Question about "location setting" of RIPE Atlas
by Anurag Bhatia 15 Sep '15

15 Sep '15

I have been hosting one of RIPE probes and recently I have switched over my ISP. Basically my previous ISP provider was regular ISP network with full L3 PoPs nearby but in my new setup I have got a point to point to a city 900km away and getting IP transit over there. Now under such case, I am "technically" customer of that network. Should I still keep my location as I have current one or better update it to that new location 900km away? The latency of course is low (as it is provisioned on fiber and hence just 20ms roundtrip) but I think it will confuse off stats if anyone considers to use this probe for any data in my region. What you all think? Can someone recommend on correct location? Thanks. -- Anurag Bhatia anuragbhatia.com PGP Key Fingerprint: 3115 677D 2E94 B696 651B 870C C06D D524 245E 58E2

3 3

Leaseweb Network B.V. in Haarlem, The Netherlands has joined Atlas anchors
by Eamonn Lane 11 Sep '15

11 Sep '15

Dear RIPE Atlas users, We're happy to announce that another RIPE Atlas anchor has joined the network and is now available as a target for probe hosts conducting their own user-defined measurements. The new anchor is called nl-haa-as60781 and is hosted by Leaseweb Network B.V. in Haarlem, The Netherlands. Anchoring measurements (ping, ping6, traceroute and traceroute6) are scheduled towards this anchor from all the other anchors as well as several hundred probes, providing a continual overview of regional reachability. Results of these measurements are available as raw data in JSON format, and visualised on the map and "seismograph" with many configurable features. You can access the anchoring measurements for all anchors at: https://atlas.ripe.net/anchors/list/ <https://atlas.ripe.net/anchors/list/> Learn more about RIPE Atlas anchors at: https://atlas.ripe.net/about/anchors/ <https://atlas.ripe.net/about/anchors/> Thank you for participating in RIPE Atlas! Kind regards, RIPE Atlas Team RIPE NCC atlas(a)ripe.ne <mailto:atlas@ripe.ne>

1 0

us-mia-as33280, Afilias Miami has joined RIPE Atlas anchors
by Eamonn Lane 11 Sep '15

11 Sep '15

Dear RIPE Atlas users, We're happy to announce that another RIPE Atlas anchor has joined the network and is now available as a target for probe hosts conducting their own user-defined measurements. The new anchor is called us-mia-as33280 and is hosted by Afilias in Miami , USA. Anchoring measurements (ping, ping6, traceroute and traceroute6) are scheduled towards this anchor from all the other anchors as well as several hundred probes, providing a continual overview of regional reachability. Results of these measurements are available as raw data in JSON format, and visualised on the map and "seismograph" with many configurable features. You can access the anchoring measurements for all anchors at: https://atlas.ripe.net/anchors/list/ <https://atlas.ripe.net/anchors/list/> Learn more about RIPE Atlas anchors at: https://atlas.ripe.net/about/anchors/ <https://atlas.ripe.net/about/anchors/> Thank you for participating in RIPE Atlas! Kind regards, RIPE Atlas Team RIPE NCC atlas(a)ripe.net <mailto:atlas@ripe.net>

1 0

Probe management sharing - LIR
by Abreu, Alexandre, Vodafone Portugal 08 Sep '15

08 Sep '15

Hi all I've shared the management of my probes using the LIR option. It worked fine for 2 LIR users (one of them is me and I now see the probes as "mine" and "shared with me") but one other LIR user doesn't see anything unless I specify his username explicitly. What kind of users are these? Aren't these the LIR users we can add on the LIR portal? Thanks in advance. Alexandre Abreu

1 0

Booking.com (Frankfurt DE, Hong Kong and Ashbury US) have joined the RIPE Atlas Anchors
by Alastair Strachan 08 Sep '15

08 Sep '15

Dear RIPE Atlas users, We're happy to announce that three more RIPE Atlas anchors have joined the network and are now available as targets for probe hosts conducting their own user-defined measurements. The new anchors are all hosted by Booking.com: de-fra-as43996, in Frankfurt (Germany) hk-hkg-as43996 in Hong Kong (Hong Kong) us-abn-as43996 in Ashburn (US) Anchoring measurements (ping, ping6, traceroute and traceroute6) are scheduled towards these anchors from all the other anchors as well as several hundred probes, providing a continual overview of regional reachability. Results of these measurements are available as raw data in JSON format, and visualised on the map and "seismograph" with many configurable features. You can access the anchoring measurements for all anchors at: https://atlas.ripe.net/anchors/list/ <https://atlas.ripe.net/anchors/list/> Learn more about RIPE Atlas anchors at: https://atlas.ripe.net/about/anchors/ <https://atlas.ripe.net/about/anchors/> Thank you for participating in RIPE Atlas! Kind regards, RIPE Atlas Team RIPE NCC atlas(a)ripe.net <mailto:atlas@ripe.net>

1 0

Telus (CA) has joined RIPE Atlas anchors
by Lia Hestina 28 Aug '15

28 Aug '15

Dear RIPE Atlas users, We're happy to announce that another RIPE Atlas anchor has joined the network and is now available as a target for probe hosts conducting their own user-defined measurements. The new anchor is called ca-van-as852 and it is hosted by TELUS in Vancouver, Canada. Anchoring measurements (ping, ping6, traceroute and traceroute6) are scheduled towards this anchor from all the other anchors as well as several hundred probes, providing a continual overview of regional reachability. Results of these measurements are available as raw data in JSON format, and visualised on the map and "seismograph" with many configurable features. You can access the anchoring measurements for all anchors at: https://atlas.ripe.net/anchors/list/ <https://atlas.ripe.net/anchors/list/> Learn more about RIPE Atlas anchors at: https://atlas.ripe.net/about/anchors/ <https://atlas.ripe.net/about/anchors/> Thank you for participating in RIPE Atlas! Kind Regards, RIPE Atlas Team atlas(a)ripe.net <mailto:atlas@ripe.net>

1 0

Missing module
by Jacques Lav!gnotte. 26 Aug '15

26 Aug '15

Hello, I am trying to run Stephane's B. resolv-name.py and I get : import RIPEAtlas ImportError: No module named RIPEAtlas I can't figure out where to get this module. Any help ? Jacques -- GnuPg : C8F5B1E3 WeUsePGP Because privacy matters http://weusepgp.info/

3 3

X.509 certificate monitoring
by Stephane Bortzmeyer 25 Aug '15

25 Aug '15

I do not find a lot of examples of X.509 certificate retrieving and analysis? I just committed <https://github.com/RIPE-Atlas-Community/ripe-atlas-community-contrib/blob/m…> which is useful for me when watching certificate expiration for anycasted sites (where the cert retrieved depends on the probe). Any other examples? And by the way, do not hesitate to submit your scripts to <https://github.com/RIPE-Atlas-Community/ripe-atlas-community-contrib> (fork and pull request, or open an issue with the attached script).

1 0

Re: [atlas] Question about "location setting" of RIPE Atlas
by Tomáš Hetmer 23 Aug '15

23 Aug '15

Hi, I'd use the simplest logical interpretation and enter the actual physical location no matter if the actual interconnect is right there, 900 km away or transmitted from a satellite. Also, if you placed it to that location 900km away you wouldn't skew the results for your own town, but anyone measuring the latency there would see a +20ms difference from reality, so that doesn't improve anything. Many networks are large and complex, such as an ADSL for a whole country being connected to the net via a local MPLS network via a central point at one main location - should you use that one for all the probes in the country? Of course not, you enter wherever the endpoint is. If you'd like however, you can mention your specific configuration in the probe details. That's my personal view on this, others might differ. Regards Tomáš Hetmer 2015-08-22 23:42 GMT+02:00 Anurag Bhatia <me(a)anuragbhatia.com>: > I have been hosting one of RIPE probes and recently I have switched over my > ISP. > > > Basically my previous ISP provider was regular ISP network with full L3 PoPs > nearby but in my new setup I have got a point to point to a city 900km away > and getting IP transit over there. > > > Now under such case, I am "technically" customer of that network. Should I > still keep my location as I have current one or better update it to that new > location 900km away? > > > The latency of course is low (as it is provisioned on fiber and hence just > 20ms roundtrip) but I think it will confuse off stats if anyone considers to > use this probe for any data in my region. > > > What you all think? Can someone recommend on correct location? > > > > Thanks. > > -- > > > Anurag Bhatia > anuragbhatia.com > > > PGP Key Fingerprint: 3115 677D 2E94 B696 651B 870C C06D D524 245E 58E2

1 0

Afilias, Los Angeles, CA, United States has joined RIPE Atlas anchors
by Eamonn Lane 21 Aug '15

21 Aug '15

Dear RIPE Atlas users, We're happy to announce that another RIPE Atlas anchor has joined the network and is now available as a target for probe hosts conducting their own user-defined measurements. The new anchor is called us-lax-as63403 and is hosted by Los Angeles, CA, United States. Anchoring measurements (ping, ping6, traceroute and traceroute6) are scheduled towards this anchor from all the other anchors as well as several hundred probes, providing a continual overview of regional reachability. Results of these measurements are available as raw data in JSON format, and visualised on the map and "seismograph" with many configurable features. You can access the anchoring measurements for all anchors at: https://atlas.ripe.net/anchors/list/ Learn more about RIPE Atlas anchors at: https://atlas.ripe.net/about/anchors/ Thank you for participating in RIPE Atlas! Kind regards, RIPE Atlas Team RIPE NCC atlas(a)ripe.net

1 0