- ripe-atlas - mailman.ripe.net

Change in Probe Archive API
by Johan ter Beest 26 Sep '22

26 Sep '22

Dear probe hosts, Since 2013 we are creating a daily snapshot of the probe API which is available at https://atlas.ripe.net/api/v2/probes/archive Until today, this snapshot included some probes which had never connected. Starting with the snapshot of today (26 / 09/ 2022) we will exclude all never connected probes from the archive as they do not provide any useful information. Previous snapshots will not be altered. In addition to this change, every known probe will now have a probestatus page at https://atlas.ripe.net/probes/<probe ID>/ where previously some of these probes would generate a 404. Let us know if you have any question or comment about this change. Kind regards, Johan ter Beest RIPE Atlas Team

1 0

Riple Atlas + openwrt + docker + gns3 + debian
by Gery Escalier 07 Sep '22

07 Sep '22

Hi, I'm doing tests with OpenWrt SNAPSHOT, r20377-ca5c695a45 on docker in a gns3 lab and on debian 11. At the moment it allows me to carry out tests and later it will allow me to work with old routers and other hardware that can run openwrt. root@OpenWrt:~# /etc/init.d/atlasSyntax: /etc/init.d/atlas [command] Available commands: start Start the service stop Stop the service restart Restart the service reload Reload configuration files (or restart if service does not implement reload) enable Enable service autostart disable Disable service autostart enabled Check if service is started on boot Check if service is running status Service status trace Start with syscall trace info Dump procd service info get_key print probe public key (used for probe registration) probeid print probe id log print probe status log create_backup backup ssh key to tar.gz load_backup 'backup.tar.gz' load backup ssh key from tar.gz create_key create probe priv/pub key root@OpenWrt:~# /etc/init.d/atlas info{ "atlas": { "instances": { "instance1": { "running": true, "pid": 4707, "command": [ "/usr/libexec/atlas-probe-scripts/bin/ATLAS" ], "term_timeout": 5 I have done the configuration that the software probe account requires, I have done the configuration of the riple atlas package to generate the ssh keys and connect with my riple atlas account. I have had the probe 100% operational for several hours and generated credits, the problem I currently have is that when I turn off and start gns3 I have to install the Ripe Atlas packages from scratch in openwrt, configure it and generate the ssh keys again, update the keys in my Ripe Atlas account. At the moment I am using this option for testing, but it would be interesting if openwrt saves the data persistently, I am looking for information on what the problem may be, I am commenting on it in case someone who has used openwrt and something similar has come up. I will be updating news. Greetings. Gery

2 2

Group in Spanish Riple Atlas?
by Gery Escalier 06 Sep '22

06 Sep '22

Hello everyone, I have the doubt if there is any group in Spanish where I can participate, I have been documenting myself about Riple Atlas and I have been able to activate a software probe using openwrt, gns3 and Debian. It is always more interesting to be able to carry out tests and others participating with the community. I have seen some videos of the deployathons in which Michela G. and Agustin F. participated, that is why I was encouraged to configure the probe and understood a little better about the Riple Atlas project. I will also participate here and I will be sending emails with my queries. Thank you very much, best regards! Gery

4 6

Probe on sailboat with Starlink
by Michael Markstaller 02 Sep '22

02 Sep '22

Hi, just a question: any interest to have a probe on a sailboat with Starlink (not officially supported) Just got my probe Probe #27837 fixed again at home (usb-stick RO/dead) and now I wonder if I leave it at home or take it with me over Adriatic/Atlantic. And if yes, some API-way to update location would be nice as we're moving:-) best regards Michael Markstaller Softwareentwicklung & IT-Dienstleistungen Am Birkengarten 19b 82024 Taufkirchen Tel: +49-89-21553825, Mobile: +49-179-2080789 USt-ID: DE293191950

11 14

New on RIPE Labs: 240/4 As Seen by RIPE Atlas
by Qasim Lone 23 Aug '22

23 Aug '22

Dear colleagues, In this new article on RIPE Labs, we use data from RIPE Atlas probes to investigate the usage of 240/4, a block of IPv4 addresses 'reserved for future use' and formally known as Class E in the wild. https://labs.ripe.net/author/qasim-lone/2404-as-seen-by-ripe-atlas/ Kind regards, Qasim

1 0

Updated RIPE Atlas Documentation
by camin 22 Aug '22

22 Aug '22

Dear colleagues, A new version of the RIPE Atlas documentation has been published. We have consolidated the text in places and improved the structure to make it easier to find content. The new version can be found at: https://atlas.ripe.net/docs/ Regards, Chris Amin

5 9

Re: [atlas] My experiences with a SW probe…
by Michel Stam 07 Jul '22

07 Jul '22

Hey Ernst, Thanks for your email. Regarding the busybox implementation, there’s history here. As I understand it, the first probes were implemented on a system without a memory management unit. This created the problem that starting and restarting processes caused memory fragmentation. That lead to the system running out of memory, which is why an approach was chosen with a multi-call binary: Only one program loaded into memory, and busybox already was implemented and available on the system. Of course, since the version 3 probes (the TPLINK), there is no need anymore. There is a memory management unit taking care of this. However, the code was retained because it was already implemented. Later on, the decision was made to offer an installable software probe package for regular Linux systems, which is in essence the same code running on the hardware probes, which brings us to today. Today you find busybox even on regular Linux systems, but then typically in the initrd environment, prior to the system booting from the root filesystem. We’re currently refactoring parts of the probes to make things easier to maintain. This may mean, without guaranteeing it, that this can change in the future. Why ATLAS starts properly using /etc/init.d and not on boot, I cannot say. It can be as simple as the networking not being available or a race condition. I would suggest to touch base with the author of this code and ask? The debate whether a Windows version would be beneficial is something that we should have with a wider audience, and should cover such topics as 24/7 availability, usability and convenience for the user. I merely want to point out that the engineering effort may be significant. If other people would like to weigh in on this matter, that would be welcome. Will keep you posted. Regards, Michel > On 6 Jul 2022, at 16:18, Ernst J. Oud <ernstoud(a)gmail.com> wrote: > > Michel, > > Thanks for the concise answer. > > Good to know that my problems with the CentOS installation can be reproduced. Turns out I am not an idiot after all :-) > > In a Linux container in Docker Desktop for Windows even the standard Linux traceroute command of Ubuntu or CentOS does not work. Ping does but traceroute does not. As per my previous email, it seems that this a vpnkit bug in Docker. Not a lot that can be done, on GitHub I asked for progress on this issue, no response yet. > > On my Windows 10 PC I measure a pretty constant 940/940 speed using Ookla SpeedTest. Only when VMware was installed also on that PC in bridge mode, those measurements went haywire. Ofcourse a bridge for networking between the host and a virtual machine requires a network driver in VMware doing some trickery. That might explain why. Ofcourse this has nothing to do with the SW probe itself. > > Thanks for the input on telnetd and busybox. When I had a look at the SW probe after installation I indeed wondered what the heck was going on with a busybox binary, which in embedded Linux environments and in small Linux distributions such as Alpine, has its place. Did not understand why RIPE created a multi-call binary for the probe. And calling it busybox is even more confusing… > > Still doesn’t explain why stopping the ATLAS service and restarting it does correctly load the RIPE telnetd daemon but starting the service at boot does not. > > For me a Windows version only would mean saving disk space for VMWare and a virtual machine on that mini PC. Also I noticed that the traceroute results of the SW probe are around 1 ms. higher in the first hop, due to the probe running in a virtual machine. Both issues are not a big deal. What I meant more is that the amount of people willing to install the probe, if a Windows service would be available, would be potentially much, much larger. The Windows client community is so much larger than the Linux client community… > > Take care, > > Met vriendelijke groet / Regards, > > Ernst J. Oud > > > > Met vriendelijke groet, > > Ernst J. Oud >> On 6 Jul 2022, at 14:07, Michel Stam <mstam(a)ripe.net> wrote: >> >> Hi Ernst, >> >> First of all, thanks for the logs. >> >> I will group all the individual subtopics of this email :) I hope I caught all of them. If not, you know where to find me. >> >> Centos VM install: >> =============== >> I just did a clean install on a VM here, it seems there’s indeed something wrong with the repository on our end. YUM does not seem to find the atlasswprobe package. I’ll have a look why this is and get back to you. >> >> Traceroute in Docker for Windows: >> =========================== >> I have not seen this combination before. I do know that we’re doing very low-level networking communication to get such as traceroute & ping to work. We could try and see if this works, but there is a chance that this is reaching a limitation within Linux containers under Windows. Are you aware of any that may affect this? >> (Raw IP sockets). >> >> Speed on VMs: >> ============= >> I’m not sure its related, but in a previous life I did quite a few tests on the LAN with iPerf. I noticed that performance reports with Windows (hosts) were consistently lower than with Linux hosts. No VMs involved, running on the host itself (flat point-to-point without firewalls etc). Maximum speed I’ve ever observed with 2 Linux laptops and iPerf over a 1G switch is around the 900-930Mbps. If Windows laptops were involved (same hardware), typically 700-800 Mbps. >> >> I’ll add that these were my observations at the time, and mileage may vary on other hardware/OS combinations. I used a Dell Latitude and a Dell Precision laptop. I never investigated further than this, because my goal was to test the infrastructure, not the endpoints. It may be relevant here, though. >> >> OpenWRT: >> ========= >> There’s a bit of history here. The measurement code of Atlas was derived from a Busybox release at some point in the distant past. The telnetd from Busybox was repurposed to host a process for the backend to communicate with the probe. So while its called telnetd, its not the telnetd that you’d expect in a regular Linux system, it works quite differently from the original purpose of telnetd (a shell). I believe software probes typically install it in /usr/local/atlas/bb-13.3/bin. >> >> It seems the community probe installs files in /usr/libexec/atlas-probe, so there’s the first difference. The startup scripts also do things quite a bit different than the RIPE NCC version does. This may be a second indication. >> There’s also a rpcd process added that works differently. >> >> We do have a cleanup of the way the software probe works on our roadmap, and it will be good to touch base with the author of the community version to align. As yet, it seems the community version and the RIPE NCC version have diverged somewhat. As yet, it is probably better to contact the author of the community version for this particular issue. >> >> Windows: >> ======== >> A Windows port would mean looking at what is feasible on the Windows platform, which may involve significant recoding, if not rewriting. Even libraries such as MINGW32 might not fully resolve this. >> We would appreciate if someone would be willing to put time into such an effort, otherwise I don’t think we will be able to create such a version in the near future. >> >> I am curious though, how would a Windows version of the probe software work better for you than the existing Linux version? >> >> Will keep you posted on the CentOS bug. >> >> Regards, >> >> Michel >> >>> On 5 Jul 2022, at 18:50, Ernst J. Oud <ernstoud(a)gmail.com <mailto:ernstoud@gmail.com>> wrote: >>> >>> Michel, >>> >>> Twice (once in Docker Desktop for Windows and once in VMware Player 16) I exactly followed the instructions as in https://github.com/RIPE-NCC/ripe-atlas-probe-doc/blob/master/manuals/CentOS… <https://github.com/RIPE-NCC/ripe-atlas-probe-doc/blob/master/manuals/CentOS…> and twice in the last step, the actual installation of the binary package (yum install atlasswprobe), yum complained that there was no such package. I then downloaded it directly from https://ftp.ripe.net/ripe/atlas/software-probe/centos7/noarch/ripe-atlas-re… <https://ftp.ripe.net/ripe/atlas/software-probe/centos7/noarch/ripe-atlas-re…> and did a yum install of that package which worked fine. >>> >>> Traceroute in Linux containers on Docker Desktop for Windows is known to not work (see: https://github.com/moby/vpnkit/issues/194 <https://github.com/moby/vpnkit/issues/194>) and in VMware it only works in bridge mode. >>> >>> However on the Windows 10 PC on which I run hourly SpeedTests and ping tests those tests were impacted after installation of VMWare, CentOS and the probe on that PC. I have gigabit fiber and instead of 940/940 Mbps. the speeds fluctuated, between 900/900 and 900/800. Perhaps an effect of VMware bridge mode on a physical Ethernet port shared with the Windows host. >>> >>> When using NAT mode in VMware on that PC again traceroute did not work, only the first hop is shown, subsequent hops showed * * *. >>> >>> Not to worry, I installed the probe on CentOS on VMware on another dedicated mini Windows 10 PC using bridged network mode and all is well. (Another PC in my home network…). >>> >>> Earlier On OpenWRT 21.01 I installed the probe from the Luci GUI, i.e. https://openwrt.org/packages/pkgdata/atlas-probe <https://openwrt.org/packages/pkgdata/atlas-probe>. This is the community version. It ran fine but I didn’t want to sacrifice a router just for this purpose. >>> >>> Why the ATLAS script fails to load telnetd in that OpenWRT environment is beyond me. Manual installs of telnetd worked fine so the executable is found. No errors in dmesg or anywhere else. Logging in via SSH and doing an “/etc/init.d/atlas stop” and then an “/etc/init.d/atlas start” worked fine. Perhaps telnetd is started from init.d with priority S30 too early in the boot process? >>> >>> As stated above, the install of the SW probe requires on Windows a hypervisor or VMware (perhaps Virtualbox will also work) which means that Windows users must be able to know how that all works and must have basic Linux knowledge. Perhaps a Windows version of the probe would mean a lot more probes in future? Hard to estimate whether it is worth the development effort for RIPE. Ping, traceroute and scheduling work fine in Windows so a Windows app is technically possible but a lot of work perhaps. >>> >>> Let me know if the issue of step 4 of the install under CentOS cannot be reproduced, then I will do it again with a log of all commands issued, but I cut/pasted the commands from the installation instructions mentioned above. So I am pretty sure there is a small error on the RIPE end of things. I see there are 3 versions of the binary on the RIPE FTP site mentioned above, perhaps yum as instructed in the instructions loads the wrong version? >>> >>> Thanks for your time. >>> >>> Met vriendelijke groet / Regards, >>> >>> Ernst J. Oud >>> >>>> On 5 Jul 2022, at 13:26, Michel Stam <mstam(a)ripe.net <mailto:mstam@ripe.net>> wrote: >>>> >>>> Hi Ernst, >>>> >>>> Sorry to hear you are having issues with installing the probe software. >>>> >>>> Can you maybe provide a step by step instruction how you got to the yum atlasswprobe error? I would like to check that everything is ok on our end. >>>> >>>> Secondly, regarding the bandwidth problems, can you explain what kind of issues you experience in non-bridged modes? What have you tried, and what was the result? Traceroute is known to work through NAT connections, which is typically what hypervisors use to share the connection (if bridging is not used). >>>> >>>> On your OpenWRT probe installation attempt, it seems there are 2 versions in the field; >>>> A version maintained by RIPE NCC used solely for the hardware probes. >>>> A community package written by the OpenWRT community, which uses the software probe implementation >>>> You mentioned having startup problems with the telnet daemon on the OpenWRT community package, I cannot say why this is, but the most likely culprit is the software not being able to find the location of the binary. Do you get any errors during startup? >>>> >>>> On a Windows implementation, there has not been a decision to do so as yet, I’m not sure whether the raw packets that are sent by the various measurements would work with Windows, but to be honest, this has not been investigated. Can you explain your use case for a Windows based implementation? >>>> >>>> Regards, >>>> >>>> Michel >>>> >>>>> On 2 Jul 2022, at 19:23, Ernst J. Oud <ernstoud(a)gmail.com <mailto:ernstoud@gmail.com>> wrote: >>>>> >>>>> Don’t know whether this is the place to share experiences but … >>>>> >>>>> I installed a SW probe in Docker for Windows (the Alpine version). Turns out traceroute doesn’t work in that setup. So I installed VMware player on that PC (the latest version can coexist with Hyper-V which Docker requires) and CentOS and the binary of the probe. Of which the instructions on the Ripe Atlas site doesn’t work in the last step (yum complains no package atlasswprobe found in the repo). Manual download and install did work however. Hurrah. >>>>> >>>>> Turns out traceroute in that setup only works with VMware in bridged network mode. Fine. But… all my bandwidth tests on that same box suddenly showed strange impacts… so either a working probe and accept incorrect bandwidth tests (using Ookla SpeedTest) or find another solution. Apparently the bridge in VMware and Windows on the same physical Ethernet port influence each other. >>>>> >>>>> Tried the probe on OpenWRT on a small router. Works fine but I don’t want to dedicate this router to just probe work. Also the ATLAS service from init.d refuses to run the telnetd daemon at startup. Weird. >>>>> >>>>> So installed VMware on a separate Windows 10 headless box (Minix Z83) that I had spare with CentOS and the binary. Runs fine. Finally. >>>>> >>>>> Will kill the other two probes once I am convinced it now finally works. >>>>> >>>>> Thanks Ripe for this excellent tool! A Windows version would help however :-) >>>>> >>>>> Regards, >>>>> >>>>> Ernst >>>>> -- >>>>> ripe-atlas mailing list >>>>> ripe-atlas(a)ripe.net <mailto:ripe-atlas@ripe.net> >>>>> https://lists.ripe.net/mailman/listinfo/ripe-atlas <https://lists.ripe.net/mailman/listinfo/ripe-atlas> >>>> >>

1 0

My experiences with a SW probe…
by Ernst J. Oud 05 Jul '22

05 Jul '22

Don’t know whether this is the place to share experiences but … I installed a SW probe in Docker for Windows (the Alpine version). Turns out traceroute doesn’t work in that setup. So I installed VMware player on that PC (the latest version can coexist with Hyper-V which Docker requires) and CentOS and the binary of the probe. Of which the instructions on the Ripe Atlas site doesn’t work in the last step (yum complains no package atlasswprobe found in the repo). Manual download and install did work however. Hurrah. Turns out traceroute in that setup only works with VMware in bridged network mode. Fine. But… all my bandwidth tests on that same box suddenly showed strange impacts… so either a working probe and accept incorrect bandwidth tests (using Ookla SpeedTest) or find another solution. Apparently the bridge in VMware and Windows on the same physical Ethernet port influence each other. Tried the probe on OpenWRT on a small router. Works fine but I don’t want to dedicate this router to just probe work. Also the ATLAS service from init.d refuses to run the telnetd daemon at startup. Weird. So installed VMware on a separate Windows 10 headless box (Minix Z83) that I had spare with CentOS and the binary. Runs fine. Finally. Will kill the other two probes once I am convinced it now finally works. Thanks Ripe for this excellent tool! A Windows version would help however :-) Regards, Ernst

2 1

Connectivity Issue - Software Probe ID 1002750
by Thomas Kessler 02 Jul '22

02 Jul '22

Hi there, a software probe of mine - ID 1002750 - has stop working about 30 days ago and I seem not to be able to get it to connect again. tcpdump shows plenty of communication between the probe and reg03 / reg04.atlas.ripe.net. As well, the probe sending SOS DNS queries but neither seem to have any effect. RIPE Atlas Console shows the probe as being descended and the SOS DNS queries are not reported there either. I've check the probes registered public key and there should be no issue. Any ideas? Best regards Thomas

1 0

Overuse of software probes
by Ponikierski, Grzegorz 30 Jun '22

30 Jun '22

Hello all! Software probes is great improvement for Atlas environment and it made deployments so much easier and more scalable. One of my probes is also software probe on Raspberry Pi. However, me and my team noticed that sometimes software probes are overused and make measurements more cumbersome to interpret. For example we found that there 4 software probes in AWS Johannesburg [1] and 15 software probes in Hostinger Sao Paulo [2]. That's total overkill. These 15 probes in Hostinger Sao Paulo is 21% of all connected probes in Brazil. All of them delivers practically the same results so without additional data filtering (which is not easy) they can dramatically skew final results for Brazil. With this I would like to open discussion how to handle this situation. Please share your thoughts about these questions: * How can we standardize data filtering for such case? * How to proactively and automatically detect overuse of probes? * How can we encourage software probes hosts to avoid deployments in data centers which are already covered by Atlas? * How to give incentives to deploy probes in data centers without existing probes? [1] 4 software probes inside AWS Johannesburg: 1000707<https://atlas.ripe.net/frames/probes/1000707/> 1001397<https://atlas.ripe.net/frames/probes/1001397/> 1002066<https://atlas.ripe.net/frames/probes/1002066/> 1002632<https://atlas.ripe.net/frames/probes/1002632/> [2] 15 software probes inside Hostinger Sao Paulo 1003554<https://atlas.ripe.net/frames/probes/1003554/> 1003555<https://atlas.ripe.net/frames/probes/1003555/> 1003556<https://atlas.ripe.net/frames/probes/1003556/> 1003557<https://atlas.ripe.net/frames/probes/1003557/> 1003558<https://atlas.ripe.net/frames/probes/1003558/> 1003559<https://atlas.ripe.net/frames/probes/1003559/> 1003560<https://atlas.ripe.net/frames/probes/1003560/> 1003561<https://atlas.ripe.net/frames/probes/1003561/> 1003562<https://atlas.ripe.net/frames/probes/1003562/> 1003563<https://atlas.ripe.net/frames/probes/1003563/> 1003564<https://atlas.ripe.net/frames/probes/1003564/> 1003565<https://atlas.ripe.net/frames/probes/1003565/> 1003566<https://atlas.ripe.net/frames/probes/1003566/> 1003567<https://atlas.ripe.net/frames/probes/1003567/> 1003568<https://atlas.ripe.net/frames/probes/1003568/> Regards, Grzegorz Ponikierski

13 19